google-research / mozolm

MozoLM: A language model (LM) serving library

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

GitHub license C++ version Build Tests (Linux) Build Tests (macOS) Build Tests (Windows) Build Tests (Android) Build Tests (iOS)

MozoLM

A language model serving library, with middleware functionality including mixing of probabilities from disparate base language model types and tokenizations along with RPC client/server interactions.

License

MozoLM is licensed under the terms of the Apache license. See LICENSE for more information.

Citation

If you use this software in a publication, please cite the accompanying paper from SLPAT 2022:

@inproceedings{roark-gutkin-2022-design,
    title = "Design principles of an open-source language modeling microservice package for {AAC} text-entry applications",
    author = "Roark, Brian and Gutkin, Alexander",
    booktitle = "Ninth Workshop on Speech and Language Processing for Assistive Technologies (SLPAT-2022)",
    month = may,
    year = "2022",
    address = "Dublin, Ireland",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.slpat-1.1",
    doi = "10.18653/v1/2022.slpat-1.1",
    pages = "1--16",
}

Mandatory Disclaimer

This is not an officially supported Google product.

About

MozoLM: A language model (LM) serving library

License:Apache License 2.0


Languages

Language:C++ 83.4%Language:Starlark 12.9%Language:Java 3.0%Language:Shell 0.6%Language:Smarty 0.1%