admwrd / LibreASR

:speech_balloon: An On-Premises, Streaming Speech Recognition System

LibreASR

An On-Premises, Streaming Speech Recognition System

Built with PyTorch and fastai

Example Apps

React Web App	ESP32-LyraT

Quickstart

docker run -it -p 8080:8080 iceychris/libreasr:latest

Head your browser to http://localhost:8080/

Features

• RNN-T network

• Fused language models

• Dynamic Bucketing DataLoader

• Dynamic Quantization

• english, german

• french, spanish, italian, multilingual

• Tuned language model fusion

Performance

Model	Dataset	Network	Params	CER (dev)	WER (dev)
english	1400h	6-2-1024	70M	18.9	23.8
german	800h	6-2-1024	70M	23.2	37.6

While this is clearly not SotA, training the models for longer and on multiple GPUs (instead of a single 2080 ti) would yield better results.

See releases for pretrained models.

Training

Language Model

See this colab notebook or use this notebook.

Contributing

Feel free to open an issue, create a pull request or join the Discord.

You may also contribute by training a large model for longer.

References & Credits

• Y. He et al., “Streaming End-to-end Speech Recognition For Mobile Devices,”

• A. Kannan et al., “Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model,”

• noahchalifour/rnnt-speech-recognition

• theblackcat102/Online-Speech-Recognition

• 1ytic/warp-rnnt

• VKCOM/YouTokenToMe