askaydevs / ITN_Phore

Inverse text normalization

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Inverse text normalization

Improving Readability for Automatic Speech Recognition Transcription

Links

Models

MASS (Song et al., 2019) https://github.com/microsoft/MASS

Moses toolkit https://github.com/moses-smt/mosesdecoder

UniLM (Dong et al., 2019) https://github.com/microsoft/unilm

RoBERTa (Liu et al., 2019) https://github.com/pytorch/fairseq

RoBERTa-UniLM datasets

https://dumps.wikimedia.org/enwiki/latest/enwiki-latestpages-articles.xml.bz2

https://www.smashwords.com/books/category/1/downloads/0/free

http://data.statmt.org/news-crawl/en-doc

https://github.com/huggingface/transformers -- for fine tuning

About

Inverse text normalization


Languages

Language:Python 100.0%