mpc001 / auto_avsr

Auto-AVSR: Lip-Reading Sentences Project

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to use AUTO-AVSR to train a Chinese AVSR model

MiningIrving opened this issue · comments

How to use AUTO-AVSR to train a Chinese AVSR model, e.g. using CMLR data sets.Visual_Speech_Recognition_for_Multiple_Languages this project came to my attention.What is the relationship between this project and the AUTO-AVSR project

Hi @MiningIrving, Auto-AVSR repository focuses on AV-ASR models and presents ASR, VSR, and AV-ASR results on LRS3 only, which includes both training and inference recipe. At this point, we have provided recipe for ASR and VSR models and will release AV-ASR recipe soon. The Visual_Speech_Recognition_for_Multiple_Languages repository focuses on VSR for multiple languages, which includes the inference recipe only. We have provided instructions to reconstruct a new dataset. Please feel free to review it.