audio-visual-speech-recognition

There are 2 repositories under audio-visual-speech-recognition topic.

modelscope / FunASR
A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.
audio-visual-speech-recognition conformer dfsmn paraformer pretrained-model punctuation pytorch rnnt speaker-diarization speech-recognition speechgpt speechllm vad voice-activity-detection whisper
Language:Python 3968
smeetrs / deep_avsr
A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.
audio-visual-speech-recognition speech-recognition lip-reading automatic-speech-recognition speech-to-text visual-speech-recognition
Language:Python 189
ankurbhatia24 / MULTIMODAL-EMOTION-RECOGNITION
Human Emotion Understanding using multimodal dataset.
deeplearning deep-learning machine-learning keras audio-visual audio-visualization audio-visual-speech-recognition python tensorflow multimodal-emotion-recognition librosa opensmile
Language:Jupyter Notebook 75
georgesterpu / Taris
Transformer-based online speech recognition system with TensorFlow 2
online speech-recognition speech-recognizer audio-visual-speech-recognition audio-visual multimodal multimodal-deep-learning transformer tensorflow tensorflow2 python mahcine-learning deep-learning taris live-caption
Language:Python 25
lzuwei / end-to-end-multiview-lipreading
End to End Multiview Lip Reading
audio-visual-speech-recognition deep-learning end-to-end-learning
Language:Python 10
hmeutzner / kaldi-avsr
Kaldi-based audio-visual speech recognition
speech-recognition kaldi deep-neural-networks avsr asr audio-visual-speech-recognition
Language:Shell 6
karlsimsBBC / cassette-bot
🤖 📼 Command-line tool for remixing videos with time-coded transcriptions.
text-to-video audio-visual-speech-recognition video
Language:Python 5
Remi-Gau / McGurk_prior_code
Code related to the fMRI experiment on the contextual modulation of the McGurk Effect
fmri fmri-data-analysis multisensory-integration audio-visual-speech-recognition
Language:MATLAB 1
luomingshuang / lipreading_with_icefall
In this repository, I try to use k2, icefall and Lhotse for lip reading. I will modify it for the lip reading task. Many different lip-reading datasets should be added. -_-
lip-reading k2 icefall visual-speech-recognition audio-visual-speech-recognition
Language:Python 0
MaazKhan98 / Multimodal-Emotion-Recognition-speech-facial-and-body-gestures
Human Emotion Understanding using multimodal dataset
audio-visual-speech-recognition deep-learning machine-learning tensorflow
Language:Jupyter Notebook 0