visual-speech-recognition

There are 6 repositories under visual-speech-recognition topic.

• mpc001 / Visual_Speech_Recognition_for_Multiple_Languages

  Visual Speech Recognition for Multiple Languages

  lipreadingvisual-speech-recognition
  Language:Python 446

• mpc001 / auto_avsr

  Auto-AVSR: Lip-Reading Sentences Project

  lipreadingvisual-speech-recognition
  Language:Python 384

• smeetrs / deep_avsr

  A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.

  audio-visual-speech-recognitionspeech-recognitionlip-readingautomatic-speech-recognitionspeech-to-textvisual-speech-recognition
  Language:Python 237

• sailordiary / LipNet-PyTorch

  "LipNet: End-to-End Sentence-level Lipreading" in PyTorch

  cnn-architecturedeep-learninglipreadingpytorch-implementationvisual-speech-recognition
  Language:Python 69

• georgesterpu / pyVSR

  Python toolkit for Visual Speech Recognition

  aamdcthidden-markov-modelsvisual-speech-recognitiontcdtimitpythonhmm
  Language:Python 38

• umbertocappellazzo / Llama-AVSR

  [ICASSP 2025] Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners".

  audio-visual-speech-recognitionlarge-language-modelsvisual-speech-recognition
  Language:Python 35

• VIPL-Audio-Visual-Speech-Understanding / deep-face-speechreading

  Visual speech recognition with face inputs: code and models for F&G 2020 paper "Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition"

  lip-readingvisual-speech-recognitionspeech-readingcomputer-visionpytorch
  Language:Python 19

• YasserdahouML / VSR_test_set

  WildVSR

  visual-speech-recognition
  Language:Python 17

• Megamind22 / lstArab100words

  Deep Visual Speech Recognition in arabic words

  computer-visionlip-readingpytorchvisual-speech-recognitionarabic
  Language:Jupyter Notebook 16

• david-gimeno / tailored-avsr

  Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"

  audio-visual-speech-recognitioninterpretabilitylipreadingparameter-efficientrobust-asrvisual-speech-recognition
  Language:Python 13

• Saeed-Biabani / LipReading

  Visual Speech Recognition using deep learing methods

  lipreadinglipreading-pytorchpythonpytorchvisual-speech-recognitionlipnet
  Language:Python 8

• YasserdahouML / Lip2Vec

  Lip2Vec

  visual-speech-recognition
  Language:Python 8

• manideep2510 / Lipreading-Keras

  Implementation of "Combining Residual Networks with LSTMs for Lipreading" in Keras and Tensorflow2.0

  deep-learningkeraslipreadinglipreading-keraslstmresnettensorflow2visual-speech-recognition
  Language:Python 5

• SMIL-SPCRAS / EMOLIPS

  EMOLIPS: TWO-LEVEL APPROACH FOR LIP-READING EMOTIONAL SPEECH

  automatic-speech-recognitionemotional-speechlip-readingvisual-speech-recognition
  Language:Python 5

• Pooventhiran / VSR

  Speaker-Independent Speech Recognition using Visual Features

  lip-readingvsrspeech-recognitionspeech-to-textvisual-speech-recognitionvisual-speechlipreading
  Language:Python 4

• david-gimeno / evaluating-end2end-spanish-lipreading

  Visual Speech Recognition for Spanish

  benchmarkevaluationlipreadingspanishvisual-speech-recognition
  Language:Jupyter Notebook 3

• BenedettoSimone / Lipnet-ITA

  LipReadingITA: Keras implementation of the method described in the paper 'LipNet: End-to-End Sentence-level Lipreading'. Research project for University of Salerno.

  deep-learninglipnetvisual-speech-recognition
  2

• elnaske / LipNet

  A single-speaker reimplementation of the LipNet architecture for lip reading.

  computer-visionlipnetpytorchvisual-speech-recognition
  Language:Python 2

• luomingshuang / lipreading_with_icefall

  In this repository, I try to use k2, icefall and Lhotse for lip reading. I will modify it for the lip reading task. Many different lip-reading datasets should be added. -_-

  lip-readingk2icefallvisual-speech-recognitionaudio-visual-speech-recognition
  Language:Python 2

• mohamed-gasser / Word-Level-LipReading-in-Arabic

  Deep Visual Speech Recognition in arabic words

  arabiccomputer-visiondeep-learninglip-readingmachine-learningpythonpytorchvisual-speech-recognition
  2

• BenedettoSimone / OnlineKD-LipNetITA

  Online Knowledge Distillation using LipNet and an Italian dataset. Master's Thesis Project.

  knowledge-distillationlipnetvisual-speech-recognition
  Language:Python 1

• sajR / V-SAD

  neural-networkmachine-learningspeech-activity-detectionvisual-speech-recognition
  Language:Python 1

• mitran27 / Multi-Factor-Authentication

  Strong Gateway using Speech Processing ,3D Vision and Language processing . Deployed using Django

  speech-recognitionspeaker-verificationvisual-speech-recognitionmetric-learningdjango
  Language:Jupyter Notebook 0