lip-sync

There are 55 repositories under lip-sync topic.

• facefusion / facefusion

  Industry leading face manipulation platform

  deepfakefaceswapaiwebcamdeep-fakeface-swaplip-synclipsync
  Language:Python 20349

• lipku / LiveTalking

  Real time interactive streaming digital human

  digital-humannerfrealtimestreamingaigcdigihumanmusetalkvirtualhumanswav2liper-nerflip-synctalking-headmetahuman-stream
  Language:Python 4150

• TMElyralab / MuseTalk

  MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

  lip-syncvirtualhumans
  Language:Python 3136

• DanielSWolf / rhubarb-lip-sync

  Rhubarb Lip Sync is a command-line tool that automatically creates 2D mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.

  animationclicommand-linegame-developmentlip-sync
  Language:C++ 1876
• sd-wav2lip-uhq

  numz / sd-wav2lip-uhq

  Wav2Lip UHQ extension for Automatic1111

  lip-synclipsyncstable-diffusion-web-uistable-diffusion-webuistable-diffusion-webui-pluginwav2lipaudio-driven-talking-facedeep-fakedeep-fakesimage-animationtalking-facetalking-face-generationtalking-headmeta-human-creatorface-swappingfaceswap
  Language:Python 1315

• hecomi / uLipSync

  MFCC-based LipSync plug-in for Unity using Job System and Burst Compiler

  unitylip-syncburst-compilerjob-systemmicrophonetimelinevrmwebgl
  Language:C# 1104
• wunjo.wladradchenko.ru

  wladradchenko / wunjo.wladradchenko.ru

  Wunjo CE: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.

  freewunjoface-swapsegment-anythingdeepfakediffusion-modelsimg2videolip-syncremoverrestyletxt2videovoice-clonecontrolnetface-animationphoto-editingpublic-apiremove-backgroundvideo-editingvideo-generation
  Language:Python 913

• Henry-23 / VideoChat

  实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

  asrdialogue-systemsdigital-humanend-to-endgradio-python-applip-syncmultimodal-large-language-modelsmusetalkreal-timestreamingtalking-headtts
  Language:Python 554

• jdh-algo / JoyVASA

  audio-driven-talking-facegenerative-ailip-syncportrait-animationtalking-head
  Language:Python 553

• Markfryazino / wav2lip-hq

  Extension of Wav2Lip repository for processing high-quality videos.

  deep-learninglip-sync
  Language:Python 538
• TalkingHead

  met4citizen / TalkingHead

  Talking Head (3D): A JavaScript class for real-time lip-sync using Ready Player Me full-body 3D avatars.

  3d-avatarlip-syncready-player-metalking-avatartalking-headtext-to-speech
  Language:JavaScript 377

• facefusion / facefusion-docker

  Industry leading face manipulation platform

  aideepfakedockerfaceswapdeep-fakeface-swaplip-synclipsyncwebcam
  350

• sahilg06 / EmoGen

  PyTorch Implementation for Paper "Emotionally Enhanced Talking Face Generation" (ICCVW'23 and ACM-MMW'23)

  emotionlip-syncmultimodalpytorchtalking-face-generationemotion-recognitiondeepfakeswav2lipaudio-driven-talking-faceface-reenactment
  Language:Python 349

• facefusion / facefusion-pinokio

  Industry leading face manipulation platform

  aideepfakefaceswappinokiodeep-fakeface-swaplip-syncwebcamlipsync
  Language:JavaScript 244

• pranauv1 / AI-Video-Translation

  A simple Google Colab notebook which can translate an original video into multiple languages along with lip sync.

  lip-synctranslationvoice-cloning
  Language:Jupyter Notebook 231

• asanchezyali / talking-avatar-with-ai

  This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

  ai-avatarsdigital-humanelevenlabsllmsopenai-apirhubarb-lip-syncwhisperlip-syncvisemeslipsync
  Language:JavaScript 213

• instant-high / wav2lip-onnx-HQ

  Full version of wav2lip-onnx including face alignment and face enhancement and more...

  face-alignmentface-enhancerlip-synclipsynconnx-models
  Language:Python 76

• junhwanjang / visemenet-inference

  3D Avatar Lip Synchronization from speech (JALI based face-rigging)

  visemenetlip-syncretargetingtensorflow2tensorflowface-rigging
  Language:Python 75

• amtsai96 / Learning-Lip-Sync-from-Audio

  Learning Lip Sync of Obama from Speech Audio

  audioliplip-synclstmmouth-trackingobamaspeech-synthesis
  Language:Python 67

• talkr-app / gif-talkr

  JavaScript library animating a GIF file to speech (or TTS)

  gifttsanimationlipsynclip-sync
  Language:JavaScript 55

• voletiv / syncnet-in-keras

  Keras version of Syncnet, by Joon Son Chung and Andrew Zisserman.

  lip-synckerasdeep-learning
  Language:Python 51

• Aml-Hassan-Abd-El-hamid / ai-lip-sync-app

  AI Lip Syncing application, deployed on Streamlit

  ailip-syncstreamlitwav2lip
  Language:Python 34

• markleybros / yer-face

  YerFace! A stupid facial performance capture engine for cartoon animation.

  cartoon-animationlip-syncperformance-captureyerface
  Language:C++ 34

• Bomou-AI / Talking-Head

  AI Talking Head: create video from plain text or audio file in minutes, support up to 100+ languages and 350+ voice models.

  ai-avatarai-avatarslip-animationlip-synctalking-facetalking-headtalking-head-videostalking-headstalking-robottext-to-videovideo-synthesiswav2lip
  32

• instant-high / wav2lip-onnx-256

  Simple and fast wav2lip using new 256x256 resolution trained onnx-converted model for inference. Easy installation

  lip-synclipsynconnx-models
  Language:Python 30

• instant-high / wav2lip-onnx

  simple and fast wav2lip using onnx models for face-detection and inference. Easy installation

  lip-synclipsynconnx-modelsonnxruntime
  Language:Python 23

• interaction-lab / PyLips

  A package for simple, expressive, and customizable text-to-speech with an animated face.

  conversational-agentshuman-computer-interactionhuman-robot-interactionlip-synclip-synchronizationpython
  Language:Python 23

• Christoferis / RhubarbBarbara

  A Python GUI script designed to work with Rhubarb Lip Sync to create mouth animation fast and easy in just mere seconds (depending on video length)

  rhubarbpythonmoviepyvideo-creationlip-syncvideoqtqt6pyside6ffmpeg
  Language:Python 20

• peterwisu / lip-synthesis

  Audio-Visual Lip Synthesis via Intermediate Landmark Representation

  deep-learningdeepfakesgenerative-ailip-sync
  Language:Python 16

• asanchezyali / ai-avatar

  Zippy Talking Avatar uses Azure Cognitive Services and OpenAI API to generate text and speech. It is built with Next.js and Tailwind CSS. This avatar responds to user input by generating both text and speech, offering a dynamic and immersive user experience

  aillmtalking-headazure-cognitive-servicesgptopenaitts-apilangchainai-avatarstalking-headsdigital-humanlip-syncvisemes
  Language:TypeScript 13

• nsourlos / end-to-end_deepfake_colab

  Create deepfake video by just uploading the original video and specifying the text the character will read

  colab-notebookdeepfakedeepfakeslip-syncmoviepypydubtext-to-speechtext-to-videotortoisettsvoice-clonevoice-cloningwav2lip
  Language:Jupyter Notebook 12

• furrtek / Svengali

  GUI authoring tool for Teddy Ruxpin tapes

  teddyruxpinauthoringaudiotapepuppetanimationanimatroniclip-sync
  Language:Python 11

• deepbrainai-research / float

  Project page for FLOAT; Flow Matching for Audio-driven Talking Portrait Video Generation

  audio-driven-portrait-animationslip-syncvideo-generation
  Language:HTML 8

• nishad / Papagayo

  Papagayo is a lip-syncing program to line up phonemes (mouth shapes) with the recorded sound of actors speaking

  animationlip-syncsoundpapagayo
  Language:C 6

• messengerbag / TotalLipSync

  Adventure Game Studio (AGS) module for lip sync

  agsadventure-game-studiorhubarblip-syncags-script
  Language:AGS Script 5

• TokageItLab / godot-audio-processing

  Godot audio processing.

  audio-processinglip-syncgodotgodot-engine
  Language:GDScript 4