talking-head

There are 68 repositories under talking-head topic.

OpenTalker / SadTalker
[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
audio-driven-talking-face cvpr2023 deep-fake deep-fakes image-animation talking-face talking-face-generation talking-head talking-heads
Language:Python 12120
AIGC-Audio / AudioGPT
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
audio gpt music sound speech talking-head
Language:Python 10066
lipku / LiveTalking
Real time interactive streaming digital human
digital-human nerf realtime streaming aigc digihuman musetalk virtualhumans wav2lip er-nerf lip-sync talking-head metahuman-stream
Language:Python 4149
yoyo-nb / Thin-Plate-Spline-Motion-Model
[CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.
deep-learning deepfake face-animation face-reenactment image-animation motion-transfer pose-transfer talking-head
Language:Jupyter Notebook 3490
echomimic
antgroup / echomimic
EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning
audio-driven-portrait-animations audio-driven-talking-face human-animation talking-face-generation talking-head
Language:Python 3282
antgroup / echomimic_v2
EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation
audio-driven-body-animation audio-driven-portrait-animations audio-driven-talking-face human-animation talking-face-generation talking-head
Language:Python 1908
ali-vilab / dreamtalk
Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models
audio-visual-learning face-animation talking-head video-generation
Language:Python 1646
harlanhong / awesome-talking-head-generation
face-reenactment image-animation motion-transfer talking-head
1539
ZiqiaoPeng / SyncTalk
[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"
talking-face-generation talking-head audio-driven-talking-face talking-face cvpr cvpr2024
Language:Python 1376
sd-wav2lip-uhq
numz / sd-wav2lip-uhq
Wav2Lip UHQ extension for Automatic1111
lip-sync lipsync stable-diffusion-web-ui stable-diffusion-webui stable-diffusion-webui-plugin wav2lip audio-driven-talking-face deep-fake deep-fakes image-animation talking-face talking-face-generation talking-head meta-human-creator face-swapping faceswap
Language:Python 1315
harlanhong / CVPR2022-DaGAN
Official code for CVPR2022 paper: Depth-Aware Generative Adversarial Network for Talking Head Video Generation
depth face gan talking-head deepfake face-reenactment image-animation motion-transfer
Language:Python 975
Kedreamix / Awesome-Talking-Head-Synthesis
💬 An extensive collection of exceptional resources dedicated to the captivating world of talking face synthesis! ⭐ If you find this repo useful, please give it a star! 🤩
arxiv paper audio-driven synthesis talking-face-generation talking-head talking-head-video-generation
896
Weizhi-Zhong / IP_LAP
CVPR2023 talking face implementation for Identity-Preserving Talking Face Generation With Landmark and Appearance Priors
talking-face-generation talking-head audio-driven-talking-face cvpr2023
Language:Python 710
primepake / wav2lip_288x288
deep-learning generation generative talking-head video face-talking audio-driven-talking-face deep-fake deep-fakes image-animation talking-face talking-face-generation
Language:Python 591
Henry-23 / VideoChat
实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.
dialogue-systems real-time digital-human gradio-python-app lip-sync musetalk streaming talking-head asr tts end-to-end multimodal-large-language-models
Language:Python 555
jdh-algo / JoyVASA
audio-driven-talking-face generative-ai lip-sync portrait-animation talking-head
Language:Python 553
Text2Video
sibozhang / Text2Video
ICASSP 2022: "Text2Video: text-driven talking-head video synthesis with phonetic dictionary".
aigc avatar deep-learning digital-humanities gan generative-ai icassp metaverse speech-synthesis talking talking-face-generation talking-head talking-heads text-to-video tts vid2vid video virtual-humans
Language:Python 430
TalkingHead
met4citizen / TalkingHead
Talking Head (3D): A JavaScript class for real-time lip-sync using Ready Player Me full-body 3D avatars.
3d-avatar lip-sync text-to-speech talking-head ready-player-me talking-avatar
Language:JavaScript 379
tanshuai0219 / EDTalk
[ECCV 2024 Oral] EDTalk - Official PyTorch Implementation
audio-visual-learning face-animation talking-face-generation talking-head video-generation
Language:Python 364
flyingby / Awesome-Deepfake-Generation-and-Detection
A Survey on Deepfake Generation and Detection
deepfake-detection deepfakes face-attribute-manipulation face-swap reenactment talking-face-generation talking-head
353
wangsuzhen / Audio2Head
code for paper "Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion" in the conference of IJCAI 2021
talking-head multi-modal talking-face paper ijcai2021 codes
Language:Python 334
theEricMa / OTAvatar
This is the official repository for OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering [CVPR2023].
cvpr2023 deep-learning deepfake face-animation face-reenactment image-animation motion-transfer pose-transfer pytorch talking-head
Language:Python 315
harlanhong / ICCV2023-MCNET
The official code of our ICCV2023 work: Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation
animation deepfake face gan image-generation motion-transfer reenactment talking-face-generation talking-head
Language:Python 249
johnGettings / LIHQ
Long-Inference, High Quality Synthetic Speaker (AI avatar/ AI presenter)
artificial-intelligence avatar avatar-generator deep-learning text-to-speech video talking-head
Language:Python 243
DiffPoseTalk / DiffPoseTalk
DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models
3d-facial-animation diffusion-models facial-animation speech-driven talking-head
Language:Python 221
shivangi-aneja / FaceTalk
[CVPR 2024] FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models
3d-facial-animation cvpr2024 diffusion-models facial-animation implicit-neural-representation speech-driven speech-driven-talking-face talking-face-generation talking-head
Language:Shell 211
TheTempAccount / Co-Speech-Motion-Generation
Freeform Body Motion Generation from Speech
co-speech-gesture generation-algorithms gesture-controller talking-head
Language:Python 199
Yazdi9 / Talking_Face_Avatar
Avatar Generation For Characters and Game Assets Using Deep Fakes
audio-to-video conversational-ai deep-fake generative-ai talking-face talking-head text-to-video tts video-generation api avatar-generation elevenlabs image-generation leonardoai llms prompt-engineering
Language:Jupyter Notebook 195
Hanbo-Cheng / DAWN-pytorch
Offical implement of Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for talking head Video Generation
image-animation talking-head video-generation
Language:Python 189
shrubb / latent-pose-reenactment
The authors' implementation of the "Neural Head Reenactment with Latent Pose Descriptors" (CVPR 2020) paper.
deep-learning head-reenactment face-reenactment talking-head generative-model pose-estimation landmark-detection facial-landmarks self-supervised-learning voxceleb voxceleb2 head-avatar avatar pytorch
Language:Python 181
foivospar / NED
PyTorch implementation for NED (CVPR 2022). It can be used to manipulate the facial emotions of actors in videos based on emotion labels or reference styles.
3dmm emotion cvpr2022 pytorch deepfakes gan expression-manipulation face-edit image-generation talking-head face
Language:Python 157
nihaomiao / WACV23_TSNet
The pytorch implementation of our WACV23 paper "Cross-identity Video Motion Retargeting with Joint Transformation and Synthesis".
deep-fake video-generation video-motion-retargeting motion-transfer talking-head
Language:Python 146
Spycsh / xtalker
Faster Talking Face Animation on Xeon CPU
aigc cpu sadtalker talking-head xeon
Language:Python 123
sibozhang / Speech2Video
Code for ACCV 2020 "Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses"
3d accv aigc body computer-vision face gan generative-ai gesture hand pose rnn simulation speech speech2video-synthesis talking-head talking-heads video
100
thuhcsi / Crystal.TTVS
Crystal TTVS engine is a real-time audio-visual Multilingual speech synthesizer with a 3D expressive avatar.
ttvs avatar talking-head avatar-generator facial-animation facial-expressions head-movements text-to-visual-speech text-to-audio-visual-speech visual-speech visual-speech-synthesis ttavs 3d-avatar xface
Language:C++ 84
rlgnswk / NeRFFaceSpeech_Code
One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior, CVPRW 2024
3d-head audio-driven-talking-face cvprw2024 image-animation nerf one-shot talking-head
Language:Python 57