zhunge

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

ChatTTS

A generative speech model for daily dialogue.

paper-reading

深度学习经典、新论文逐段精读

LivePortrait

Bring portraits to life!

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

EMO

Emote Portrait Alive: Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

AniPortrait

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

duix.ai

wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit

SenseVoice

Multilingual Voice Understanding Model

audio2photoreal

Code and dataset for photorealistic Codec Avatars driven from audio

MuseV

MuseV: Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising

V-Express

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.

dreamoving-project

Official implementation of DreaMoving

dreamtalk

Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models

GeneFacePlusPlus

GeneFace++: Generalized and Stable Real-Time 3D Talking Face Generation; Official Code

AniTalker

[ACM MM 2024] This is the official code for "AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding"

MagicClothing

Official implementation of Magic Clothing: Controllable Garment-Driven Image Synthesis

Real3DPortrait

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis; ICLR 2024 Spotlight; Official code

VividTalk

VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior

megactor

Awesome-Talking-Head-Synthesis

💬 An extensive collection of exceptional resources dedicated to the captivating world of talking face synthesis! ⭐ If you find this repo useful, please give it a star! 🤩

StyleHEAT

[ECCV 2022] StyleHEAT: A framework for high-resolution editable talking face generation

wav2lip_288x288

StyleAvatar

Code of SIGGRAPH 2023 Conference paper: StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Video

diff2lip

EMOPortraits

Official implementation of EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars

PCDMs

Implementation code：Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models

AI_power

AI toolbox and pretrain models.