lymhust

Real-Time-Voice-Cloning

Clone a voice in 5 seconds to generate arbitrary speech in real-time

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

CodeFormer

[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer

AnimateAnyone

Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation

EMO

Emote Portrait Alive: Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

ToonCrafter

a research paper for generative cartoon interpolation

AniPortrait

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Rerender_A_Video

[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

MuseTalk

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

V-Express

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.

Latte

Latte: Latent Diffusion Transformer for Video Generation.

AniTalker

[ACM MM 2024] This is the official code for "AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding"

Awesome-Talking-Face

📖 A curated list of resources dedicated to talking face.

sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111

PuLID

Official code for PuLID: Pure and Lightning ID Customization via Contrastive Alignment

chinese_speech_pretrain

chinese speech pretrained models

Real3DPortrait

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis; ICLR 2024 Spotlight; Official code

MakeItTalk

AnyV2V

Code and data for "AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Tasks"

Portrait-4D

Portrait4D: Learning One-Shot 4D Head Avatar Synthesis using Synthetic Data (CVPR 24); Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizer (ECCV 2024)

Emote-hack

Emote Portrait Alive - using ai to reverse engineer code from white paper. (abandoned)

AnimateAnyone-reproduction

reproduction of AnimateAnyone

Awesome_Audio-driven_Talking-Face-Generation

A curated list of resources of audio-driven talking face generation

Sky-Segmentation-and-Post-processing

PDF-Unlocker

加密pdf文件解锁工具

speech-to-text

Speech to Text with Hugging Face and Wav2vec 2.0

DC-AI-LipReading

ebsynth

Fast Example-based Image Synthesis and Style Transfer