yamand16

guided-diffusion

CREMA-D

Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)

HDTF

the dataset and code for "Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset"

yt-dlp

A feature-rich command-line audio/video downloader

av_hubert

A self-supervised learning framework for audio-visual speech

MDTVSFA

[official] Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training (IJCV 2021)

TalkLip

StyleSync

Official code of CVPR '23 paper "StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator"

Deep3DFaceRecon_pytorch

Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set (CVPRW 2019). A PyTorch implementation.

awesome_talking_face_generation

DINet

The source code of "DINet: deformation inpainting network for realistic face visually dubbing on high resolution video."

Palette-Image-to-Image-Diffusion-Models

Unofficial implementation of Palette: Image-to-Image Diffusion Models by Pytorch

PyTorch-VAE

A Collection of Variational Autoencoders (VAE) in PyTorch.

GFPGAN

GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.

video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

DeepLip

deep-learning based audio-visual lip bometrics

TaskMatrix

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.

VL-T5

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Awesome-Novel-Class-Discovery

A list of papers that studies Novel Class Discovery

gans-in-action

Companion repository to GANs in Action: Deep learning with Generative Adversarial Networks

muavic

MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation

instruct-pix2pix

Real-ESRGAN

Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

BasicSR

Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.

VQFR

ECCV 2022, Oral, VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder

facexlib

FaceXlib aims at providing ready-to-use face-related functions based on current STOA open-source methods.

YouRefIt_ERU

AAAI22-one-shot-talking-face

Code for One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning (AAAI 2022)