fffiloni

video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

pyChatGPT

An unofficial Python wrapper for OpenAI's ChatGPT API

Hotshot-XL

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

dreamtalk

Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models

daclip-uir

PyTorch implementation of the paper "Controlling Vision-Language Models for Universal Image Restoration"

MiniGPT4-video

OOTDiffusion

Official implementation of OOTDiffusion

style-aligned

Official code for "Style Aligned Image Generation via Shared Attention"

AnyV2V

A Plug-and-Play Framework For Any Video-to-Video Editing Tasks. Now with gradio demo

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

champ

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

DemoFusion

Let us democratise high-resolution generation! (arXiv 2023)

PASD

Real3DPortrait

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis; ICLR 2024 Spotlight; Official code

AniPortrait

AniPortrait with Gradio: Audio-Driven Synthesis of Photorealistic Portrait Animation

BasicPBC

Official Implementation of "Learning Inclusion Matching for Animation Paint Bucket Colorization"

CameraCtrl

cog-autocaption

Add caption to any video

DiffBIR

diffusion-motion-transfer

Official Pytorch Implementation for "Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer""

DragNUWA

metavoice-src

AI for human-level speech intelligence

Open-Sora-Plan-v1-0-0

This project aim to reproduce Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.

ProPainter

[ICCV 2023] ProPainter: Improving Propagation and Transformer for Video Inpainting

pytorch-image-models

PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

radio-olympiades

StoryDiffusion

Create Magic Story!

TAO-Amodal

Official Code for Tracking Any Object Amodally

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

zest_code

This is the official implementation of ZeST