jacobswan1

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1

Tune-A-Video

[ICCV 2023] Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

Rerender_A_Video

[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models

Video-LLaVA

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

co-tracker

CoTracker is a model for tracking any point (pixel) on a video.

make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

dreamoving-project

Official implementation of DreaMoving

Mora

Mora: More like Sora for Generalist Video Generation

MotionCtrl

MotionCtrl: A Unified and Flexible Motion Controller for Video Generation

FollowYourPose

[AAAI 2024] Follow-Your-Pose: This repo is the official implementation of "Follow-Your-Pose : Pose-Guided Text-to-Video Generation using Pose-Free Videos"

InternVideo

Video Foundation Models & Data for Multimodal Understanding

Text-To-Video-Finetuning

Finetune ModelScope's Text To Video model using Diffusers 🧨

SCUNet

Practical Blind Denoising via Swin-Conv-UNet and Data Synthesis (Machine Intelligence Research 2023)

unified-io-2

Panda-70M

[CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

svd-temporal-controlnet

control-a-video

Official Implementation of "Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models"

FreeNoise

[ICLR 2024] Code for FreeNoise based on VideoCrafter

VideoSwap

Code for [CVPR 2024] VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

Gen-L-Video

The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".

VideoFlow

Official implementation of ICCV2023 VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation

mPLUG-2

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

VideoLDM

Unofficial PyTorch implementation of the VideoLDM.

retrieval-augmented-diffusion-models

Official codebase for the Paper “Retrieval-Augmented Diffusion Models”

make-a-stable-diffusion-video

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch - fork with video pseudo3d

comfyui-svd-temporal-controlnet

SAVE

ReDiffusion