JulianJuaner

llama

Inference code for LLaMA models

whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

StableCascade

Official Code for Stable Cascade

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

co-tracker

CoTracker is a model for tracking any point (pixel) on a video.

consistencydecoder

Consistency Distilled Diff VAE

LayerDiffuse

Transparent Image Layer Diffusion using Latent Transparency

watermark-removal

a machine learning image inpainting task that instinctively removes watermarks from image indistinguishable from the ground truth image

Latte

Latte: Latent Diffusion Transformer for Video Generation.

Awesome-Video-Datasets

Video datasets

Hotshot-XL

✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

PIA

[CVPR 2024] PIA, your Personalized Image Animator. Animate your images by text prompt, combing with Dreambooth, achieving stunning videos. PIA，你的个性化图像动画生成器，利用文本提示将图像变为奇妙的动画

LaVie

LaVie: High-Quality Video Generation with Cascaded Latent Diffusion Models

X-Adapter

[CVPR 2024] X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model

video2dataset

Easily create large video dataset from video urls

distrifuser

[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

Magic-Me

Codes for ID-Specific Video Customized Diffusion

Panda-70M

[CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

FreeNoise

[ICLR 2024] Code for FreeNoise based on VideoCrafter

AnimateZero

Official PyTorch implementation for the paper "AnimateZero: Video Diffusion Models are Zero-Shot Image Animators"

FiT

[ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model

watermark-removal

通过水印减除方法去掉视频中的水印，快速但不完美

video-generation-survey

A reading list of video generation

VIRL

(ECCV 2024) Code for V-IRL: Grounding Virtual Intelligence in Real Life

oft

Official implementation of "Controlling Text-to-Image Diffusion by Orthogonal Finetuning".

JourneyDB

FreeNoise-AnimateDiff

[ICLR 2024] Code for FreeNoise based on AnimateDiff

DDSM

Denoising Diffusion Step-aware Models (ICLR2024)