linzai1992

InstaFlow

:zap: InstaFlow! One-Step Stable Diffusion with Rectified Flow (ICLR 2024)

syncnet_python

Out of time: automated lip sync in the wild

VideoMamba

VideoMamba: State Space Model for Efficient Video Understanding

V3D

V3D: Video Diffusion Models are Effective 3D Generators

InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.

speech-datasets-collection

a curated list of speech datasets (110+ datasets, 75+ easy to download)

ZMM-TTS

ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

SpeechMOS

Easy-to-Use Speech MOS predictors

parler-tts

Inference and training library for high-quality TTS models.

MoVQGAN

MoVQGAN - model for the image encoding and reconstruction

TATS

Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)

MeBT

official implementation of the paper: Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers (CVPR 2023)

vqvae-vqgan-pytorch-lightning

VQ-VAE/GAN implementation in pytorch-lightning

taming-transformers

Taming Transformers for High-Resolution Image Synthesis

all-in-one

[CVPR2023] All in One: Exploring Unified Video-Language Pre-training

MiniSora-DiT

minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora

StableVITON

[CVPR2024] StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On

maskgit

Official Jax Implementation of MaskGIT

LOVECon

Official implementation for "LOVECon: Text-driven Training-free Long Video Editing with ControlNet"

tts-qa

dust3r

DUSt3R: Geometric 3D Vision Made Easy

CVTHead

[WACV 2024] "CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer"

ailab

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

minisora

MiniSora: A community aims to explore the implementation path and future development direction of Sora.

DynamiCrafter

DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

SoraReview

The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".