yuanpengtu

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

EMO

Emote Portrait Alive: Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

Latte

Latte: Latent Diffusion Transformer for Video Generation.

Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

DiS

Scalable Diffusion Models with State Space Backbone

Neural-Network-Parameter-Diffusion

We introduce a novel approach for parameter generation, named neural network parameter diffusion (p-diff), which employs a standard latent diffusion model to synthesize a new set of parameters

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

gemma_pytorch

The official PyTorch implementation of Google's Gemma models

DiffiT

[ECCV 2024] Official Repository for DiffiT: Diffusion Vision Transformers for Image Generation

FiT

[ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model

LWM

OpenSORA

A public repository for reproducing a open source sora comparable video generation model

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Cleaned-Webvid

Use strategy to achieve clean webvid-10m dataset

mergekit

Tools for merging pretrained large language models.

lumiere-pytorch

Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch

VIRL

Code for V-IRL: Grounding Virtual Intelligence in Real Life

segmoe

Video-Motion-Customization

VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models (CVPR 2024)

4DGen

"4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency", Yuyang Yin*, Dejia Xu*, Zhangyang Wang, Yao Zhao, Yunchao Wei

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

mamba

Mamba SSM architecture

custom-diffusion

Custom Diffusion: Multi-Concept Customization of Text-to-Image Diffusion (CVPR 2023)

llmblueprint

[ICLR 2024] Official code for the paper "LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Prompts"

Awesome-4D-Generation

An organized list of academic papers focused on the topic of 4D Generation. If you have any additions or suggestions, feel free to contribute.

4dfy

4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling

Free-Form-Video-Inpainting

Official Pytorch implementation of "Learnable Gated Temporal Shift Module for Deep Video Inpainting. Chang et al. BMVC 2019." and the FVI dataset in "Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN, Chang et al. ICCV 2019"

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

ProPainter

[ICCV 2023] ProPainter: Improving Propagation and Transformer for Video Inpainting