limbo0000

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

mamba

StableCascade

Official Code for Stable Cascade

gemma_pytorch

The official PyTorch implementation of Google's Gemma models

dust3r

DUSt3R: Geometric 3D Vision Made Easy

transformer-debugger

VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models

LLaMA2-Accessory

An Open-source Toolkit for LLM Development

VMamba

VMamba: Visual State Space Models，code is based on mamba

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

OpenDiT

OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

FRESCO

[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation

RingAttention

Transformers with Arbitrarily Large Context

attention_with_linear_biases

Code for the ALiBi method for transformer language models (ICLR 2022)

GRM

Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

SpaTracker

[CVPR 2024 Highlight] Official PyTorch implementation of SpatialTracker: Tracking Any 2D Pixels in 3D Space

Panda-70M

[CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content

ring-flash-attention

Ring attention implementation with flash attention

mickey

[CVPR 2024 - Oral] Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences

CameraCtrl

AdaMPI

[SIGGRAPH 2022] Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Images

MiraData

DiS

Scalable Diffusion Models with State Space Backbone

ect

Consistency Models Made Easy

Diffusion-RWKV

Scaling RWKV-Like Architectures for Diffusion Models

VidProM

VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models

ring-attention

ring-attention experiments

Portrait-Mode-Video

Video dataset dedicated to portrait-mode video recognition.

Vespa

Video Diffusion State Space Models