Epiphqny

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

mamba

LWM

self-instruct

Aligning pretrained language models with instruction data generated by themselves.

jepa

PyTorch code and models for V-JEPA self-supervised learning from video.

Latte

Latte: Latent Diffusion Transformer for Video Generation.

coyo-dataset

COYO-700M: Large-scale Image-Text Pair Dataset

minisora

MiniSora: A community aims to explore the implementation path and future development direction of Sora.

rq-vae-transformer

The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)

Awesome-Mamba-Papers

Awesome Papers related to Mamba.

SoraReview

The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".

mage

A PyTorch implementation of MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesis

mcvd-pytorch

Official implementation of MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation (https://arxiv.org/abs/2205.09853)

PVDM

Official PyTorch implementation of Video Probabilistic Diffusion Models in Projected Latent Space (CVPR 2023).

OpenDVC

cs229m_notes

Awesome-Open-AI-Sora

Sora AI Awesome List – Your go-to resource hub for all things Sora AI, OpenAI's groundbreaking model for crafting realistic scenes from text. Explore a curated collection of articles, videos, podcasts, and news about Sora's capabilities, advancements, and more.

VideoDirectorGPT

official implementation of VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning

DreamComposer

[CVPR 2024] DreamComposer: Controllable 3D Object Generation via Multi-View Conditions

common_metrics_on_video_quality

You can easily calculate FVD, PSNR, SSIM, LPIPS for evaluating the quality of generated or predicted videos.

STTN

The official code for "Spatial temporal transformer networks for traffic flow forecasting"

DirecT2V

MakeLongVideo

Implementation of long video generation

awesome-video-generation

A collection of awesome video generation studies.

amused

mamba-hf

Implementation of the Mamba SSM with hf_integration.

video-localized-narratives

MeBT

official implementation of the paper: Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers (CVPR 2023)

FSAM4PLM

[EMNLP22] Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

CC-SAM

This is the implementation of our CVPR'23 paper "Class-Conditional Sharpness-Aware Minimization for Deep Long-Tailed Recognition".