tyshiwo1

deepseekv2-profile

Odysseus-Transformer

KAISR-lite

A lite version of KAIR with SISR codes

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

Dimba

Transformer-Mamba Diffusion Models

RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

LLaVA-NeXT

AMD

[CVPR 2024] Asymmetric Masked Distillation for Pre-Training Small Foundation Models

SportsHHI

MAP-NEO

Awesome-Game-Analysis

a comprehensive collection of video game tech analysis resources

gemma-2B-10M

Gemma 2B with 10M context length using Infini-attention.

long-context-attention

Sequence Parallel Attention for Long Context LLM Model Training and Inference

rfpp

The codebase of our paper "Improving the Training of Rectified Flows"

d3pm

Minimal Implementation of a D3PM in pytorch

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

Yuan2.0-M32

Mixture-of-Experts (MoE) Language Model

DiG

DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention

DMP

Official pytorch implementation of "Diffusion Model Patching via Mixture-of-Prompts"

DiM-DiffusionMamba

The official implementation of DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis

video-mamba-suite

The suite of modeling video with Mamba

DMD2

Cross-Layer-Attention

ambient-tweedie

[ICML 2024]: Official implementation for the paper: "Consistent Diffusion Meets Tweedie"

InfoNet-pytorch-implement

DCFormer

Pandora

Pandora: Towards General World Model with Natural Language Actions and Video States

KVCachePapers

zigma

A PyTorch implementation of the paper "ZigMa: A DiT-Style Mamba-based Diffusion Model"

XQL

Extreme Q-Learning: Max Entropy RL without Entropy