Tonyhao96

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

triton

Development repository for the Triton language and compiler

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

LWM

skypilot

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Latte

Latte: Latent Diffusion Transformer for Video Generation.

awesome_lists

Awesome Lists for Tenure-Track Assistant Professors and PhD students. (助理教授/博士生生存指南)

gdrive

Google Drive CLI Client

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

nanotron

Minimalistic large language model 3D-parallelism training

skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

EasyContext

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

MS-AMP

Microsoft Automatic Mixed Precision Library

ring-flash-attention

Ring attention implementation with flash attention

Autonomous-Agents

Autonomous Agents (LLMs) research papers. Updated Daily.

doremi

Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets

InternEvo

BitBLAS

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.

long-context-attention

Sequence Parallel Attention for Long Context LLM Model Training and Inference

superbenchmark

A validation and profiling tool for AI infrastructure

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

torchsnapshot

A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind.

AcmeTrace

orion

An interference-aware scheduler for fine-grained GPU sharing