wm901115nwpu

taco

The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs

pscan

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

lectures

Material for cuda-mode lectures

resource-stream

CUDA related news and material links

pytorch-model-train-template

pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用

ring-attention

ring-attention experiments

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

PiPPy

Pipeline Parallelism for PyTorch

fusemix

Data-Efficient Multimodal Fusion on a Single GPU

parler-tts

Inference and training library for high-quality TTS models.

xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)

vision

Datasets, Transforms and Models specific to Computer Vision

recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.

EasyContext

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

MOSS-RLHF

MOSS-RLHF

whisper.cpp

Port of OpenAI's Whisper model in C/C++

ggml

Tensor library for machine learning

fix-posture

llama.cpp

llama 2 Inference

calm

CUDA/Metal accelerated language model inference

sam.cpp

hqq

Official implementation of Half-Quadratic Quantization (HQQ)

torchtune

A Native-PyTorch Library for LLM Fine-tuning

skhd

Simple hotkey daemon for macOS

long-context-attention

Sequence Parallel Attention for Long Context LLM Model Training and Inference

QuaRot

Code for QuaRot, an end-to-end 4-bit inference of large language models.

guidance

A guidance language for controlling large language models.

JORA

JORA: JAX Tensor-Parallel LoRA Library

torchpipe

Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends