wm901115nwpu

triton

Development repository for the Triton language and compiler

asplos-tvm

GVProf

GVProf: A Value Profiler for GPU-based Clusters

GPA

GPU Performance Advisor

triton-shared

Shared Middle-Layer for Triton Compilation

xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

TFMQ-DM

[CVPR 2024 Highlight] TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models

llama_index

LlamaIndex is a data framework for your LLM applications

taco

The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs

pscan_kernel

pscan

unsloth

Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

lectures

Material for cuda-mode lectures

resource-stream

CUDA related news and material links

pytorch-model-train-template

pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用

ring-attention

ring-attention experiments

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

PiPPy

Pipeline Parallelism for PyTorch

fusemix

Data-Efficient Multimodal Fusion on a Single GPU

parler-tts

Inference and training library for high-quality TTS models.

xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)

vision

Datasets, Transforms and Models specific to Computer Vision

recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.

EasyContext

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

MOSS-RLHF

MOSS-RLHF

whisper.cpp

Port of OpenAI's Whisper model in C/C++

ggml

Tensor library for machine learning

fix-posture

llama.cpp

llama 2 Inference

calm

CUDA/Metal accelerated language model inference