zetwhite

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

llama3

The official Meta Llama 3 GitHub site

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

llm.c

LLM training in simple, raw C/CUDA

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

llamafile

Distribute and run LLMs with a single file.

pykan

Kolmogorov Arnold Networks

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

flash-attention

Fast and memory-efficient exact attention

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

torch7

http://torch.ch

MNN

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

tiny-gpu

A minimal GPU design in Verilog to learn how GPUs work from the ground up

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

victor-mono

A free programming font with cursive italics and ligatures. Donations welcome ❤️

lectures

Material for cuda-mode lectures

XNNPACK

High-efficiency floating-point neural network inference operators for mobile, server, and Web

ml-cvnets

CVNets: A library for training computer vision networks

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

executorch

On-device AI across mobile, embedded and edge for PyTorch

ATen

ATen: A TENsor library for C++11

flash-attention-minimal

Flash Attention in ~100 lines of CUDA (forward pass only)

attorch

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

intel-npu-acceleration-library

Intel® NPU Acceleration Library

tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

tt-buda

Tenstorrent TT-BUDA Repository

tt-budabackend

Buda Compiler Backend for Tenstorrent devices

tt-tvm

TVM for Tenstorrent ASICs

rope-triton

paged-attention-triton

PagedAttention in triton