xwhzz

ccf-deadlines

⏰ Collaboratively track deadlines of conferences recommended by CCF (Website, Python Cli, Wechat Applet) / If you find it useful, please star this project, thanks~

CIM-MLC

[ASPLOS 2024] CIM-MLC: A Multi-level Compilation Stack for Computing-In-Memory Accelerators

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

tiny-gpu

A minimal GPU design in Verilog to learn how GPUs work from the ground up

cutlass

CUDA Templates for Linear Algebra Subroutines

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

llm.c

LLM training in simple, raw C/CUDA

NN-CUDA-Example

Several simple examples for popular neural network toolkits calling custom CUDA operators.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

flash-attention

Fast and memory-efficient exact attention

cuda-samples

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

CUDALibrarySamples

CUDA Library Samples

text-generation-inference

Large Language Model Text Generation Inference

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

mlir-tutorial

MLIR For Beginners tutorial

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

Awesome-LLM-System-Papers

Rust

All Algorithms implemented in Rust

tinygrad

You like pytorch? You like micrograd? You love tinygrad! ❤️

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

grok-1

Grok open release

MatPlotAgent

luminal

Deep learning at the speed of light.

FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

awesome-generative-ai-guide

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

Modern-CPP-Programming

Modern C++ Programming Course (C++03/11/14/17/20/23/26)

triton

Development repository for the Triton language and compiler