Chaojian Li's starred repositories
ServerlessLLM
Cost-efficient and fast multi-LLM serving.
ThunderKittens
Tile primitives for speedy kernels
grayskull-attention
Attention in SRAM on Tenstorrent Grayskull :metal:
LLM4HWDesign_Starting_Toolkit
LLM4HWDesign Starting Toolkit
Grendel-GS
Ongoing research training gaussian splatting at scale by distributed system
cs249r_book
Collaborative book Machine Learning Systems
LogarithmicPosit
[DAC'24] Official Implementation of the Logarithmic Posit (LP) Number System
DeepSeek-V2
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
ShiftAddLLM
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
arxiv-latex-cleaner
arXiv LaTeX Cleaner: Easily clean the LaTeX code of your paper to submit to arXiv
TensorRT-Model-Optimizer
TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.