Panpan XU's starred repositories
LLMs-from-scratch
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
lm-evaluation-harness
A framework for few-shot evaluation of language models.
tiny-cuda-nn
Lightning fast C++/CUDA neural network framework
mamba-minimal
Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
Awesome-Text2SQL
Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSL、Text2API、Text2Vis and more.
smoothquant
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
flashinfer
FlashInfer: Kernel Library for LLM Serving
blocksparse
Efficient GPU kernels for block-sparse matrix multiplication and convolution
extension-cpp
C++ extensions in PyTorch
optimum-neuron
Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.