guocuimi

minitf

Simplified version of Tensorflow for learning purposes.

ScaleLLM

A high-performance inference system for large language models, designed for production environments.

attention_learning

cutlass_learning

flash_attention_inference

Performance of the C++ interface of flash attention, flash attention v2 and self quantized decoding attention in large language model (LLM) inference scenarios.

flashinfer

FlashInfer: Kernel Library for LLM Serving

LookaheadDecoding

MatmulTutorial

A Easy-to-understand TensorOp Matmul Tutorial