nndeploy / Awesome-LLM-Inference

💻A small Collection for Awesome LLM Inference [Papers|Blogs|Docs] with codes, contains TensorRT-LLM, streaming-llm, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

https://github.com/DefTruth/Awesome-LLM-Inference

Geek Repo

Github PK Tool