Giters

DefTruth / Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Home Page:https://github.com/DefTruth/Awesome-LLM-Inference

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DefTruth/Awesome-LLM-Inference Stargazers