Geek Repo
followers
following
stars
Github PK Tool:Github PK Tool
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.
A high-throughput and memory-efficient inference and serving engine for LLMs
