TheBloke / AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Repository from Github https://github.comTheBloke/AutoGPTQRepository from Github https://github.comTheBloke/AutoGPTQ

TheBloke/AutoGPTQ Stargazers