JiHa-Kim / quantize-hf-models

Quantize LLMs from HuggingFace into the GGUF format (both standard and with imatrix) using a Colab notebook.

Geek Repo

Github PK Tool