This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
Home Page:https://arxiv.org/abs/2405.06001
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool