omniquant

There are 0 repository under omniquant topic.

ModelTC / llmc
This is the official PyTorch implementation of "LLM-QBench: A Benchmark Towards the Best Practice for Post-training Quantization of Large Language Models", and also an efficient LLM compression tool with various advanced compression methods, supporting multiple inference backends.
awq benchmark deployment evaluation falcon internlm internlm2 large-language-models llama llama2 llama3 llm omniquant opt post-training-quantization pruning ptq quantization smoothquant tool
Language:Python 115

ModelTC / llmc