mit-han-lab / smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Home Page:https://arxiv.org/abs/2211.10438

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No module named 'torch_int'

liangxiaoyun opened this issue · comments

commented

When I run the export_int8_model.py to export INT8 models, an error occurred: No module named 'torch_int'
I have installed the following packages. Thanks a lot, looking forward to reply.
torch 1.12.1+cu113
torchaudio 0.12.1+cu113
torchvision 0.13.1+cu113

How to install torch_int module ?