How Can I Peft the Smoothquanted LLM?
LameloBally opened this issue · comments
WoosungMyung commented
I want to know how to use LoRA mehthod to SmoothQuant LLM
yuanqian_zhao commented
same issue, is this available?
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
LameloBally opened this issue · comments
I want to know how to use LoRA mehthod to SmoothQuant LLM
same issue, is this available?