htqin / IR-QLoRA

This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retention

htqin/IR-QLoRA Issues

AttributeError: 'IRQLoraLinear4bit' object has no attribute 'base_layer'. Did you mean: 'update_layer'
Updated 2 months ago1
Code for int4
Closed 3 months ago3