Dereck0602 / Bolaco

Bolaco

This repo contains the code for "Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization"(https://arxiv.org/abs/2405.10616)

Quick start

Installation

pip install -r requirement.txt

Low-rank compression

bash run.sh

Post-training

bash run_posttrain.sh

Model checkpoint

You can download the checkpoints for the model from here