jongwooko/distillm Issues
OPTS+=" --kd-ratio 1.0"
Closed 2How to download the models after sft
Closed 4The metric of GPT-4 Eval
Closed 1
Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)