Giters

microsoft / LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Home Page:https://arxiv.org/abs/2106.09685

Repository from Github https://github.commicrosoft/LoRARepository from Github https://github.commicrosoft/LoRA

Where is the LoRA matrices saved?

KelsenMa opened this issue · comments

commented

I used the bash roberta_base_sst2.sh to reproduce the result. But I can' t find the LoRA matrix checkpoint.

Ideally, there should be a 3.4MB bin file which contains the weights of LoRA matrices but I can't find this file in the output dir.