leehanchung / lora-instruct

Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can this codebase be applicable for finetuning larger models, e.g., falcon-40b?

ZeroYuHuang opened this issue · comments

Can this codebase be applicable for finetuning larger models, e.g., falcon-40b?