Giters

Lightning-AI / litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

Home Page:https://lightning.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to use litgpt inside another project, as a library?

vabatista opened this issue · comments

commented

How to use litgpt inside another project, as a library?

commented

Good question. While you could import individual bits and pieces (classes and functions) like in the finetuning scripts (e.g., finetune/full.py), we don't have an official library UI (yet!).

commented

Thank you. I dedicated the past two days to attempting that task, but after encountering a roadblock, I eventually realized it was due to a litgpt error. I have documented this in another issue, #1176.