Lightning-AI / litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

Home Page:https://lightning.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Installation of extras

awaelchli opened this issue · comments

Since LitGPT will be made into a package, we will need to have a way to install extras. Otherwise it is cumbersome to install a bunch of packages manually.

At least:

pip install litgpt[all]

Could also go more granular, like

pip install litgpt[pretrain]

But I don't know what makes sense there.

@carmocca

I'm adding "[all]" in #1068. No need to be more granular at the moment.

It will also require that the package is installed to be used.