p1atdev / stablelm_lora

stablelm_lora

Worked with VRAM 8GB (RTX 3070Ti).

Setup

git clone https://github.com/p1atdev/stablelm_lora
cd stablelm_lora
pip install -r requirements.txt

Install bitsandbytes

for Linux

(not tested)

pip install bitsandbytes

for Windows

See https://github.com/jllllll/bitsandbytes-windows-webui.

pip install bitsandbytes --prefer-binary --extra-index-url=https://jllllll.github.io/bitsandbytes-windows-webui

Train

Please edit example_train.py to match your dataset and settings.

Then,

python ./example_train.py

to start training.

References

• japanese-stablelm-base-alpha-7bのLoRAを試す
• Windows10でのPEFTの実行方法 (bitsandbytes-windows-webui使用)