nicknochnack / PyReft

LoReFT

Hyper fast fine tuning for LLMs using PyReft.

See it live and in action 📺

Startup 🚀

1. Install pip install torch==2.2.0 transformers pyreft
2. Replace your HF token with access tokens from here https://huggingface.co/settings/tokens
3. Run the training pipeline python train.py
4. Score using the scoring pipeline python score.py

Other References 🔗

-PyReft:Pyreft library from the awesome Stanford NLP team.

-ReFt Paper:Research paper talking about Representation Fine Tuning.

Who, When, Why?

👨🏾‍💻 Author: Nick Renotte
📅 Version: 1.x
📜 License: This project is licensed under the MIT License