unslothai / unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Home Page:https://unsloth.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

`transformers.Trainer` variant of `UnslothTrainer`

lmg-anon opened this issue · comments

This isn't a major issue, but I'm unable to use code for transformers.Trainer with UnslothTrainer without modifying Unsloth's code. Currently, UnslothTrainer inherits from SFTTrainer. It would be nice if there was another class like UnslothTrainer that inherited from transformers.Trainer instead.

Oh good point! I was thinking of doing a UnslothWrap(Trainer) type wrapper