jina-ai / jerboa

LLM finetuning

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Incorporate baize data and training into jerboa training pipeline

alaeddine-13 opened this issue · comments

Current training pipeline only supports instruction-tuning based on the alpaca template/dataset
The baize's pipeline supports both training to follow instructions and to behave like a chatbot.
It might be interesting to incorporate this logic/dataset into our training pipeline