tcapelle / llm_recipes

A set of scripts and notebooks on LLM finetunning and dataset creation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

LLM Recipes

This repo contains my own exploration of the LLM world right now. I am interested mostly in fine-tuning LMs for text generation tasks. This implies:

  • Dataset preparation and preprocessing
  • Model fine-tuning with libraries like Axolotl, HuggingFace, etc.
  • Model evaluation

About

A set of scripts and notebooks on LLM finetunning and dataset creation


Languages

Language:Jupyter Notebook 84.0%Language:Python 15.9%Language:Dockerfile 0.1%Language:Shell 0.0%