morphpiece

morphpiece.github.io

cosmopedia

docs

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

llm.c

LLM training in simple, raw C/CUDA

lm-evaluation-harness

A framework for few-shot evaluation of language models.

mteb

MTEB: Massive Text Embedding Benchmark

open-r1

Fully open reproduction of DeepSeek-R1

Streamlit-Authenticator

A secure authentication module to manage user access in a Streamlit application.

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.