koalazf99

LLM101n

LLM101n: Let's build a Storyteller

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

flash-attention

Fast and memory-efficient exact attention

trafilatura

Python & command-line tool to gather text on the Web: Crawling & scraping, content extraction, metadata. TXT, Markdown, CSV & XML output.

mistral-finetune

gptpdf

Using GPT to parse PDF

magentic

Seamlessly integrate LLMs as Python functions

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

DeepSeek-Coder-V2

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.

aqt

magpie

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing"

anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

dclm

DataComp for Language Models

vscode-lean4

Visual Studio Code extension for the Lean 4 proof assistant

bigcodebench

BigCodeBench: The Next Generation of HumanEval

OpenWebMath

DL4TP

A Survey on Deep Learning for Theorem Proving

OlympicArena

This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"

schedules-and-scaling

k2-train

regmix

[arXiv 2024] RegMix: Data Mixture as Regression for Language Model Pre-training

agent-attack

[Arxiv 2024] Adversarial Attacks on Multimodal Agents

MoPS

[ACL 2024] Code for "MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation"

Spider2-V

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

eval-arena

remiss-jailbreak

tpu_pod_commander

TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.

Awesome-DataCentric-LLM

trending projects & awesome papers about data-centric llm studies.