ChaofanTao

lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

Megatron-LLaMA

Best practice for training LLaMA models in Megatron-LM

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

Long-Context-Data-Engineering

Implementation of paper Data Engineering for Scaling Language Models to 128K Context

icefall

how-to-train-tokenizer

怎么训练一个LLM分词器

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

datablations

Scaling Data-Constrained Language Models

open-instruct

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

pixel

Research code for pixel-based encoders of language (PIXEL)

URIAL

promptbench

A unified evaluation framework for large language models

BPO

alignment-handbook

Robust recipes to align language models with human and AI preferences

PICL

Code for ACL2023 paper: Pre-Training to Learn in Context

AppAgent

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

starcoder

Home of StarCoder: fine-tuning & inference!

Megatron-LLM

distributed trainer for LLMs

ProAgent

An LLM-based Agent for the New Automation Paradigm - Agentic Process Automation

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

OpenAgents

OpenAgents: An Open Platform for Language Agents in the Wild

visual_prompt_retrieval

[NeurIPS2023] Official implementation and model release of the paper "What Makes Good Examples for Visual In-Context Learning?"

Emu

Emu Series: Generative Multimodal Models from BAAI

Awesome-LLMs-Evaluation-Papers

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.

LLaVA-RLHF

Aligning LMMs with Factually Augmented RLHF

generative-models

Generative Models by Stability AI

latent-consistency-model

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference