younesbelkada

rich

Rich is a Python library for rich text and beautiful formatting in the terminal.

llamafile

Distribute and run LLMs with a single file.

candle

Minimalist ML framework for Rust

uv

An extremely fast Python package installer and resolver, written in Rust.

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

OLMo

Modeling, training, eval, and inference code for OLMo

mergekit

Tools for merging pretrained large language models.

metavoice-src

Foundational model for human-like, expressive TTS

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

cookbook

Open-source AI cookbook

fsdp_qlora

Training LLMs with QLoRA + FSDP

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

nanotron

Minimalistic large language model 3D-parallelism training

AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf

flashinfer

FlashInfer: Kernel Library for LLM Serving

DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

Multi-LoRA-Composition

Repository for the Paper "Multi-LoRA Composition for Image Generation"

marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

QuIP

Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"

KVQuant

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

float8_experimental

This repository contains the experimental PyTorch native float8 training UX

llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters

EasyDeL

Accelerate your training with this open-source library. Optimize performance with streamlined training and serving options with JAX. 🚀

fast-llm.rs

Sakura-SOLAR-DPO

Sakura-SOLAR-DPO: Merge, SFT, and DPO

quanto

A pytorch Quantization Toolkit