Hugging Face

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

candle

Minimalist ML framework for Rust

trl

Train transformer language models with reinforcement learning.

text-generation-inference

Large Language Model Text Generation Inference

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

chat-ui

Open source codebase powering the HuggingChat app

alignment-handbook

Robust recipes to align language models with human and AI preferences

autotrain-advanced

🤗 AutoTrain Advanced

safetensors

Simple, safe way to store and distribute tensors

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

blog

Public repo for HF blog posts

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

huggingface_hub

The official Python client for the Huggingface Hub.

huggingface.js

Utilities to use the Hugging Face Hub API

llm-vscode

LLM powered development for VSCode

nanotron

Minimalistic large language model 3D-parallelism training

optimum-nvidia

dataset-viewer

Lightweight web API for visualizing and exploring any dataset - computer vision, speech, text, and tabular - stored on the Hugging Face Hub

quanto

A pytorch Quantization Toolkit

optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

ratchet

A cross-platform browser ML framework.

optimum-benchmark

A unified multi-backend utility for benchmarking Transformers, Timm, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

optimum-neuron

Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.

optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

data-is-better-together

Let's build better datasets, together!

optimum-tpu

Google TPU optimizations for transformers models

lm-evaluation-harness

A framework for few-shot evaluation of language models.