LysandreJik

mojo

The Mojo Programming Language

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

candle

Minimalist ML framework for Rust

trl

Train transformer language models with reinforcement learning.

text-generation-inference

Large Language Model Text Generation Inference

starcoder

Home of StarCoder: fine-tuning & inference!

Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

alignment-handbook

Robust recipes to align language models with human and AI preferences

LLM-As-Chatbot

LLM as a Chatbot Service

distil-whisper

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

llm-awq

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

MiniChain

A tiny library for coding with large language models.

llm-vscode

LLM powered development for VSCode

runhouse

The fastest way to iterate and deploy AI workloads on your own infra. Unobtrusive, debuggable, PyTorch-like APIs.

attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

quanto

A pytorch Quantization Toolkit

llm-ls

LSP server leveraging LLMs for code completion (and more?)

large_language_model_training_playbook

An open collection of implementation tips, tricks and resources for training large language models

open-muse

Open reproduction of MUSE for fast text2image generation.

audio-transformers-course

The Hugging Face Course on Transformers for Audio

awesome-adapter-resources

Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning

FFMPerative

Chat to Compose Video

cubzh

sharp-transformers

A Unity plugin for using Transformers models in Unity.

pipegoose

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

hf_image_uploader

megatron-smol-cluster

Megatron-LM setup in the smol-cluster

transformers_4_36_release

Playground for transformers 4.36.0 release