warner-benjamin

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

guidance

A guidance language for controlling large language models.

flash-attention

Fast and memory-efficient exact attention

ml-engineering

Machine Learning Engineering Open Book

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

latexify_py

A library to generate LaTeX expression from Python code.

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

nbdev

Create delightful software with Jupyter Notebooks

textual_inversion

ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)

RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

mamba-minimal

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

pillow-simd

The friendly PIL fork

samply

Command-line sampling profiler for macOS and Linux

sd-akashic

A compendium of informations regarding Stable Diffusion (SD)

awesome-stable-diffusion

Curated list of awesome resources for the Stable Diffusion AI Model.

cramming

Cramming the training of a (BERT-type) language model into limited compute.

stable-fast

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

autofaiss

Automatically create Faiss knn indices with the most optimal similarity search parameters.

the-art-of-debugging

The Art of Debugging

CushyStudio

🛋 The AI and Generative Art platform for everyone

CLIP-Guided-Diffusion

Just playing with getting CLIP Guided Diffusion running locally, rather than having to use colab.

blurr

A library that integrates huggingface transformers with the world of fastai, giving fastai devs everything they need to train, evaluate, and deploy transformer specific models.

FFCV-SSL

FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs

triton-autodiff

Experiment of using Tangent to autodiff triton