yassouali

ComfyUI

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.

llm.c

LLM training in simple, raw C/CUDA

supervision

We write your reusable computer vision tools. 💜

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.29% of bugs in the SWE-bench evaluation set and takes just 1.5 minutes to run.

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

StreamDiffusion

StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation

VoiceCraft

Zero-Shot Speech Editing and Text-to-Speech in the Wild

axolotl

Go ahead and axolotl questions

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

cutlass

CUDA Templates for Linear Algebra Subroutines

mindspore

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

transformer-debugger

mergekit

Tools for merging pretrained large language models.

torchtune

A Native-PyTorch Library for LLM Fine-tuning

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

LLM4Decompile

Reverse Engineering: Decompiling Binary Code with Large Language Models

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

faer-rs

Linear algebra foundation for the Rust programming language

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

LLM-Training-Puzzles

What would you do with 1000 H100s...

Triton-Puzzles

Puzzles for learning Triton

GPTFast

Accelerate your Hugging Face Transformers 6-8.5x. Native to Hugging Face and PyTorch.

aphrodite-engine

PygmalionAI's large-scale inference engine

flash-attention-minimal

Flash Attention in ~100 lines of CUDA (forward pass only)

aisys-building-blocks

Building blocks for foundation models.

ao

Native PyTorch library for quantization and sparsity

ngn-k-tutorial

An ngn/k tutorial.

binary-networks-pytorch

Binarize convolutional neural networks using pytorch :fire: