williamberman

kineto

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

enhancing-transformers

An unofficial implementation of both ViT-VQGAN and RQ-VAE in Pytorch

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

surrealdb

A scalable, distributed, collaborative, document-graph database, for the realtime web

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

procgen

Procgen Benchmark: Procedurally-Generated Game-Like Gym-Environments

quda

QUDA is a library for performing calculations in lattice QCD on GPUs.

pytorch_forward_forward

Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

reth

Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust

whisper.cpp

Port of OpenAI's Whisper model in C/C++

xla

A machine learning compiler for GPUs, CPUs, and ML accelerators

stablehlo

Backward compatible ML compute opset inspired by HLO/MHLO

torchscale

Foundation Architecture for (M)LLMs

karlo

nerf-from-image

Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversion

lingvo

Lingvo

Arraymancer

A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ColossalAI

Making large AI models cheaper, faster and more accessible

cutlass

CUDA Templates for Linear Algebra Subroutines

builder

Flashbots MEV-Boost Block Builder

CompilerGym

Reinforcement learning environments for compiler and program optimization tasks

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

helios

A fast, secure, and portable light client for Ethereum

TASO

The Tensor Algebra SuperOptimizer for Deep Learning

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.