myleott

torchtitan

A native PyTorch Library for large model training

ansible-role-rke2

Ansible Role to install RKE2 Kubernetes.

keras-core

A multi-backend implementation of the Keras API, with support for TensorFlow, JAX, and PyTorch.

mctx

Monte Carlo tree search in JAX

tini

A tiny but valid `init` for containers

grain

nginx-s3-gateway

NGINX S3 Caching Gateway

chatgpt-mac

ChatGPT for Mac, living in your menubar.

growthbook

Open Source Feature Flagging and A/B Testing Platform

langchain

🦜🔗 Build context-aware reasoning applications

dust

Amplify your team's potential with customizable and secure AI assistants.

skypilot

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

k-diffusion

Karras et al. (2022) diffusion models for PyTorch

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

pyrallis

Pyrallis is a framework for structured configuration parsing from both cmd and files. Simply define your desired configuration structure as a dataclass and let pyrallis do the rest!

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

FasterTransformer

Transformer related optimization, including BERT, GPT

metaseq

Repo for external large-scale work

gpu-burn

Multi-GPU CUDA stress test

timeout-decorator

Timeout decorator for Python

subprocess-tee

A subprocess.run drop-in replacement that supports a tee mode, being able to display output in real time while still capturing it. No dependencies needed

functorch

functorch is JAX-like composable function transforms for PyTorch.

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

filesystem_spec

A specification that python filesystems should adhere to.

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

varuna

TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.