Yeojoon

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

simple-local-rag

Build a RAG (Retrieval Augmented Generation) pipeline from scratch and have it all run locally.

rag-from-scratch

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

logix

AI Logging for Interpretability and Explainability🔬

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

GPU-Puzzles

Solve puzzles. Learn CUDA.

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

torchtune

A Native-PyTorch Library for LLM Fine-tuning

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

LoftQ

LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

lm-evaluation-harness

A framework for few-shot evaluation of language models.

lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

llmtools

Finetuning Large Language Models on One Consumer GPU in Under 4 Bits

hivemind

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

flash-attention

Fast and memory-efficient exact attention

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

CoLLiE

Collaborative Training of Large Language Models in an Efficient Way

low-bit-optimizers

Low-bit optimizers for PyTorch

CS7545

FedML

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Awesome-Federated-Learning

FedML - The Research and Production Integrated Federated Learning Library: https://fedml.ai

betty

Betty: an automatic differentiation library for generalized meta-learning and multilevel optimization

FedTorch

FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.

FedAc-NeurIPS20

Code for "Federated Accelerated Stochastic Gradient Descent" (NeurIPS 2020)

gitignore

A collection of useful .gitignore templates