will-thompson-k

get-started-with-JAX

The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series of tutorials (YouTube videos and Jupyter Notebooks) as well as the content I found useful while learning about the JAX ecosystem.

torchtitan

A native PyTorch Library for large model training

alignment-handbook

Robust recipes to align language models with human and AI preferences

llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

paxml

Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

transformer-debugger

luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

llm_steer

Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectors

weak-to-strong

mistral-inference

Official inference library for Mistral models

axolotl

Go ahead and axolotl questions

LLM-Benchmark-Logs

Just a bunch of benchmark logs for different LLMs

AlpaCare

chain-of-verification

swarm-jax

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

awesome-hallucination-detection

List of papers on hallucination detection in LLMs.

YaLM-100B

Pretrained language model with 100B parameters

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

LLM-Agent-Paper-List

The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

triton-transformer

Implementation of a Transformer, but completely in Triton

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

litllm

pgvector

Open-source vector similarity search for Postgres