rasbt

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

deeplearning-models

A collection of various deep learning architectures, models, and tips

python-machine-learning-book

The "Python Machine Learning (1st edition)" book code repository and info resource

mlxtend

A library of extension and helper modules for Python's data analysis and machine learning libraries.

machine-learning-book

Code Repository for Machine Learning with PyTorch and Scikit-Learn

reasoning-from-scratch

Implement a reasoning LLM in PyTorch from scratch, step by step

LLM-workshop-2024

A 4-hour coding workshop to understand how LLMs are implemented and used

watermark

An IPython magic extension for printing date and time stamps, version numbers, and hardware information

machine-learning-notes

Collection of useful machine learning codes and snippets (originally intended for my personal use)

MachineLearning-QandAI-book

Machine Learning Q and AI book

stat451-machine-learning-fs20

STAT 451: Intro to Machine Learning @ UW-Madison (Fall 2020)

pycon2024

Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024

LLM-finetuning-scripts

dora-from-scratch

LoRA and DoRA from Scratch Implementations

RAGs

RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems

rasbt

build-your-own-x

Master programming by recreating your favorite technologies from scratch.

ViT-finetuning-scripts

Vision transformer finetuning scripts

build-nanogpt

Video+code lecture on building nanoGPT from scratch

py-args

Python command line tools as productivity supplements for Posix systems

gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

pytorch-lightning

Deep learning framework to train, deploy, and ship AI products Lightning fast.

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

LitServe

Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.

bitsandbytes

8-bit CUDA functions for PyTorch

axolotl

Go ahead and axolotl questions

test-github-image-rendering

Debug GitHub rendering issues

dora

Implementation of DoRA

bugreport

A repository to store code examples to reproduce issues for bug reports.