karpathy

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

LLM101n

LLM101n: Let's build a Storyteller

llm.c

LLM training in simple, raw C/CUDA

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

llama2.c

Inference Llama 2 in one file of pure C

nn-zero-to-hero

Neural Networks: Zero to Hero

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

char-rnn

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

convnetjs

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

neuraltalk

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

arxiv-sanity-preserver

Web interface for browsing, search and filtering recent arxiv submissions

build-nanogpt

Video+code lecture on building nanoGPT from scratch

ng-video-lecture

makemore

An autoregressive character-level language model for making more things

rendergit

Render any git repo into a single static HTML page for humans or LLMs

cryptos

Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes

nano-llama31

nanoGPT style version of Llama 3.1

arxiv-sanity-lite

arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors based on paper abstracts.

randomfun

Notebooks and various random fun

ulogme

Automatically collect and visualize usage statistics in Ubuntu/OSX environments.

karpathy.github.io

my blog

lecun1989-repro

Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

deep-vector-quantization

VQVAEs, GumbelSoftmaxes and friends

researchpooler

Automating research publications discovery and analysis. For example, ever wish your computer could automatically open papers that are most similar to a paper at an arbitrary url? How about finding all papers that report results on some dataset? Let's re-imagine literature review.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

calorie

nice and effective super simple calorie counter web app

notpygamejs

Game making library for using Canvas element

karpathy

root repo

optim

A numeric optimization package for Torch.