karpathy

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

char-rnn

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

convnetjs

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

nn-zero-to-hero

Neural Networks: Zero to Hero

neuraltalk

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

arxiv-sanity-preserver

Web interface for browsing, search and filtering recent arxiv submissions

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

reinforcejs

Reinforcement Learning Agents in Javascript (Dynamic Programming, Temporal Difference, Deep Q-Learning, Stochastic/Deterministic Policy Gradients)

ng-video-lecture

cryptos

Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes

ulogme

Automatically collect and visualize usage statistics in Ubuntu/OSX environments.

tsnejs

Implementation of t-SNE visualization algorithm in Javascript.

pytorch-normalizing-flows

Normalizing flows in PyTorch. Current intended use is education not production.

makemore

An autoregressive character-level language model for making more things

arxiv-sanity-lite

arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors based on paper abstracts.

svmjs

Support Vector Machine in Javascript (SMO algorithm, supports arbitrary kernels) + GUI demo

pytorch-made

MADE (Masked Autoencoder Density Estimation) implementation in PyTorch

karpathy.github.io

my blog

randomfun

Notebooks and various random fun

lecun1989-repro

Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

deep-vector-quantization

VQVAEs, GumbelSoftmaxes and friends

covid-sanity

Aspires to help the influx of bioRxiv / medRxiv papers on COVID-19

gitstats

A lightweight/pretty visualizer for recent work on a git code base in multiple branches. Helps stay up to date with teams working on one git repo in many branches.

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

notpygamejs

Game making library for using Canvas element

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

karpathy

root repo

sqlitedict

Persistent dict, backed by sqlite3 and pickle, multithread-safe.

optim

A numeric optimization package for Torch.