Andrej's repositories

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Language:PythonLicense:MITStargazers:32083Issues:342Issues:290

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Language:PythonLicense:MITStargazers:18945Issues:255Issues:70

llm.c

LLM training in simple, raw C/CUDA

Language:CudaLicense:MITStargazers:18425Issues:189Issues:94

llama2.c

Inference Llama 2 in one file of pure C

char-rnn

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

convnetjs

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

Language:JavaScriptLicense:MITStargazers:10750Issues:595Issues:75

nn-zero-to-hero

Neural Networks: Zero to Hero

Language:Jupyter NotebookLicense:MITStargazers:10467Issues:270Issues:24

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

Language:Jupyter NotebookLicense:MITStargazers:8389Issues:141Issues:25

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Language:PythonLicense:MITStargazers:7989Issues:79Issues:28

neuraltalk

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

arxiv-sanity-preserver

Web interface for browsing, search and filtering recent arxiv submissions

Language:PythonLicense:MITStargazers:5041Issues:171Issues:113

makemore

An autoregressive character-level language model for making more things

Language:PythonLicense:MITStargazers:2106Issues:34Issues:8

cryptos

Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes

Language:Jupyter NotebookStargazers:1420Issues:36Issues:3

arxiv-sanity-lite

arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors based on paper abstracts.

Language:PythonLicense:MITStargazers:1089Issues:22Issues:7

randomfun

Notebooks and various random fun

Language:Jupyter NotebookStargazers:1051Issues:46Issues:4

ulogme

Automatically collect and visualize usage statistics in Ubuntu/OSX environments.

pytorch-normalizing-flows

Normalizing flows in PyTorch. Current intended use is education not production.

Language:Jupyter NotebookStargazers:823Issues:26Issues:9

lecun1989-repro

Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

Language:Jupyter NotebookLicense:MITStargazers:547Issues:9Issues:2

deep-vector-quantization

VQVAEs, GumbelSoftmaxes and friends

Language:Jupyter NotebookLicense:MITStargazers:485Issues:13Issues:7

covid-sanity

Aspires to help the influx of bioRxiv / medRxiv papers on COVID-19

Language:PythonLicense:MITStargazers:355Issues:17Issues:9

researchpooler

Automating research publications discovery and analysis. For example, ever wish your computer could automatically open papers that are most similar to a paper at an arbitrary url? How about finding all papers that report results on some dataset? Let's re-imagine literature review.

ttmik

Talk to me in Korean Anki cards and related scripts

gitstats

A lightweight/pretty visualizer for recent work on a git code base in multiple branches. Helps stay up to date with teams working on one git repo in many branches.

Language:HTMLStargazers:92Issues:3Issues:0

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Language:PythonLicense:Apache-2.0Stargazers:90Issues:1Issues:0

notpygamejs

Game making library for using Canvas element

Language:JavaScriptStargazers:46Issues:4Issues:0

optim

A numeric optimization package for Torch.

Language:LuaLicense:NOASSERTIONStargazers:8Issues:3Issues:0

sqlitedict

Persistent dict, backed by sqlite3 and pickle, multithread-safe.

Language:PythonLicense:Apache-2.0Stargazers:8Issues:2Issues:0