antonio-f / GPT_from_scratch

Very simple implementation of GPT architecture using PyTorch and Jupyter.

easy-to-use gpt jupyter-notebook python pytorch tutorial from-scratch noob-friendly simple newbie transformer multihead-attention self-attention triangular-matrix bigram-model

GPT from scratch

Very simple implementation of GPT architecture.

Based on A. Karpathy's code. Needs just PyTorch and Jupyter.

About

Very simple implementation of GPT architecture using PyTorch and Jupyter.

easy-to-use gpt jupyter-notebook python pytorch tutorial from-scratch noob-friendly simple newbie transformer multihead-attention self-attention triangular-matrix bigram-model

Languages

Language:Jupyter Notebook 100.0%