Khsaadi / built_basic_transformer

This repo contains a basic transformer implementation

attention-mechanism encoder-decoder key-value positional-encoding query transformers

This repository contains:

A notebook of a basic transformer architecture built from scratch.

About

This repo contains a basic transformer implementation

attention-mechanism encoder-decoder key-value positional-encoding query transformers

Languages

Language:Jupyter Notebook 100.0%