wuhuijianke1 / Attention-is-all-you-Need

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Transformer

  1. Trasnformer from Scratch (Uses loops which helps you to understand the architectural details)
  2. Transformer in TensorFlow (you can use this file for traning)
  3. Transformer in PyTorch (you can use this file for traning)

Architecture

image

Scaler Dot Product

image

About


Languages

Language:Jupyter Notebook 100.0%