khanmhmdi / Transformers-From-Scratch

This repo contains transformers model from scratch. A transformer is a deep learning model that adopts the mechanism of self-attention, differentially weighting the significance of each part of the input data. It is used primarily in the fields of natural language processing and computer vision.