khanmhmdi / Transformers-From-Scratch

This repo contains transformers model from scratch. A transformer is a deep learning model that adopts the mechanism of self-attention, differentially weighting the significance of each part of the input data. It is used primarily in the fields of natural language processing and computer vision.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Transformers-From-Scratch

This repo contains transformers model from scratch. A transformer is a deep learning model that adopts the mechanism of self-attention, differentially weighting the significance of each part of the input data. It is used primarily in the fields of natural language processing and computer vision.

About

This repo contains transformers model from scratch. A transformer is a deep learning model that adopts the mechanism of self-attention, differentially weighting the significance of each part of the input data. It is used primarily in the fields of natural language processing and computer vision.

License:MIT License