mathslingo / multi-heads-attention-image-classification

Multi heads attention for image classification

Attention is all you need: A Keras Implementation

Using attention to increase image classification accuracy. Inspired from "Attention is All You Need" (Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin, arxiv, 2017).

The medium article can be found here.