flintstones84 / AttentioNN

All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.

AttentioNN

All about attention in neural networks described as colab notebooks

Notebooks

Name	Description	Notebook
Attention maps	How does a CNN attent to image objects
Attention in nmt	Attention mechanism in neural machine translation
Attention in image captioning	Attention in image captioning using sof attention and double stochastic regularization