additive-attention

There are 0 repository under additive-attention topic.

sooftware / attentions
PyTorch implementation of some attentions for Deep Learning Researchers.
pytorch attention location-sensitive-attension location-aware-attention additive-attention dot-product-attention multi-head-attention relative-positional-encoding relative-multi-head-attention
Language:Python 487
shawnhan108 / Attention-LSTMs
A set of notebooks that explores the power of Recurrent Neural Networks (RNNs), with a focus on LSTM, BiLSTM, seq2seq, and Attention.
rnn lstm lstm-neural-networks keras keras-tensorflow music-generation bidirectional-lstm seq2seq encoder-decoder-model attention-mechanism attention-model recurrent-neural-network machine-translation additive-attention
Language:Jupyter Notebook 9
mtanghu / LEAP
LEAP: Linear Explainable Attention in Parallel for causal language modeling with O(1) path length, and O(1) inference
linear-attention pytorch transformers attention-mechanism deep-learning local-attention softmax additive-attention dot-product-attention parallel rnn transformer
Language:Jupyter Notebook 4