dot-product-attention

There are 0 repository under dot-product-attention topic.

sooftware / attentions
PyTorch implementation of some attentions for Deep Learning Researchers.
additive-attention attention dot-product-attention location-aware-attention location-sensitive-attension multi-head-attention pytorch relative-multi-head-attention relative-positional-encoding
Language:Python 490
bulatkh / image_captioning
Master Project on Image Captioning using Supervised Deep Learning Methods
image-captioning attention-mechanisms encoder-decoder-framework recurrent-neural-networks vgg bahdanau-attention dot-product-attention beam-search-decoder tensorflow keras
Language:Jupyter Notebook 4
mtanghu / LEAP
LEAP: Linear Explainable Attention in Parallel for causal language modeling with O(1) path length, and O(1) inference
linear-attention pytorch transformers attention-mechanism deep-learning local-attention softmax additive-attention dot-product-attention parallel rnn transformer
Language:Jupyter Notebook 4
AndreiMoraru123 / Neural-Machine-Translation
Modern Eager TensorFlow implementation of Attention Is All You Need
attention beam-search encoder-decoder keras label-smoothing nlp self-attention tensorflow transformers translation bleu-score byte-pair-encoding deep-learning dot-product-attention einops embedding-projector embeddings language language-model tokenization
Language:Python 2
dcarpintero / transformer101
Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'
attention-is-all-you-need encoder-decoder-architecture multihead-attention positional-encoding self-attention transfomer dot-product-attention dropout-layers feedforward-neural-network gelu linear-layers normalization-layers softmax pytorch
Language:Jupyter Notebook 1
kkiningh / tf-attention-example
Simple example of how to do dot-product attention in TensorFlow
attention dot-product-attention tensorflow
Language:Python 1
whsqkaak / attentions_pytorch
A repository for implementations of attention mechanism by PyTorch.
attention dot-product-attention pytorch scaled-dot-product-attention attention-mechanism multihead-attention
Language:Python 1