multi-head-self-attention

There are 0 repository under multi-head-self-attention topic.

Altaheri / EEG-ATCNet
Attention temporal convolutional network for EEG-based motor imagery classification
attention classification convolutional-neural-networks eeg motor-imagery multi-head-self-attention temporal-convolutional-network
Language:Python 153
datnnt1997 / multi-head_self-attention
A Faster Pytorch Implementation of Multi-Head Self-Attention
self-attention attention-mechanism attention multihead-attention multihead-self-attention multi-head-self-attention pytorch-self-attention transformer-attention multi-head multi-head-attention
Language:Jupyter Notebook 68
BabyGPT-Build_GPT_From_Scratch
TatevKaren / BabyGPT-Build_GPT_From_Scratch
BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python
python gpt gpt-3 large-language-models llm-training llms transformers attention-is-all-you-need dropout-layers multi-head-self-attention pytorch residual-connections layer-normalization neural-networks
Language:Python 33
cyk1337 / Transformer-in-PyTorch
Transformer/Transformer-XL/R-Transformer examples and explanations
multi-head-self-attention self-attention transformer-variants transformers
Language:Python 25
ChristianOrr / transformers
Transformer creation from scratch using Jax.
attention-mechanism bigram gpt-2 multi-head-self-attention transformer
Language:Jupyter Notebook 3