attention-mechanism

There are 33 repositories under attention-mechanism topic.

lucidrains / vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
artificial-intelligence attention-mechanism computer-vision image-classification transformers
Language:Python 10093
brightmart / text_classification
all kinds of text classification models and more with deep learning
attention-mechanism classification convolutional-neural-networks fasttext memory-networks multi-class multi-label nlp sentence-classification tensorflow text-classification textcnn textrnn
Language:Python 7318
awesome-graph-classification
benedekrozemberczki / awesome-graph-classification
A collection of important graph embedding, classification and representation learning papers with implementations.
attention-mechanism classification-algorithm deep-graph-kernels deepwalk graph-attention-model graph-attention-networks graph-classification graph-convolutional-networks graph-embedding graph-kernel graph-kernels graph-representation-learning graph2vec kernel-methods netlsd network-embedding node-embedding node2vec structural-attention weisfeiler-lehman
Language:Python 4409
lucidrains / DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
artificial-intelligence attention-mechanism deep-learning multi-modal text-to-image transformers
Language:Python 4319
Kyubyong / transformer
A TensorFlow Implementation of the Transformer: Attention Is All You Need
attention-is-all-you-need attention-mechanism implementation transformer translation
Language:Python 3731
philipperemy / keras-attention-mechanism
Attention mechanism Implementation for Keras.
keras keras-neural-networks attention-mechanism attention-model deep-learning
Language:Python 2593
PetarV- / GAT
Graph Attention Networks (https://arxiv.org/abs/1710.10903)
graph-attention-networks attention-mechanism self-attention tensorflow neural-networks python
Language:Python 2399
zzw922cn / awesome-speech-recognition-speech-synthesis-papers
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
automatic-speech-recognition papers roadmap rnn cnn dnn attention-mechanism seq2seq acoustic-model timit-dataset tts language-model speaker-verification speech-recognition speech-synthesis neural-network recognition-synthesis diffusion-models singing-voice-synthesis voice-conversion
2255
Diego999 / pyGAT
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
graph-attention-networks attention-mechanism self-attention pytorch neural-networks python
Language:Python 2053
sgrvinod / a-PyTorch-Tutorial-to-Image-Captioning
Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning
pytorch pytorch-tutorial show-attend-and-tell image-captioning encoder-decoder attention-mechanism computer-vision mscoco
Language:Python 2020
lucidrains / reformer-pytorch
Reformer, the efficient Transformer, in Pytorch
artificial-intelligence transformers attention-mechanism machine-learning pytorch
Language:Python 1742
pytorch-GAT
gordicaleksa / pytorch-GAT
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
attention attention-mechanism deep-learning gat gat-tutorial graph-attention-network graph-attention-networks jupyter python pytorch pytorch-gat pytorch-implementation self-attention
Language:Jupyter Notebook 1635
lucidrains / x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
artificial-intelligence attention-mechanism deep-learning transformers
Language:Python 1597
lucidrains / lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
artificial-intelligence deep-learning computer-vision attention-mechanism attention
Language:Python 1502
awslabs / sockeye
Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch
deep-learning deep-neural-networks machine-learning machine-translation neural-machine-translation encoder-decoder attention-mechanism sequence-to-sequence sequence-to-sequence-models sockeye attention-is-all-you-need attention-model seq2seq translation transformer-architecture transformer transformer-network pytorch
Language:Python 1070
lucidrains / alphafold2
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
artificial-intelligence deep-learning protein-folding attention-mechanism
Language:Python 1032
richliao / textClassifier
Text classifier for Hierarchical Attention Networks for Document Classification
text-classification hierarchical-attention-networks attention-mechanism recurrent-neural-networks convolutional-neural-networks
Language:Python 1028
charlesXu86 / Chatbot_CN
基于金融-司法领域(兼有闲聊性质)的聊天机器人，其中的主要模块有信息抽取、NLU、NLG、知识图谱等，并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口
attention-mechanism chatbot-cn deep-learning dialogue-systems django-restful intent-detection ir knowledge-graph ner nlg nlu oriented-dialogs recommendation reinforcement-learning sentiment-analysis slot-filling tenserflow-serving tensorflow text-classification text-correct
1019
yunjey / show-attend-and-tell
TensorFlow Implementation of "Show, Attend and Tell"
attention-mechanism image-captioning mscoco-image-dataset show-attend-and-tell tensorflow
Language:Jupyter Notebook 898
lucidrains / performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
artificial-intelligence deep-learning attention-mechanism attention transformers
Language:Python 829
self-attention-cv
The-AI-Summer / self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
artificial-intelligence attention attention-mechanism deep-learning machine-learning machine-learning-algorithms self-attention transformer transformers
Language:Python 822
atulkum / pointer_summarizer
pytorch implementation of "Get To The Point: Summarization with Pointer-Generator Networks"
nlp deep-learning attention-mechanism summarization pointer-networks pytorch-implmention seq2seq-attn
Language:Python 793
lucidrains / perceiver-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
artificial-intelligence deep-learning attention-mechanism
Language:Python 778
datalogue / keras-attention
Visualizing RNNs using the attention mechanism
attention-mechanism deep-learning deep-neural-networks machine-learning natural-language-processing recurrent-neural-networks translation
Language:Python 724
cedrickchee / awesome-bert-nlp
A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.
nlp natural-language-processing bert transformer language-model transfer-learning attention-mechanism awesome-list gpt-2 xlnet neural-networks pre-trained-language-models gpt-3 awesome
691
pytorch-original-transformer
gordicaleksa / pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
attention attention-is-all-you-need attention-mechanism deep-learning deeplearning jupyter original-transformer python pytorch pytorch-transformer pytorch-transformers transformer transformer-tutorial transformers
Language:Jupyter Notebook 660
ibrahimjelliti / Deeplearning.ai-Natural-Language-Processing-Specialization
This repository contains my full work and notes on Coursera's NLP Specialization (Natural Language Processing) taught by the instructor Younes Bensouda Mourri and Łukasz Kaiser offered by deeplearning.ai
machine-learning deep-learning nlp coursera deeplearning-ai specialization neural neural-networks logistic-regression naive-bayes probabilistic-models sequence-models attention-mechanism encoder-decoder
Language:Jupyter Notebook 605
CyberZHG / keras-self-attention
Attention mechanism for processing sequential data that considers the context for each timestamp.
attention-mechanism keras
Language:Python 593
Canjie-Luo / MORAN_v2
MORAN: A Multi-Object Rectified Attention Network for Scene Text Recognition
scene-text scene-text-recognition image-deformation image-rectification attention-mechanism
Language:Python 590
lucidrains / bottleneck-transformer-pytorch
Implementation of Bottleneck Transformer in Pytorch
artificial-intelligence deep-learning transformers attention-mechanism image-classification vision
Language:Python 582
lucidrains / TimeSformer-pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
artificial-intelligence deep-learning attention-mechanism transformers video-classification
Language:Python 567
hirofumi0810 / neural_sp
End-to-end ASR/LM implementation with PyTorch
pytorch speech-recognition automatic-speech-recognition asr ctc attention-mechanism attention seq2seq sequence-to-sequence speech language-model transformer language-modeling rnn-transducer transformer-xl streaming
Language:Python 546
lvapeab / nmt-keras
Neural Machine Translation with Keras
neural-machine-translation keras deep-learning sequence-to-sequence theano machine-learning nmt machine-translation lstm-networks gru tensorflow attention-mechanism web-demo transformer attention-is-all-you-need attention-model attention-seq2seq
Language:Python 526
soobinseo / Transformer-TTS
A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"
text-to-speech tts transformer attention-plots attention-mechanism deep-learning pytorch pytorch-implementation
Language:Python 501
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
492
kaushalshetty / Structured-Self-Attention
A Structured Self-attentive Sentence Embedding
attention-mechanism attention-model self-attention self-attentive-rnn pytorch deep-learning python3 attention visualization classification sentence-embeddings attention-weights
Language:Python 486

ezoic increase your site revenue

Related Topics

nlp natural-language-processing bert sentiment-analysis text-classification