attention

There are 24 repositories under attention topic.

annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
attention deep-learning deep-learning-tutorial gan literate-programming machine-learning neural-networks optimizers pytorch reinforcement-learning transformer transformers
Language:Jupyter Notebook 48996
ddbourgin / numpy-ml
Machine learning, in numpy
machine-learning neural-networks topic-modeling gaussian-mixture-models hidden-markov-models gradient-boosting bayesian-inference wavenet vae resnet lstm wgan-gp attention reinforcement-learning good-turing-smoothing knn mfcc gaussian-processes word2vec
Language:Python 14578
graykode / nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
attention bert natural-language-processing nlp paper pytorch tensorflow transformer tutorial
Language:Jupyter Notebook 13758
xmu-xiaoma666 / External-Attention-pytorch
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
attention pytorch paper cbam squeeze excitation-networks linear-layers visual-tasks
Language:Python 10951
jadore801120 / attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
attention attention-is-all-you-need deep-learning natural-language-processing nlp pytorch
Language:Python 8505
bentrevett / pytorch-seq2seq
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
pytorch seq2seq sequence-to-sequence tutorial rnn gru lstm torchtext pytorch-tutorial pytorch-implmention encoder-decoder encoder-decoder-model neural-machine-translation pytorch-seq2seq attention transformer cnn-seq2seq pytorch-implementation pytorch-tutorials pytorch-nlp
Language:Jupyter Notebook 5179
km1994 / nlp_paper_study
该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记
attention bert entity-recognition gcn relation-extraction
Language:C++ 3762
google-research / scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
attention computer-vision deep-learning jax research transformers vision-transformer
Language:Python 3036
anseki / leader-line
Draw a leader line in your web page.
leader line svg mouse markup arrow attention highlight spotlight bubble
Language:JavaScript 2931
iscyy / yoloair
🔥🔥🔥 专注于YOLOv5，YOLOv7、YOLOv8、YOLOv9改进模型，Support to improve backbone, neck, head, loss, IoU, NMS and other modules🚀
yolov5 attention backbone pytorch transformer yolor yolov3 yolov4 yolov7 yolox deep-learning yoloair scaledyolov4 yolov6 ppyolo ppyoloe tood anchor-based anchor-free yolo
Language:Python 2352
pytorch-GAT
gordicaleksa / pytorch-GAT
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
gat graph-attention-networks attention-mechanism self-attention pytorch python attention pytorch-gat gat-tutorial deep-learning graph-attention-network pytorch-implementation jupyter
Language:Jupyter Notebook 2311
hyunwoongko / transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
attention dataset pytorch transformer
Language:Python 2258
songyouwei / ABSA-PyTorch
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
sentiment-analysis aspect-based-sentiment-analysis bert attention natural-language-processing nlp sentiment-classification
Language:Python 1962
mesolitica / NLP-Models-Tensorflow
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
nlp machine-learning deep-learning lstm attention lstm-seq2seq-tf neural-machine-translation optical-character-recognition dnc-seq2seq pos-tagging summarization embedded luong-api chatbot speech-to-text language-detection
Language:Jupyter Notebook 1775
argusswift / YOLOv4-pytorch
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
yolov4 object-detection pytorch senet cbam mobilenetv2 mobilenetv3 attention
Language:Python 1683
msgi / nlp-journey
Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.
ner embedding classification similarity keras tensorflow lda gensim fasttext svm bert elmo word2vec crf attention
Language:Python 1580
lucidrains / lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
artificial-intelligence deep-learning computer-vision attention-mechanism attention
Language:Python 1534
szagoruyko / attention-transfer
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
pytorch knowledge-distillation attention deep-learning
Language:Jupyter Notebook 1426
dorarad / gansformer
Generative Adversarial Transformers
transformers gans generative-adversarial-networks image-generation scene-generation compositionality attention
Language:Python 1309
pprp / SimpleCVReproduction
Replication of simple CV Projects including attention, classification, detection, keypoint detection, etc.
computer-vision paper-reproduction demo cv pytorch classification object-detection face-detection landmark attention
Language:Jupyter Notebook 1177
self-attention-cv
The-AI-Summer / self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
deep-learning transformer transformers self-attention attention-mechanism attention machine-learning machine-learning-algorithms artificial-intelligence
Language:Python 1141
codingonion / awesome-yolo-object-detection
🚀🚀🚀 A collection of some awesome public YOLO object detection series projects.
yolo yolov5 onnx tensorrt object-detection snn attention yolov8 autonomous-driving spiking-neural-network gui awesome-list sora gpt yolov9 qt cuda llm ultralytics llama3
1066
lucidrains / performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
artificial-intelligence deep-learning attention-mechanism attention transformers
Language:Python 1059
awesome-fast-attention
Separius / awesome-fast-attention
list of efficient attention modules
transformer attention awesome reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network
Language:Python 978
kevinzakka / spatial-transformer-network
A Tensorflow implementation of Spatial Transformer Networks.
affine-transformation attention convnet spatial-transformer-network stn tensorflow
Language:Python 974
houqb / CoordAttention
Code for our CVPR2021 paper coordinate attention
attention mobilenetv2 mobilenext
Language:Python 960
pytorch-original-transformer
gordicaleksa / pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
attention attention-is-all-you-need attention-mechanism deep-learning deeplearning jupyter original-transformer python pytorch pytorch-transformer pytorch-transformers transformer transformer-tutorial transformers
Language:Jupyter Notebook 939
MorvanZhou / NLP-Tutorials
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
seq2seq attention nlp tutorial bert gpt w2v transformer elmo
Language:Python 875
jtkim-kaist / VAD
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
vad dnn lstm bdnn acam attention speech data voice-detection speech-recognition voice-activity-detection speech-activity-detection
Language:MATLAB 822
graphtransformer
graphdeeplearning / graphtransformer
Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.
graph-transformer transformers transformer attention graph-neural-networks graph-deep-learning aaai transformer-networks
Language:Python 817
jeya-maria-jose / Medical-Transformer
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
attention deep-learning medical-image-analysis medical-imaging pytorch segmentation transformer transformers
Language:Python 777
kaituoxu / Speech-Transformer
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
asr transformer end-to-end attention self-attention attention-is-all-you-need pytorch
Language:Python 764
ilivans / tf-rnn-attention
Tensorflow implementation of attention mechanism for text classification tasks.
attention tensorflow rnn text-classification sentiment-analysis
Language:Python 745
TobiasLee / Text-Classification
Implementation of papers for text classification task on DBpedia
text-classification attention tensorflow lstm cnn
Language:Python 738
buppt / ChineseNRE
中文实体关系抽取，pytorch，bilstm+attention
relation-extraction nre pytorch chinese bilstm-attention bilstm attention
Language:Python 733
google-research / long-range-arena
Long Range Arena for Benchmarking Efficient Transformers
attention deep-learning flax jax nlp transformers
Language:Python 685

attention

labmlai / annotated_deep_learning_paper_implementations

ddbourgin / numpy-ml

graykode / nlp-tutorial

xmu-xiaoma666 / External-Attention-pytorch

jadore801120 / attention-is-all-you-need-pytorch

bentrevett / pytorch-seq2seq

km1994 / nlp_paper_study

google-research / scenic

anseki / leader-line

iscyy / yoloair

gordicaleksa / pytorch-GAT

hyunwoongko / transformer

songyouwei / ABSA-PyTorch

mesolitica / NLP-Models-Tensorflow

argusswift / YOLOv4-pytorch

msgi / nlp-journey

lucidrains / lambda-networks

szagoruyko / attention-transfer

dorarad / gansformer

pprp / SimpleCVReproduction

The-AI-Summer / self-attention-cv

codingonion / awesome-yolo-object-detection

lucidrains / performer-pytorch

Separius / awesome-fast-attention

kevinzakka / spatial-transformer-network

houqb / CoordAttention

gordicaleksa / pytorch-original-transformer

MorvanZhou / NLP-Tutorials

jtkim-kaist / VAD

graphdeeplearning / graphtransformer

jeya-maria-jose / Medical-Transformer

kaituoxu / Speech-Transformer

ilivans / tf-rnn-attention

TobiasLee / Text-Classification

buppt / ChineseNRE

google-research / long-range-arena