attention

There are 30 repositories under attention topic.

annotated_deep_learning_paper_implementations
labmlai / annotated_deep_learning_paper_implementations
🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning attention literate-programming lora
Language:Python 63212
ddbourgin / numpy-ml
Machine learning, in numpy
machine-learning neural-networks topic-modeling gaussian-mixture-models hidden-markov-models gradient-boosting bayesian-inference wavenet vae resnet lstm wgan-gp attention reinforcement-learning good-turing-smoothing knn mfcc gaussian-processes word2vec
Language:Python 16145
graykode / nlp-tutorial
Natural Language Processing Tutorial for Deep Learning Researchers
nlp natural-language-processing tutorial pytorch tensorflow transformer attention paper bert
Language:Jupyter Notebook 14729
xmu-xiaoma666 / External-Attention-pytorch
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
attention pytorch paper cbam squeeze excitation-networks linear-layers visual-tasks
Language:Python 11864
jadore801120 / attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
attention attention-is-all-you-need deep-learning natural-language-processing nlp pytorch
Language:Python 9374
bentrevett / pytorch-seq2seq
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
attention cnn-seq2seq encoder-decoder encoder-decoder-model gru lstm neural-machine-translation pytorch pytorch-implementation pytorch-implmention pytorch-nlp pytorch-seq2seq pytorch-tutorial pytorch-tutorials rnn seq2seq sequence-to-sequence torchtext transformer tutorial
Language:Jupyter Notebook 5616
km1994 / nlp_paper_study
该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记
bert relation-extraction entity-recognition attention gcn
Language:C++ 4010
google-research / scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
jax computer-vision deep-learning research attention transformers vision-transformer
Language:Python 3661
hyunwoongko / transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
attention dataset pytorch transformer
Language:Python 3586
anseki / leader-line
Draw a leader line in your web page.
leader line svg mouse markup arrow attention highlight spotlight bubble
Language:JavaScript 3177
pytorch-GAT
gordicaleksa / pytorch-GAT
My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!
gat graph-attention-networks attention-mechanism self-attention pytorch python attention pytorch-gat gat-tutorial deep-learning graph-attention-network pytorch-implementation jupyter
Language:Jupyter Notebook 2590
thu-ml / SageAttention
Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.
attention inference-acceleration llm quantization cuda triton video-generation efficient-attention mlsys llm-infra vit video-generate
Language:Cuda 2390
songyouwei / ABSA-PyTorch
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
aspect-based-sentiment-analysis attention bert natural-language-processing nlp sentiment-analysis sentiment-classification
Language:Python 2063
mesolitica / NLP-Models-Tensorflow
Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0
nlp machine-learning deep-learning lstm attention lstm-seq2seq-tf neural-machine-translation optical-character-recognition dnc-seq2seq pos-tagging summarization embedded luong-api chatbot speech-to-text language-detection
Language:Jupyter Notebook 1786
argusswift / YOLOv4-pytorch
This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO
yolov4 object-detection pytorch senet cbam mobilenetv2 mobilenetv3 attention
Language:Python 1675
lucidrains / lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
artificial-intelligence attention attention-mechanism computer-vision deep-learning
Language:Python 1531
szagoruyko / attention-transfer
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
attention deep-learning knowledge-distillation pytorch
Language:Jupyter Notebook 1461
dorarad / gansformer
Generative Adversarial Transformers
attention compositionality gans generative-adversarial-networks image-generation scene-generation transformers
Language:Python 1339
pprp / SimpleCVReproduction
Replication of simple CV Projects including attention, classification, detection, keypoint detection, etc.
attention classification computer-vision cv demo face-detection landmark object-detection paper-reproduction pytorch
Language:Jupyter Notebook 1248
lucidrains / transfusion-pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
artificial-intelligence attention deep-learning multi-modal transformers flow-matching
Language:Python 1203
self-attention-cv
The-AI-Summer / self-attention-cv
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
artificial-intelligence attention attention-mechanism deep-learning machine-learning machine-learning-algorithms self-attention transformer transformers
Language:Python 1199
lucidrains / performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
artificial-intelligence attention attention-mechanism deep-learning transformers
Language:Python 1119
houqb / CoordAttention
Code for our CVPR2021 paper coordinate attention
attention mobilenetv2 mobilenext
Language:Python 1046
pytorch-original-transformer
gordicaleksa / pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
transformer transformers pytorch-transformer pytorch-transformers attention attention-mechanism attention-is-all-you-need pytorch python jupyter transformer-tutorial deeplearning deep-learning original-transformer
Language:Jupyter Notebook 1043
kevinzakka / spatial-transformer-network
A Tensorflow implementation of Spatial Transformer Networks.
spatial-transformer-network tensorflow stn attention affine-transformation convnet
Language:Python 1002
awesome-fast-attention
Separius / awesome-fast-attention
list of efficient attention modules
transformer attention awesome reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network
Language:Python 999
MorvanZhou / NLP-Tutorials
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
seq2seq attention nlp tutorial bert gpt w2v transformer elmo
Language:Python 951
graphtransformer
graphdeeplearning / graphtransformer
Graph Transformer Architecture. Source code for "A Generalization of Transformer Networks to Graphs", DLG-AAAI'21.
graph-transformer transformers transformer attention graph-neural-networks graph-deep-learning aaai transformer-networks
Language:Python 950
jtkim-kaist / VAD
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
vad dnn lstm bdnn acam attention speech data voice-detection speech-recognition voice-activity-detection speech-activity-detection
Language:MATLAB 863
jeya-maria-jose / Medical-Transformer
Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021
attention deep-learning medical-image-analysis medical-imaging pytorch segmentation transformer transformers
Language:Python 823
hellonlp / classifier-multi-label
多标签文本分类，多标签分类，文本分类, multi-label, classifier, text classification, BERT, seq2seq，attention, multi-label-classification
multi-label-classification text-classification tensorflow multi-label textcnn cnn bert classifier-multi-label text-classifier attention seq2seq
Language:Python 788
kaituoxu / Speech-Transformer
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
asr attention attention-is-all-you-need end-to-end pytorch self-attention transformer
Language:Python 786
buppt / ChineseNRE
中文实体关系抽取，pytorch，bilstm+attention
relation-extraction nre pytorch chinese bilstm-attention bilstm attention
Language:Python 764
google-research / long-range-arena
Long Range Arena for Benchmarking Efficient Transformers
attention deep-learning flax jax nlp transformers
Language:Python 749
ilivans / tf-rnn-attention
Tensorflow implementation of attention mechanism for text classification tasks.
attention rnn sentiment-analysis tensorflow text-classification
Language:Python 748
TobiasLee / Text-Classification
Implementation of papers for text classification task on DBpedia
text-classification attention tensorflow lstm cnn
Language:Python 737

attention

labmlai / annotated_deep_learning_paper_implementations

ddbourgin / numpy-ml

graykode / nlp-tutorial

xmu-xiaoma666 / External-Attention-pytorch

jadore801120 / attention-is-all-you-need-pytorch

bentrevett / pytorch-seq2seq

km1994 / nlp_paper_study

google-research / scenic

hyunwoongko / transformer

anseki / leader-line

gordicaleksa / pytorch-GAT

thu-ml / SageAttention

songyouwei / ABSA-PyTorch

mesolitica / NLP-Models-Tensorflow

argusswift / YOLOv4-pytorch

lucidrains / lambda-networks

szagoruyko / attention-transfer

dorarad / gansformer

pprp / SimpleCVReproduction

lucidrains / transfusion-pytorch

The-AI-Summer / self-attention-cv

lucidrains / performer-pytorch

houqb / CoordAttention

gordicaleksa / pytorch-original-transformer

kevinzakka / spatial-transformer-network

Separius / awesome-fast-attention

MorvanZhou / NLP-Tutorials

graphdeeplearning / graphtransformer

jtkim-kaist / VAD

jeya-maria-jose / Medical-Transformer

hellonlp / classifier-multi-label

kaituoxu / Speech-Transformer

buppt / ChineseNRE

google-research / long-range-arena

ilivans / tf-rnn-attention

TobiasLee / Text-Classification