transformer-encoder

There are 1 repository under transformer-encoder topic.

microsoft / DeBERTa
The implementation of DeBERTa
bert deeplearning representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder
Language:Python 1863
VITA-Group / TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
gan pytorch transformer transformer-encoder transformer-models
Language:Python 1622
brightmart / bert_language_understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning nlp question-answering textcnn fasttext
Language:Python 959
lilianweng / transformer-tensorflow
Implementation of Transformer Model in Tensorflow
attention-is tensorflow-models transformer transformer-encoder
Language:Python 427
wgcban / ChangeFormer
[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection
change-detection remote-sensing siamese-network transformer-encoder transformer-architecture attention-mechanism pytorch deep-learning satellite-imagery multi-temporal climate-change
Language:Python 388
zhongkaifu / Seq2SeqSharp
Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.
seq2seq encoder-decoder neural-network deep-learning lstm attention-model cuda gpu tensor machine-translation transformer-encoder transformer sequence-to-sequence transformer-architecture translation image text vision-transformer
Language:C# 190
jackaduma / SecBERT
pretrained BERT model for cyber security text, learned CyberSecurity Knowledge
apt attention bert bert-embeddings cyber-security cyber-threat-intelligence cybersecurity deep-learning-security deeplearning machine-learning-security nlp nlp-machine-learning security security-automation threat-analysis threat-detection threat-hunting threat-intelligence transformer-encoder transformers
Language:Python 135
Vidhiwar / multimodule-ecg-classification
Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification
cnn deep-learning lstm mitbih pytorch transformer transformer-encoder
Language:Jupyter Notebook 81
declare-lab / MIME
This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.
conversational-bots dialogue-systems empathetic-dialogues empathetic-responses natural-language-processing transformer-encoder
Language:Python 43
microsoft / CASPR
CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.
attention-mechanism business deep-learning tabular-data transformer transformer-architecture transformer-encoder
Language:Python 36
bh1995 / AF-classification
The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.
ecg-classification transformer deep-learning neural-network transformer-encoder
Language:Python 35
helpmefindaname / transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
python transformer-encoder transformers
Language:Python 20
ApurbaSengupta / Lyrics-Generation-using-BERT
Generating English Rock lyrics using BERT
bert bert-model transformer-encoder transformer songs lyrics-generator jupyter-notebook pronouncing rhyming
Language:Jupyter Notebook 18
gazelle93 / Transformer-Various-Positional-Encoding
This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods.
gensim natural-language-processing nlp nltk pytorch relative-positional-encoding relative-positional-representation spacy t5 transformer transformer-encoder wordembeddings
Language:Python 16
jiangnanboy / knowledge-automatic-tagging
题目知识点预测标注。Question knowledge point prediction.
knowledge-auto-tagging pytorch textcnn transformer-encoder
Language:Jupyter Notebook 16
heartcored98 / transformer_anatomy
Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020
attention-head interpretability interpretable-deep-learning transformer-encoder
Language:Python 14
utahnlp / therapist-observer
Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"
psychotherapy acl2019 dialog focal-loss behavior-coding attention transformer-encoder elmo hierarchical-attention-networks
Language:Python 12
zhenyuanlu / PainAttnNet
Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals
deep-learning machine-learning pain-classification transformer-encoder
Language:Python 11
brainsqueeze / text2vec
Contextual embedding for text blobs.
text-embedding tensorflow text-summarization sequence-to-sequence attention-model transformer-encoder natural-language-processing
Language:Python 10
jaketae / realformer
PyTorch implementation of RealFormer: Transformer Likes Residual Attention
natural-language-processing pytorch transformer transformer-encoder
Language:Python 10
nikhilroxtomar / Vision-Transformer-ViT-in-TensorFlow
Vision Transformer Implementation in TensorFlow
transformer transformer-architecture transformer-encoder vision-transformer vit
Language:Python 10
hoangtuanvu / conformer_ocr
Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).
ocr optical-character-recognition conformer transformer-encoder vietnamese-ocr
Language:Python 9
JinLi711 / UTGN
Universal Transforming Geometric Network for protein structure prediction.
deep-learning protein-structure transformer-encoder
Language:Python 9
bl0nder / makespeare
Repository for a transformer I coded from scratch and trained on the tiny-shakespeare dataset.
deep-learning neural-networks pytorch text-generation transformer-architecture transformer-encoder transformer-from-scratch
Language:Python 8
ImMohammadHosseini / MKP-RL
:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers
knapsack-problem multiple-knapsacks ppo proximal-policy-optimization reinforcement-learning reinforcement-learning-algorithms transformer-encoder transformer-pytorch transformers-models combinatorial-optimization deep-reinforcement-learning transformers deep-learning lstm mlp resource-management discrete-sac sac soft-actor-critic
Language:Python 8
Shikhar-S / EvolvedTransformer
Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP
attention-is-all-you-need classification-model evolved-transformer gated-linear-unit transformer-encoder
Language:Jupyter Notebook 8
naokishibuya / simple_transformer
A Transformer Implementation that is easy to understand and customizable.
transformer transformer-architecture transformer-encoder transformer-models transformer-pytorch transformers transformers-models
Language:Python 7
samrat-halder / personality-detection-with-BERT-RoBERT
Detection of MBTI-type personality with NLP and Deep Learning
nlp bert-model robert embeddings classification transformer-encoder attention-mechanism
Language:Python 7
xiaobaicxy / text-classification-transformer-attention-pytorch
Pytorch实现transformer编码器+attention的文本分类算法
transformer-encoder pytorch text-classification
Language:Python 7
kyegomez / ShallowFF
Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"
artificial-intelligence attention attention-is-all-you-need attention-mechanism attention-mechanisms feedforward transformer transformer-encoder transformer-models transformers-models
Language:Python 6
lucylow / En_francais_si_vous_plait-
French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"
pytorch machine-learning french french-nlp french-english translation fairseq sequence-to-sequence sequence-models language-translation-service transformer-encoder attention attention-is-all-you-need attention-model wmt-14 neural-networks cnn convolutional-neural-network
Language:Python 6
OumaimaHourrane / Bert_LDA_Combo
Topic modeling using BERT and LDA combination.
topic-modeling bert bert-model bert-embeddings lda transformer transformer-encoder
Language:Jupyter Notebook 4
Platanus-hy / sememes_codriven_text_matching
Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge
chinese-nlp hownet knowledge-representation semantic-analysis transformer-encoder knowledge-data-codriven semantic-consistency sememes-knowledge
Language:Python 4
larngroup / TAG-DTA
TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers
binding-affinity binding-pocket deep-learning drug-target-interaction transformer-encoder
Language:Python 3
lordzuko / Transformer-Stance-Detection
This is a transformer based implementation for Stance Detection with Bidirectional Conditional Encoding
deep-learning implementation python pytorch stance-detection transformer-encoder
Language:Python 3
yashkim77 / Document-Similarity
Semantic Textual Similarity between two document
cosine-similarity universal-sentence-encoder python tensorflow tensorflow-hub nlp transformer-encoder plotly jupyter-notebook
Language:Jupyter Notebook 3

transformer-encoder

microsoft / DeBERTa

VITA-Group / TransGAN

brightmart / bert_language_understanding

lilianweng / transformer-tensorflow

wgcban / ChangeFormer

zhongkaifu / Seq2SeqSharp

jackaduma / SecBERT

Vidhiwar / multimodule-ecg-classification

declare-lab / MIME

microsoft / CASPR

bh1995 / AF-classification

helpmefindaname / transformer-smaller-training-vocab

ApurbaSengupta / Lyrics-Generation-using-BERT

gazelle93 / Transformer-Various-Positional-Encoding

jiangnanboy / knowledge-automatic-tagging

heartcored98 / transformer_anatomy

utahnlp / therapist-observer

zhenyuanlu / PainAttnNet

brainsqueeze / text2vec

jaketae / realformer

nikhilroxtomar / Vision-Transformer-ViT-in-TensorFlow

hoangtuanvu / conformer_ocr

JinLi711 / UTGN

bl0nder / makespeare

ImMohammadHosseini / MKP-RL

Shikhar-S / EvolvedTransformer

naokishibuya / simple_transformer

samrat-halder / personality-detection-with-BERT-RoBERT

xiaobaicxy / text-classification-transformer-attention-pytorch

kyegomez / ShallowFF

lucylow / En_francais_si_vous_plait-

OumaimaHourrane / Bert_LDA_Combo

Platanus-hy / sememes_codriven_text_matching

larngroup / TAG-DTA

lordzuko / Transformer-Stance-Detection

yashkim77 / Document-Similarity