transformer-encoder

There are 1 repository under transformer-encoder topic.

microsoft / DeBERTa
The implementation of DeBERTa
bert deeplearning language-model natural-language-understanding representation-learning roberta self-attention transformer-encoder
Language:Python 1987
VITA-Group / TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
gan pytorch transformer transformer-encoder transformer-models
Language:Python 1642
brightmart / bert_language_understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning nlp question-answering textcnn fasttext
Language:Python 958
lilianweng / transformer-tensorflow
Implementation of Transformer Model in Tensorflow
attention-is tensorflow-models transformer transformer-encoder
Language:Python 450
wgcban / ChangeFormer
[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection
attention-mechanism change-detection climate-change deep-learning multi-temporal pytorch remote-sensing satellite-imagery siamese-network transformer-architecture transformer-encoder
Language:Python 429
zhongkaifu / Seq2SeqSharp
Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.
attention-model cuda deep-learning encoder-decoder gpu image lstm machine-translation neural-network seq2seq sequence-to-sequence tensor text transformer transformer-architecture transformer-encoder translation vision-transformer
Language:C# 199
jackaduma / SecBERT
pretrained BERT model for cyber security text, learned CyberSecurity Knowledge
cybersecurity security nlp bert bert-embeddings nlp-machine-learning deeplearning attention transformers transformer-encoder cyber-security security-automation apt machine-learning-security deep-learning-security cyber-threat-intelligence threat-intelligence threat-hunting threat-detection threat-analysis
Language:Python 158
Vidhiwar / multimodule-ecg-classification
Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification
cnn deep-learning lstm mitbih pytorch transformer transformer-encoder
Language:Jupyter Notebook 97
declare-lab / MIME
This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.
dialogue-systems conversational-bots natural-language-processing transformer-encoder empathetic-dialogues empathetic-responses
Language:Python 43
bh1995 / AF-classification
The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.
ecg-classification transformer deep-learning neural-network transformer-encoder
Language:Python 38
microsoft / CASPR
CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.
attention-mechanism business deep-learning tabular-data transformer transformer-architecture transformer-encoder
Language:Python 38
gazelle93 / Transformer-Various-Positional-Encoding
This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods.
gensim natural-language-processing nlp nltk pytorch relative-positional-encoding relative-positional-representation spacy t5 transformer transformer-encoder wordembeddings
Language:Python 22
helpmefindaname / transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
python transformer-encoder transformers
Language:Python 22
ApurbaSengupta / Lyrics-Generation-using-BERT
Generating English Rock lyrics using BERT
bert bert-model jupyter-notebook lyrics-generator pronouncing rhyming songs transformer transformer-encoder
Language:Jupyter Notebook 19
jiangnanboy / knowledge-automatic-tagging
题目知识点预测标注。Question knowledge point prediction.
pytorch textcnn transformer-encoder knowledge-auto-tagging
Language:Jupyter Notebook 19
heartcored98 / transformer_anatomy
Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020
attention-head interpretability interpretable-deep-learning transformer-encoder
Language:Python 15
zhenyuanlu / PainAttnNet
Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals
deep-learning machine-learning pain-classification transformer-encoder
Language:Python 15
nikhilroxtomar / Vision-Transformer-ViT-in-TensorFlow
Vision Transformer Implementation in TensorFlow
transformer transformer-architecture transformer-encoder vision-transformer vit
Language:Python 12
utahnlp / therapist-observer
Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"
acl2019 attention behavior-coding dialog elmo focal-loss hierarchical-attention-networks psychotherapy transformer-encoder
Language:Python 12
brainsqueeze / text2vec
Contextual embedding for text blobs.
text-embedding tensorflow text-summarization sequence-to-sequence attention-model transformer-encoder natural-language-processing
Language:Python 11
jaketae / realformer
PyTorch implementation of RealFormer: Transformer Likes Residual Attention
pytorch transformer transformer-encoder natural-language-processing
Language:Python 11
hoangtuanvu / conformer_ocr
Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).
conformer ocr optical-character-recognition transformer-encoder vietnamese-ocr
Language:Python 9
ImMohammadHosseini / MKP-RL
:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers
knapsack-problem multiple-knapsacks ppo proximal-policy-optimization reinforcement-learning reinforcement-learning-algorithms transformer-encoder transformer-pytorch transformers-models combinatorial-optimization deep-reinforcement-learning transformers deep-learning lstm mlp resource-management discrete-sac sac soft-actor-critic
Language:Python 9
Shikhar-S / EvolvedTransformer
Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP
transformer-encoder classification-model evolved-transformer attention-is-all-you-need gated-linear-unit
Language:Jupyter Notebook 9
bl0nder / makespeare
Repository for a transformer I coded from scratch and trained on the tiny-shakespeare dataset.
deep-learning neural-networks pytorch text-generation transformer-architecture transformer-encoder transformer-from-scratch
Language:Python 8
JinLi711 / UTGN
Universal Transforming Geometric Network for protein structure prediction.
deep-learning protein-structure transformer-encoder
Language:Python 8
kyegomez / ShallowFF
Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"
artificial-intelligence attention attention-is-all-you-need attention-mechanism attention-mechanisms feedforward transformer transformer-encoder transformer-models transformers-models
Language:Python 8
samrat-halder / personality-detection-with-BERT-RoBERT
Detection of MBTI-type personality with NLP and Deep Learning
nlp bert-model robert embeddings classification transformer-encoder attention-mechanism
Language:Python 8
naokishibuya / simple_transformer
A Transformer Implementation that is easy to understand and customizable.
transformer transformer-architecture transformer-models transformer-pytorch transformer-encoder transformers-models transformers
Language:Python 7
xiaobaicxy / text-classification-transformer-attention-pytorch
Pytorch实现transformer编码器+attention的文本分类算法
pytorch text-classification transformer-encoder
Language:Python 7
lucylow / En_francais_si_vous_plait-
French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"
pytorch machine-learning french french-nlp french-english translation fairseq sequence-to-sequence sequence-models language-translation-service transformer-encoder attention attention-is-all-you-need attention-model wmt-14 neural-networks cnn convolutional-neural-network
Language:Python 5
Platanus-hy / sememes_codriven_text_matching
Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge
chinese-nlp hownet knowledge-representation semantic-analysis transformer-encoder knowledge-data-codriven semantic-consistency sememes-knowledge
Language:Python 5
larngroup / TAG-DTA
TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers
binding-affinity binding-pocket deep-learning drug-target-interaction transformer-encoder
Language:Python 4
OumaimaHourrane / Bert_LDA_Combo
Topic modeling using BERT and LDA combination.
topic-modeling bert bert-model bert-embeddings lda transformer transformer-encoder
Language:Jupyter Notebook 4
matchild / DeepBrownianMotion
A deep learning classification tool for anomalous diffusion trajectories.
diffusion pytorch transformer-architecture transformer-encoder
Language:Jupyter Notebook 3
yashkim77 / Document-Similarity
Semantic Textual Similarity between two document
cosine-similarity universal-sentence-encoder python tensorflow tensorflow-hub nlp transformer-encoder plotly jupyter-notebook
Language:Jupyter Notebook 3

transformer-encoder

microsoft / DeBERTa

VITA-Group / TransGAN

brightmart / bert_language_understanding

lilianweng / transformer-tensorflow

wgcban / ChangeFormer

zhongkaifu / Seq2SeqSharp

jackaduma / SecBERT

Vidhiwar / multimodule-ecg-classification

declare-lab / MIME

bh1995 / AF-classification

microsoft / CASPR

gazelle93 / Transformer-Various-Positional-Encoding

helpmefindaname / transformer-smaller-training-vocab

ApurbaSengupta / Lyrics-Generation-using-BERT

jiangnanboy / knowledge-automatic-tagging

heartcored98 / transformer_anatomy

zhenyuanlu / PainAttnNet

nikhilroxtomar / Vision-Transformer-ViT-in-TensorFlow

utahnlp / therapist-observer

brainsqueeze / text2vec

jaketae / realformer

hoangtuanvu / conformer_ocr

ImMohammadHosseini / MKP-RL

Shikhar-S / EvolvedTransformer

bl0nder / makespeare

JinLi711 / UTGN

kyegomez / ShallowFF

samrat-halder / personality-detection-with-BERT-RoBERT

naokishibuya / simple_transformer

xiaobaicxy / text-classification-transformer-attention-pytorch

lucylow / En_francais_si_vous_plait-

Platanus-hy / sememes_codriven_text_matching

larngroup / TAG-DTA

OumaimaHourrane / Bert_LDA_Combo

matchild / DeepBrownianMotion

yashkim77 / Document-Similarity