transformer-models

There are 4 repositories under transformer-models topic.

cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer computer-vision papers attention-mechanisms self-attention vit detr transformers
4292
OpenNMT / CTranslate2
Fast inference engine for Transformer models
neural-machine-translation cpp mkl quantization cuda thrust opennmt deep-neural-networks openmp onednn intrinsics avx2 avx parallel-computing gemm neon transformer-models machine-translation deep-learning inference
Language:C++ 2860
sovrasov / flops-counter.pytorch
Flops counter for convolutional networks in pytorch framework
deep-neural-networks deeplearning flops-counter pytorch pytorch-cnn pytorch-utils transformer transformer-models
Language:Python 2696
VITA-Group / TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
transformer transformer-encoder transformer-models gan pytorch
Language:Python 1625
vturrisi / solo-learn
solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
simclr nvidia-dali contrastive-learning pytorch pytorch-lightning barlow-twins self-supervised-learning swav byol moco simsiam vicreg nnclr dino deepcluster ressl vibcreg transformer-models mae masked-input-prediction
Language:Python 1363
swarms
kyegomez / swarms
Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD
artificial-intelligence attention-mechanism gpt4 langchain machine-learning multi-modal-imaging multi-modality multimodal swarms transformer-models agents prompt-engineering prompt-toolkit prompting tree-of-thoughts ai chatgpt gpt4all huggingface langchain-python
Language:Python 696
daiquocnguyen / Graph-Transformer
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
graph-classification graph-deep-learning graph-embeddings graph-machine-learning graph-neural-networks graph-representation-learning graph-transformer node-embeddings self-attention text-classification transformer transformer-models
Language:Python 623
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models vision-transformer large-language-models transformer-models multimodal-models
587
ScalaConsultants / Aspect-Based-Sentiment-Analysis
💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)
aspect-based-sentiment-analysis tensorflow sentiment-analysis machine-learning interpretability distill transformers transformer-models bert-embeddings deep-learning explainable-ml explainable-ai
Language:Python 529
imperial-qore / TranAD
[VLDB'22] Anomaly Detection using Transformers, self-conditioning and adversarial training.
adversarial-learning anomaly-detection multi-head-attention transformer-models unsupervised-learning
Language:Python 464
cuiziteng / Illumination-Adaptive-Transformer
[BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.
exposure-correction low-light-enhance transformer-architecture transformer-models low-level-vision bmvc image-enhancement image-reconstruction image-restoration pytorch low-light-image-enhancement
Language:Python 429
TransformerSum
HHousen / TransformerSum
Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.
automatic-summarization machine-learning extractive-summarization bert roberta distilbert albert summarization transformer-models pytorch-lightning summarization-dataset text-summarization
Language:Python 425
audeering / w2v2-how-to
How to use our public wav2vec2 dimensional emotion model
speech-emotion-recognition deep-learning wav2vec2 transformer-models arousal dominance valence msp-podcast onnx
Language:Jupyter Notebook 402
usefulsensors / useful-transformers
Efficient Inference of Transformer models
cpp neural-networks npu openai-whisper rockchip transformer-models
Language:C++ 319
RetroCirce / HTS-Audio-Transformer
The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"
audio-classification sound-event-detection music-information-retrieval transformer-models python
Language:Python 317
philipturner / metal-flash-attention
Faster alternative to Metal Performance Shaders
artificial-intelligence attention-mechanism gpgpu high-performance-computing machine-learning metal quantum-chemistry-simulation stable-diffusion transformer-models
Language:Swift 301
ThilinaRajapakse / pytorch-transformers-classification
Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.
pytorch-transformers text-classification natural-language-processing transformer-models huggingface
Language:Jupyter Notebook 300
dpressel / mint
MinT: Minimal Transformer Library and Tutorials
transformer-models transformer transformers pytorch bert gpt2 gpt bart t5 roberta sentence-transformers tutorials opt
Language:Python 241
xashru / punctuation-restoration
Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
bangla bert deep-learning punctuation-marks punctuation-restoration pytorch transformer-models
Language:Python 194
davidnvq / grit
GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
image-cap coco-captions detr eccv2022 nocaps region-based-method swin-transformer transformer-models image-captioning object-detection
Language:Python 173
yizhongw / Tk-Instruct
Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
few-shot-learning instruction transformer-models zero-shot-learning cross-task-generalization
Language:Python 172
RetroCirce / Zero_Shot_Audio_Source_Separation
The official code repo for "Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data", in AAAI 2022
audio-source-separation music-information-retrieval zero-shot-learning transformer-models query-based-learning python
Language:Python 166
AnkurDeria / MFT
Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.
deep-learning hsi-classification multimodal-datasets multimodal-deep-learning remote-sensing transformer-models hyperspectral-image-classification
Language:Jupyter Notebook 154
imodelsX
csinva / imodelsX
Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.
ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch text text-classification transformer-models xai scikit-learn
Language:Python 133
GuoLanqing / ShadowFormer
ShadowFormer (AAAI2023), Pytorch implementation
image-processing image-restoration shadow-removal transformer-models
Language:Python 120
attention-viz
catherinesyeh / attention-viz
Visualizing query-key interactions in language + vision transformers
attention-mechanism attention-visualization bert computer-vision gpt nlp transformer transformer-models visualization visualization-tools
Language:HTML 105
crockwell / rel_pose
[3DV 2022] The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs
3d-vision computer-vision machine-learning transformer-models vision-transformer
Language:Python 89
cptq / SignNet-BasisNet
SignNet and BasisNet
deep-learning graph-neural-networks machine-learning graph graph-convolutional-networks graph-machine-learning graph-transformer transformer-models
Language:Python 88
kyegomez / Algorithm-Of-Thoughts
My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"
artificial-intelligence gpt4 gpt4-api gpt4all prompt-engineering swarms transformer-architecture transformer-models ai-reasoning
Language:Python 74
sagizty / Multi-Stage-Hybrid-Transformer
Official release of MSHT: Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer https://ieeexplore.ieee.org/document/10006398
cytopathology pancreatic-cancer transformer-models deep-learning multi-scale-model hybrid-models
Language:Jupyter Notebook 68
Soham-Deshpande / Stock-TFT
Stock price prediction using a Temporal Fusion Transformer
deep-learning machine-learning stock-market stock-prediction python time-series-analysis tft temporal-fusion-transformer transformer-models
Language:TeX 67
ZhouYuxuanYX / Hyperformer
This is the official implementation of our paper "Hypergraph Transformer for Skeleton-based Action Recognition."
graph-modeling hypergraph-neural-networks skeleton-based-action-recognition transformer-models
Language:Python 64
ayanglab / SwinMR
This is the official implementation of our proposed SwinMR
mri-reconstruction transformer-models swin-transformer deep-learning computer-vision
Language:Python 60
marslanm / Multimodality-Representation-Learning
This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .
cross-modal multimodal-datasets multimodal-deep-learning multimodal-pre-trained-model transformer-models vision-language-pretraining multimodal-applications multimodal-pretext
60
aofrancani / TSformer-VO
Implementation of the paper "Transformer-based model for monocular visual odometry: a video understanding approach".
deep-learning monocular-visual-odometry transformer-models visual-odometry visual-slam
Language:Python 57
sviperm / neuro-comma
🇷🇺 Punctuation restoration production-ready model for Russian language 🇷🇺
deep-learning pytorch bert punctuation-marks transformer-models punctuation-restoration ner machine-learning python nlp russian
Language:Python 55

transformer-models

cmhungsteve / Awesome-Transformer-Attention

OpenNMT / CTranslate2

sovrasov / flops-counter.pytorch

VITA-Group / TransGAN

vturrisi / solo-learn

kyegomez / swarms

daiquocnguyen / Graph-Transformer

uncbiag / Awesome-Foundation-Models

ScalaConsultants / Aspect-Based-Sentiment-Analysis

imperial-qore / TranAD

cuiziteng / Illumination-Adaptive-Transformer

HHousen / TransformerSum

audeering / w2v2-how-to

usefulsensors / useful-transformers

RetroCirce / HTS-Audio-Transformer

philipturner / metal-flash-attention

ThilinaRajapakse / pytorch-transformers-classification

dpressel / mint

xashru / punctuation-restoration

davidnvq / grit

yizhongw / Tk-Instruct

RetroCirce / Zero_Shot_Audio_Source_Separation

AnkurDeria / MFT

csinva / imodelsX

GuoLanqing / ShadowFormer

catherinesyeh / attention-viz

crockwell / rel_pose

cptq / SignNet-BasisNet

kyegomez / Algorithm-Of-Thoughts

sagizty / Multi-Stage-Hybrid-Transformer

Soham-Deshpande / Stock-TFT

ZhouYuxuanYX / Hyperformer

ayanglab / SwinMR

marslanm / Multimodality-Representation-Learning

aofrancani / TSformer-VO

sviperm / neuro-comma