transformer-models

There are 4 repositories under transformer-models topic.

cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
4737
swarms
kyegomez / swarms
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.gg/jM3Z6M9uMq
agents ai artificial-intelligence attention-mechanism chatgpt gpt4 gpt4all huggingface langchain langchain-python machine-learning multi-modal-imaging multi-modality multimodal prompt-engineering prompt-toolkit prompting swarms transformer-models tree-of-thoughts
Language:Python 4363
OpenNMT / CTranslate2
Fast inference engine for Transformer models
avx avx2 cpp cuda deep-learning deep-neural-networks gemm inference intrinsics machine-translation mkl neon neural-machine-translation onednn openmp opennmt parallel-computing quantization thrust transformer-models
Language:C++ 3553
sovrasov / flops-counter.pytorch
Flops counter for convolutional networks in pytorch framework
deep-neural-networks deeplearning flops-counter pytorch pytorch-cnn pytorch-utils transformer transformer-models
Language:Python 2854
VITA-Group / TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
transformer transformer-encoder transformer-models gan pytorch
Language:Python 1658
vturrisi / solo-learn
solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
barlow-twins byol contrastive-learning deepcluster dino mae masked-input-prediction moco nnclr nvidia-dali pytorch pytorch-lightning ressl self-supervised-learning simclr simsiam swav transformer-models vibcreg vicreg
Language:Python 1458
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models large-language-models multimodal-models transformer-models vision-transformer
923
daiquocnguyen / Graph-Transformer
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
graph-classification graph-deep-learning graph-embeddings graph-machine-learning graph-neural-networks graph-representation-learning graph-transformer node-embeddings self-attention text-classification transformer transformer-models
Language:Python 660
ScalaConsultants / Aspect-Based-Sentiment-Analysis
💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)
aspect-based-sentiment-analysis tensorflow sentiment-analysis machine-learning interpretability distill transformers transformer-models bert-embeddings deep-learning explainable-ml explainable-ai
Language:Python 560
imperial-qore / TranAD
[VLDB'22] Anomaly Detection using Transformers, self-conditioning and adversarial training.
anomaly-detection transformer-models multi-head-attention unsupervised-learning adversarial-learning
Language:Python 551
cuiziteng / Illumination-Adaptive-Transformer
🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.
bmvc exposure-correction image-enhancement image-reconstruction image-restoration low-level-vision low-light-enhance low-light-image-enhancement pytorch transformer-architecture transformer-models
Language:Python 497
audeering / w2v2-how-to
How to use our public wav2vec2 dimensional emotion model
arousal deep-learning dominance msp-podcast onnx speech-emotion-recognition transformer-models valence wav2vec2
Language:Jupyter Notebook 476
philipturner / metal-flash-attention
FlashAttention (Metal Port)
artificial-intelligence attention-mechanism high-performance-computing metal software-engineering stable-diffusion transformer-models
Language:Swift 431
TransformerSum
HHousen / TransformerSum
Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.
albert automatic-summarization bert distilbert extractive-summarization machine-learning pytorch-lightning roberta summarization summarization-dataset text-summarization transformer-models
Language:Python 428
harleyszhang / llm_note
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
cuda-programming kv-cache llm llm-inference transformer-models triton-kernels vllm
Language:Python 425
usefulsensors / useful-transformers
Efficient Inference of Transformer models
cpp neural-networks npu openai-whisper rockchip transformer-models
Language:C++ 415
RetroCirce / HTS-Audio-Transformer
The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"
audio-classification music-information-retrieval python sound-event-detection transformer-models
Language:Python 382
ThilinaRajapakse / pytorch-transformers-classification
Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.
huggingface natural-language-processing pytorch-transformers text-classification transformer-models
Language:Jupyter Notebook 306
dpressel / mint
MinT: Minimal Transformer Library and Tutorials
bart bert gpt gpt2 opt pytorch roberta sentence-transformers t5 transformer transformer-models transformers tutorials
Language:Python 251
xashru / punctuation-restoration
Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
punctuation-restoration transformer-models pytorch deep-learning bangla bert punctuation-marks
Language:Python 205
AnkurDeria / MFT
Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.
deep-learning hsi-classification multimodal-datasets multimodal-deep-learning remote-sensing transformer-models hyperspectral-image-classification
Language:Jupyter Notebook 200
RetroCirce / Zero_Shot_Audio_Source_Separation
The official code repo for "Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data", in AAAI 2022
audio-source-separation music-information-retrieval python query-based-learning transformer-models zero-shot-learning
Language:Python 191
davidnvq / grit
GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
coco-captions detr eccv2022 image-cap image-captioning nocaps object-detection region-based-method swin-transformer transformer-models
Language:Python 185
yizhongw / Tk-Instruct
Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
cross-task-generalization few-shot-learning instruction transformer-models zero-shot-learning
Language:Python 180
imodelsX
csinva / imodelsX
Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.
ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai
Language:Python 163
GuoLanqing / ShadowFormer
ShadowFormer (AAAI2023), Pytorch implementation
image-processing image-restoration shadow-removal transformer-models
Language:Python 143
attention-viz
catherinesyeh / attention-viz
Visualizing query-key interactions in language + vision transformers
attention-mechanism attention-visualization bert computer-vision gpt nlp transformer transformer-models visualization visualization-tools
Language:HTML 133
andrerochow / fsrt
Official implementation of the CVPR 2024 paper "FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features"
face-reenactment generative-model image-animation transformer-models
Language:Python 103
cptq / SignNet-BasisNet
SignNet and BasisNet
deep-learning graph graph-convolutional-networks graph-machine-learning graph-neural-networks graph-transformer machine-learning transformer-models
Language:Python 95
crockwell / rel_pose
[3DV 2022] The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs
3d-vision computer-vision machine-learning transformer-models vision-transformer
Language:Python 95
kyegomez / Algorithm-Of-Thoughts
My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"
artificial-intelligence gpt4 gpt4-api gpt4all prompt-engineering swarms transformer-architecture transformer-models ai-reasoning
Language:Python 95
Soham-Deshpande / Stock-TFT
Stock price prediction using a Temporal Fusion Transformer
deep-learning machine-learning stock-market stock-prediction python time-series-analysis tft temporal-fusion-transformer transformer-models
Language:TeX 91
ZhouYuxuanYX / Hyperformer
This is the official implementation of our paper "Hypergraph Transformer for Skeleton-based Action Recognition."
graph-modeling hypergraph-neural-networks skeleton-based-action-recognition transformer-models
Language:Python 90
KittenCN / predict_Lottery_ticket_pytorch
pytorch下基于transformer / LSTM模型的彩票预测
lottery-tickets lstm lstm-neural-networks machine-learning pytorch transformer-models
Language:Python 82
rayabhisek123 / CFAT
[CVPR 2024] CFAT: Unleashing Triangular Windows for Image Super-resolution
attention-mechanism attention-model deep-learning-framework image-restoration image-sr image-super-resolution light-weight-image-super-resolution low-level-vision rectangular-window restoration super-resolution transformer-models triangular-window vision-transformer
Language:Python 81
Bindwell / PLAPT
Codebase and CLI for PLAPT: A state-of-the-art protein-ligand binding affinity model for drug discovery
drug-discovery protein-ligand-binding-affinity state-of-the-art transformer-models transformers
Language:Mathematica 79

transformer-models

cmhungsteve / Awesome-Transformer-Attention

kyegomez / swarms

OpenNMT / CTranslate2

sovrasov / flops-counter.pytorch

VITA-Group / TransGAN

vturrisi / solo-learn

uncbiag / Awesome-Foundation-Models

daiquocnguyen / Graph-Transformer

ScalaConsultants / Aspect-Based-Sentiment-Analysis

imperial-qore / TranAD

cuiziteng / Illumination-Adaptive-Transformer

audeering / w2v2-how-to

philipturner / metal-flash-attention

HHousen / TransformerSum

harleyszhang / llm_note

usefulsensors / useful-transformers

RetroCirce / HTS-Audio-Transformer

ThilinaRajapakse / pytorch-transformers-classification

dpressel / mint

xashru / punctuation-restoration

AnkurDeria / MFT

RetroCirce / Zero_Shot_Audio_Source_Separation

davidnvq / grit

yizhongw / Tk-Instruct

csinva / imodelsX

GuoLanqing / ShadowFormer

catherinesyeh / attention-viz

andrerochow / fsrt

cptq / SignNet-BasisNet

crockwell / rel_pose

kyegomez / Algorithm-Of-Thoughts

Soham-Deshpande / Stock-TFT

ZhouYuxuanYX / Hyperformer

KittenCN / predict_Lottery_ticket_pytorch

rayabhisek123 / CFAT

Bindwell / PLAPT