transformer-models

There are 4 repositories under transformer-models topic.

swarms
kyegomez / swarms
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai
agents ai artificial-intelligence attention-mechanism chatgpt gpt4 gpt4all huggingface langchain langchain-python machine-learning multi-modal-imaging multi-modality multimodal prompt-engineering prompt-toolkit prompting swarms transformer-models tree-of-thoughts
Language:Python 5376
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
attention-mechanism attention-mechanisms awesome-list computer-vision deep-learning detr papers self-attention transformer transformer-architecture transformer-awesome transformer-cv transformer-models transformer-with-cv transformers vision-transformer visual-transformer vit
4959
OpenNMT / CTranslate2
Fast inference engine for Transformer models
neural-machine-translation cpp mkl quantization cuda thrust opennmt deep-neural-networks openmp onednn intrinsics avx2 avx parallel-computing gemm neon transformer-models machine-translation deep-learning inference
Language:C++ 4121
sovrasov / flops-counter.pytorch
Flops counter for neural networks in pytorch framework
deep-neural-networks deeplearning flops-counter pytorch pytorch-cnn pytorch-utils transformer transformer-models
Language:Python 2952
VITA-Group / TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
gan pytorch transformer transformer-encoder transformer-models
Language:Python 1684
vturrisi / solo-learn
solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
simclr nvidia-dali contrastive-learning pytorch pytorch-lightning barlow-twins self-supervised-learning swav byol moco simsiam vicreg nnclr dino deepcluster ressl vibcreg transformer-models mae masked-input-prediction
Language:Python 1526
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models large-language-models multimodal-models transformer-models vision-transformer
1114
harleyszhang / llm_note
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
llm llm-inference triton-kernels vllm cuda-programming kv-cache transformer-models
Language:Python 839
daiquocnguyen / Graph-Transformer
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
graph-representation-learning graph-classification graph-neural-networks node-embeddings graph-embeddings graph-transformer self-attention transformer graph-machine-learning text-classification transformer-models graph-deep-learning
Language:Python 677
imperial-qore / TranAD
[VLDB'22] Anomaly Detection using Transformers, self-conditioning and adversarial training.
anomaly-detection transformer-models multi-head-attention unsupervised-learning adversarial-learning
Language:Python 618
ScalaConsultants / Aspect-Based-Sentiment-Analysis
💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)
aspect-based-sentiment-analysis tensorflow sentiment-analysis machine-learning interpretability distill transformers transformer-models bert-embeddings deep-learning explainable-ml explainable-ai
Language:Python 574
philipturner / metal-flash-attention
FlashAttention (Metal Port)
artificial-intelligence attention-mechanism high-performance-computing metal software-engineering stable-diffusion transformer-models
Language:Swift 548
cuiziteng / Illumination-Adaptive-Transformer
🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.
bmvc exposure-correction image-enhancement image-reconstruction image-restoration low-level-vision low-light-enhance low-light-image-enhancement pytorch transformer-architecture transformer-models
Language:Python 547
audeering / w2v2-how-to
How to use our public wav2vec2 dimensional emotion model
speech-emotion-recognition deep-learning wav2vec2 transformer-models arousal dominance valence msp-podcast onnx
Language:Jupyter Notebook 526
moonshine-ai / useful-transformers
Efficient Inference of Transformer models
cpp neural-networks npu openai-whisper rockchip transformer-models
Language:C++ 467
RetroCirce / HTS-Audio-Transformer
The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"
audio-classification sound-event-detection music-information-retrieval transformer-models python
Language:Python 440
TransformerSum
HHousen / TransformerSum
Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.
albert automatic-summarization bert distilbert extractive-summarization machine-learning pytorch-lightning roberta summarization summarization-dataset text-summarization transformer-models
Language:Python 438
ThilinaRajapakse / pytorch-transformers-classification
Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.
huggingface natural-language-processing pytorch-transformers text-classification transformer-models
Language:Jupyter Notebook 312
dpressel / mint
MinT: Minimal Transformer Library and Tutorials
transformer-models transformer transformers pytorch bert gpt2 gpt bart t5 roberta sentence-transformers tutorials opt
Language:Python 259
AnkurDeria / MFT
Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.
deep-learning hsi-classification multimodal-datasets multimodal-deep-learning remote-sensing transformer-models hyperspectral-image-classification
Language:Jupyter Notebook 227
xashru / punctuation-restoration
Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
punctuation-restoration transformer-models pytorch deep-learning bangla bert punctuation-marks
Language:Python 221
RetroCirce / Zero_Shot_Audio_Source_Separation
The official code repo for "Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data", in AAAI 2022
audio-source-separation music-information-retrieval zero-shot-learning transformer-models query-based-learning python
Language:Python 209
davidnvq / grit
GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
coco-captions detr eccv2022 image-cap image-captioning nocaps object-detection region-based-method swin-transformer transformer-models
Language:Python 197
OpenMachine-ai / transformer-tricks
A collection of tricks and tools to speed up transformer models
ai llm llm-inference llmops machine-learning python arxiv arxiv-papers transformer transformer-models transformer-pytorch
Language:TeX 186
yizhongw / Tk-Instruct
Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
cross-task-generalization few-shot-learning instruction transformer-models zero-shot-learning
Language:Python 182
imodelsX
csinva / imodelsX
Interpret text data with LLMs (sklearn compatible).
ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai
Language:Python 171
GuoLanqing / ShadowFormer
ShadowFormer (AAAI2023), Pytorch implementation
image-processing image-restoration shadow-removal transformer-models
Language:Python 167
attention-viz
catherinesyeh / attention-viz
Visualizing query-key interactions in language + vision transformers (VIS 2023)
attention-mechanism attention-visualization bert computer-vision gpt nlp transformer transformer-models visualization visualization-tools
Language:HTML 156
Soham-Deshpande / Stock-TFT
Stock price prediction using a Temporal Fusion Transformer
deep-learning machine-learning stock-market stock-prediction python time-series-analysis tft temporal-fusion-transformer transformer-models
Language:TeX 117
andrerochow / fsrt
Official implementation of the CVPR 2024 paper "FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features"
face-reenactment generative-model image-animation transformer-models
Language:Python 116
KittenCN / predict_Lottery_ticket_pytorch
pytorch下基于transformer / LSTM模型的彩票预测
lottery-tickets pytorch machine-learning transformer-models lstm lstm-neural-networks
Language:Python 108
Bindwell / PLAPT
Codebase and CLI for PLAPT: A state-of-the-art protein-ligand binding affinity model for drug discovery
drug-discovery protein-ligand-binding-affinity state-of-the-art transformer-models transformers
Language:Mathematica 107
ZhouYuxuanYX / Hyperformer
This is the official implementation of our paper "Hypergraph Transformer for Skeleton-based Action Recognition."
graph-modeling hypergraph-neural-networks skeleton-based-action-recognition transformer-models
Language:Python 104
cptq / SignNet-BasisNet
SignNet and BasisNet
deep-learning graph-neural-networks machine-learning graph graph-convolutional-networks graph-machine-learning graph-transformer transformer-models
Language:Python 101
kyegomez / Algorithm-Of-Thoughts
My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"
artificial-intelligence gpt4 gpt4-api gpt4all prompt-engineering swarms transformer-architecture transformer-models ai-reasoning
Language:Python 98
crockwell / rel_pose
[3DV 2022] The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs
computer-vision machine-learning transformer-models vision-transformer 3d-vision
Language:Python 97

transformer-models

kyegomez / swarms

cmhungsteve / Awesome-Transformer-Attention

OpenNMT / CTranslate2

sovrasov / flops-counter.pytorch

VITA-Group / TransGAN

vturrisi / solo-learn

uncbiag / Awesome-Foundation-Models

harleyszhang / llm_note

daiquocnguyen / Graph-Transformer

imperial-qore / TranAD

ScalaConsultants / Aspect-Based-Sentiment-Analysis

philipturner / metal-flash-attention

cuiziteng / Illumination-Adaptive-Transformer

audeering / w2v2-how-to

moonshine-ai / useful-transformers

RetroCirce / HTS-Audio-Transformer

HHousen / TransformerSum

ThilinaRajapakse / pytorch-transformers-classification

dpressel / mint

AnkurDeria / MFT

xashru / punctuation-restoration

RetroCirce / Zero_Shot_Audio_Source_Separation

davidnvq / grit

OpenMachine-ai / transformer-tricks

yizhongw / Tk-Instruct

csinva / imodelsX

GuoLanqing / ShadowFormer

catherinesyeh / attention-viz

Soham-Deshpande / Stock-TFT

andrerochow / fsrt

KittenCN / predict_Lottery_ticket_pytorch

Bindwell / PLAPT

ZhouYuxuanYX / Hyperformer

cptq / SignNet-BasisNet

kyegomez / Algorithm-Of-Thoughts

crockwell / rel_pose