husin123 / Transformer-in-Computer-Vision

A paper list of some recent Transformer-based CV works.

Transformer-in-Vision

A paper list of some recent Transformer-based CV works. If you find some ignored papers, please open issues or pull requests.

**Last updated: 2022/08/02

Update log

2021/April - update all of recent papers of Transformer-in-Vision.
2021/May - update all of recent papers of Transformer-in-Vision.
2021/June - update all of recent papers of Transformer-in-Vision.
2021/July - update all of recent papers of Transformer-in-Vision.
2021/August - update all of recent papers of Transformer-in-Vision.
2021/September - update all of recent papers of Transformer-in-Vision.
2021/October - update all of recent papers of Transformer-in-Vision.
2021/November - update all of recent papers of Transformer-in-Vision.
2021/December - update all of recent papers of Transformer-in-Vision.
2022/January - update all of recent papers of Transformer-in-Vision.
2022/February - update all of recent papers of Transformer-in-Vision.
2022/March - update all of recent papers of Transformer-in-Vision.
2022/April - update all of recent papers of Transformer-in-Vision.
2022/May - update all of recent papers of Transformer-in-Vision.

Survey:

• (arXiv 2022.05) Multimodal Learning with Transformers: A Survey. [Paper]

• (arXiv 2022.05) Transformers in 3D Point Clouds: A Survey. [Paper]

• (arXiv 2022.03) Vision Transformers in Medical Computer Vision - A Contemplative Retrospection. [Paper]

• (arXiv 2022.03) Transformers Meet Visual Learning Understanding: A Comprehensive Review. [Paper]

• (arXiv 2022.03) Recent Advances in Vision Transformer: A Survey and Outlook of Recent Work. [Paper]

• (arXiv 2022.02) Transformers in Medical Image Analysis: A Review. [Paper]

• (arXiv 2022.01) Transformers in Medical Imaging: A Survey. [Paper], [Awesome]

• (arXiv 2022.01) A Comprehensive Study of Vision Transformers on Dense Prediction Tasks. [Paper]

• (arXiv 2022.01) Video Transformers: A Survey. [Paper]

• (arXiv 2021.11) A Survey of Visual Transformers. [Paper]

• (arXiv 2021.09) Survey: Transformer based Video-Language Pre-training. [Paper]

• (arXiv 2021.03) Multi-modal Motion Prediction with Stacked Transformers. [Paper], [Code]

• (arXiv 2021.03) Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and Vision. [Paper]

• (arXiv 2020.09) Efficient Transformers: A Survey. [Paper]

• (arXiv 2020.01) Transformers in Vision: A Survey. [Paper]

Recent Papers

Action

• (CVPR'20) Speech2Action: Cross-modal Supervision for Action Recognition, [Paper]
• (arXiv 2021.01) Trear: Transformer-based RGB-D Egocentric Action Recognition, [Paper]
• (arXiv 2021.02) Relaxed Transformer Decoders for Direct Action Proposal Generation, [Paper], [Code]
• (arXiv 2021.04) TubeR: Tube-Transformer for Action Detection, [Paper]
• (arXiv 2021.04) Few-Shot Transformation of Common Actions into Time and Space, [Paper]
• (arXiv 2021.05) Temporal Action Proposal Generation with Transformers, [Paper]
• (arXiv 2021.06) End-to-end Temporal Action Detection with Transformer, [Paper], [Code]
• (arXiv 2021.06) OadTR: Online Action Detection with Transformers, [Paper], [Code]
• (arXiv 2021.07) Action Transformer: A Self-Attention Model for Short-Time Human Action Recognition, [Paper]
• (arXiv 2021.07) VideoLightFormer: Lightweight Action Recognition using Transformers, [Paper]
• (arXiv 2021.07) Long Short-Term Transformer for Online Action Detection, [Paper]
• (arXiv 2021.07) STAR: Sparse Transformer-based Action Recognition, [Paper], [Code]
• (arXiv 2021.08) Shifted Chunk Transformer for Spatio-Temporal Representational Learning, [Paper]
• (arXiv 2021.08) GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformer, [Paper], [Code]
• (arXiv 2021.09) GCsT: Graph Convolutional Skeleton Transformer for Action Recognition, [Paper], [Code]
• (arXiv 2021.10) Lightweight Transformer in Federated Setting for Human Activity Recognition, [Paper]
• (arXiv 2021.10) ASFormer: Transformer for Action Segmentation, [Paper], [Code]
• (arXiv 2021.10) Few-Shot Temporal Action Localization with Query Adaptive Transformer, [Paper], [Code]
• (arXiv 2021.10) IIP-Transformer: Intra-Inter-Part Transformer for Skeleton-Based Action Recognition, [Paper], [Code]
• (arXiv 2021.11) Evaluating Transformers for Lightweight Action Recognition, [Paper]
• (arXiv 2021.12) MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection, [Paper]
• (arXiv 2021.12) Co-training Transformer with Videos and Images Improves Action Recognition, [Paper]
• (arXiv 2021.12) Temporal Transformer Networks with Self-Supervision for Action Recognition, [Paper]
• (arXiv 2022.01) Spatio-Temporal Tuples Transformer for Skeleton-Based Action Recognition, [Paper], [Code]
• (arXiv 2022.01) Transformers in Action:Weakly Supervised Action Segmentation, [Paper]
• (arXiv 2022.02) ActionFormer: Localizing Moments of Actions with Transformers, [Paper], [Code]
• (arXiv 2022.03) Multi-View Fusion Transformer for Sensor-Based Human Activity Recognition, [Paper]
• (arXiv 2022.03) TransDARC: Transformer-based Driver Activity Recognition with Latent Space Feature Calibration, [Paper], [Code]
• (arXiv 2022.03) Zero-Shot Action Recognition with Transformer-based Video Semantic Embedding, [Paper]
• (arXiv 2022.03) LocATe: End-to-end Localization of Actions in 3D with Transformers, [Paper]
• (arXiv 2022.03) DirecFormer: A Directed Attention in Transformer Approach to Robust Action Recognition, [Paper], [Code]
• (arXiv 2022.03) Multi-label Transformer for Action Unit Detection, [Paper]
• (arXiv 2022.04) Vision Transformer with Cross-attention by Temporal Shift for Efficient Action Recognition, [Paper]
• (arXiv 2022.04) TALLFormer: Temporal Action Localization with Long-memory Transformer, [Paper], [Code]
• (arXiv 2022.04) TransRAC: Encoding Multi-scale Temporal Correlation with Transformers for Repetitive Action Counting, [Paper], [Code]
• (arXiv 2022.04) Detector-Free Weakly Supervised Group Activity Recognition, [Paper], [Code]
• (arXiv 2022.05) Cross-modal Representation Learning for Zero-shot Action Recognition, [Paper], [Code]
• (arXiv 2022.05) Entity-aware and Motion-aware Transformers for Language-driven Action Localization in Videos, [Paper], [Code]
• (arXiv 2022.05) Cross-subject Action Unit Detection with Meta Learning and Transformer-based Relation Modeling, [Paper]
• (arXiv 2022.05) Cross-Enhancement Transformer for Action Segmentation, [Paper]
• (arXiv 2022.05) Efficient U-Transformer with Boundary-Aware Loss for Action Segmentation, [Paper]
• (arXiv 2022.05) Future Transformer for Long-term Action Anticipation, [Paper], [Code]
• (arXiv 2022.06) One-stage Action Detection Transformer, [Paper]
• (arXiv 2022.06) Spatial Transformer Network with Transfer Learning for Small-scale Fine-grained Skeleton-based Tai Chi Action Recognition, [Paper]
• (arXiv 2022.07) Hunting Group Clues with Transformers for Social Group Activity Recognition, [Paper]
• (arXiv 2022.07) Global-local Motion Transformer for Unsupervised Skeleton-based Action Learning, [Paper],[Code]
• (arXiv 2022.07) Entry-Flipped Transformer for Inference and Prediction of Participant Behavior, [Paper],[Code]
• (arXiv 2022.07) Action Quality Assessment with Temporal Parsing Transformer, [Paper]
• (arXiv 2022.07) HTNet: Anchor-free Temporal Action Localization with Hierarchical Transformers, [Paper]
• (arXiv 2022.07) An Efficient Spatio-Temporal Pyramid Transformer for Action Detection, [Paper]
• (arXiv 2022.07) Action Quality Assessment using Transformers, [Paper]
• (arXiv 2022.07) Unsupervised Domain Adaptation for Video Transformers in Action Recognition, [Paper],[Code]
• (arXiv 2022.07) Spatiotemporal Self-attention Modeling with Temporal Patch Shift for Action Recognition, [Paper],[Code]

Active Learning

• (arXiv 2022.06) Visual Transformer for Task-aware Active Learning, [Paper], [Code]

Adversarial Attacks

• (arXiv 2022.06) Exploring Adversarial Attacks and Defenses in Vision Transformers trained with DINO, [Paper], [Code]
• (arXiv 2022.06) Backdoor Attacks on Vision Transformers, [Paper], [Code]
• (arXiv 2022.06) Defending Backdoor Attacks on Vision Transformer via Patch Processing, [Paper]
• (arXiv 2022.07) Towards Efficient Adversarial Training on Vision Transformers, [Paper]
• (arXiv 2022.08) Understanding Adversarial Robustness of Vision Transformers via Cauchy Problem, [Paper], [Code]

Anomaly Detection

• (arXiv 2021.04) VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localization, [Paper]
• (arXiv 2021.04) Inpainting Transformer for Anomaly Detection, [Paper]
• (arXiv 2022.03) AnoViT: Unsupervised Anomaly Detection and Localization with Vision Transformer-based Encoder-Decoder, [Paper]
• (arXiv 2022.06) Anomaly detection in surveillance videos using transformer based attention model, [Paper], [Code]
• (arXiv 2022.06) Multi-Contextual Predictions with Vision Transformer for Video Anomaly Detection, [Paper]

Assessment

• (arXiv 2021.01) Transformer for Image Quality Assessment, [Paper], [Code]
• (arXiv 2021.04) Perceptual Image Quality Assessment with Transformers, [Paper], [Code]
• (arXiv 2021.08) No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency, [Paper], [Code]
• (arXiv 2021.08) MUSIQ: Multi-scale Image Quality Transformer, [Paper], [Code]
• (arXiv 2021.10) VTAMIQ: Transformers for Attention Modulated Image Quality Assessment, [Paper]
• (arXiv 2021.12) Learning Transformer Features for Image Quality Assessment, [Paper]
• (arXiv 2022.03) Visual Mechanisms Inspired Efficient Transformers for Image and Video Quality Assessment, [Paper]
• (arXiv 2022.04) Multi-Scale Features and Parallel Transformers Based Image Quality Assessment, [Paper], [Code]
• (arXiv 2022.05) SwinIQA: Learned Swin Distance for Compressed Image Quality Assessment, [Paper]
• (arXiv 2022.05) MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion, [Paper]

Bird's-Eye-View

• (arXiv 2022.03) BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers, [Paper], [Code]
• (arXiv 2022.05) ViT-BEVSeg: A Hierarchical Transformer Network for Monocular Birds-Eye-View Segmentation, [Paper], [Code]
• (arXiv 2022.06) PETRv2: A Unified Framework for 3D Perception from Multi-Camera Images, [Paper]
• (arXiv 2022.06) Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformer, [Paper], [Code]
• (arXiv 2022.06) PolarFormer: Multi-camera 3D Object Detection with Polar Transformer, [Paper], [Code]
• (arXiv 2022.07) CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers, [Paper]
• (arXiv 2022.07) UniFormer: Unified Multi-view Fusion Transformer for Spatial-Temporal Representation in Bird's-Eye-View, [Paper]

Captioning

• (arXiv 2021.01) CPTR: Full Transformer Network for Image Captioning, [Paper]
• (arXiv 2021.01) Dual-Level Collaborative Transformer for Image Captioning, [Paper]
• (arXiv.2021.02) VisualGPT: Data-efficient Image Captioning by Balancing Visual Input and Linguistic Knowledge from Pretraining, [Paper], [Code]
• (arXiv 2021.06) Semi-Autoregressive Transformer for Image Captioning, [Paper], [Code]
• (arXiv 2021.08) Optimizing Latency for Online Video Captioning Using Audio-Visual Transformers, [Paper]
• (arXiv 2021.08) Dual Graph Convolutional Networks with Transformer and Curriculum Learning for Image Captioning, [Paper], [Code]
• (arXiv 2021.09) Bornon: Bengali Image Captioning with Transformer-based Deep learning approach, [Paper]
• (arXiv 2021.09) Label-Attention Transformer with Geometrically Coherent Objects for Image Captioning, [Paper], [Code]
• (arXiv 2021.09) Geometry-Entangled Visual Semantic Transformer for Image Captioning, [Paper]
• (arXiv 2021.10) Geometry Attention Transformer with Position-aware LSTMs for Image Captioning, [Paper]
• (arXiv 2021.10) Bangla Image Caption Generation through CNN-Transformer based Encoder-Decoder Network, [Paper]
• (arXiv 2021.11) SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning, [Paper]
• (arXiv 2021.12) Injecting Semantic Concepts into End-to-End Image Captioning, [Paper]
• (arXiv 2022.01) Compact Bidirectional Transformer for Image Captioning, [Paper], [Code]
• (arXiv 2022.02) ACORT: A Compact Object Relation Transformer for Parameter Efficient Image Captioning, [Paper], [Code]
• (arXiv 2022.02) Deep soccer captioning with transformer: dataset, semantics-related losses, and multi-level evaluation, [Paper], [Code]
• (arXiv 2022.03) X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning, [Paper]
• (arXiv 2022.03) End-to-End Transformer Based Model for Image Captioning, [Paper]
• (arXiv 2022.03) Quantifying Societal Bias Amplification in Image Captioning, [Paper]
• (arXiv 2022.04) Image Captioning In the Transformer Age, [Paper]
• (arXiv 2022.05) Dual-Level Decoupled Transformer for Video Captioning, [Paper]
• (arXiv 2022.05) Variational Transformer: A Framework Beyond the Trade-off between Accuracy and Diversity for Image Captioning, [Paper], [Code]
• (arXiv 2022.06) Transformer-Based Multi-modal Proposal and Re-Rank for Wikipedia Image-Caption Matching, [Paper], [Code]
• (arXiv 2022.07) ExpansionNet: exploring the sequence length bottleneck in the Transformer for Image Captioning, [Paper], [Code]
• (arXiv 2022.07) GRIT: Faster and Better Image captioning Transformer Using Dual Visual Features, [Paper], [Code]
• (arXiv 2022.07) Retrieval-Augmented Transformer for Image Captioning, [Paper]

Classification (Backbone)

• (ICLR'21) MODELING LONG-RANGE INTERACTIONS WITHOUT ATTENTION, [Paper], [Code]
• (CVPR'20) Feature Pyramid Transformer, [Paper], [Code]
• (ICLR'21) An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, [Paper], [Code]
• (arXiv 2020.06) Visual Transformers: Token-based Image Representation and Processing for Computer Vision, [Paper]
• (arXiv 2020.12) Training data-efficient image transformers & distillation through attention, [Paper], [Code]
• (arXiv 2021.01) Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet, [Paper], [Code]
• (arXiv 2021.01) Bottleneck Transformers for Visual Recognition, [Paper] , [Code]
• (arXiv.2021.02) Conditional Positional Encodings for Vision Transformers, [Paper], [Code]
• (arXiv.2021.02) Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions, [Paper], [Code]
• (arXiv 2021.03) Transformer in Transformer, [Paper], [Code]
• (arXiv 2021.03) ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases, [Paper], [Code]
• (arXiv 2021.03) Scalable Visual Transformers with Hierarchical Pooling, [Paper]
• (arXiv 2021.03) Incorporating Convolution Designs into Visual Transformers, [Paper]
• (arXiv 2021.03) DeepViT: Towards Deeper Vision Transformer, [Paper], [Code]
• (arXiv 2021.03) Swin Transformer: Hierarchical Vision Transformer using Shifted Windows, [Paper], [Code]
• (arXiv 2021.03) Understanding Robustness of Transformers for Image Classification, [Paper]
• (arXiv 2021.03) Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding, [Paper]
• (arXiv 2021.03) CvT: Introducing Convolutions to Vision Transformers, [Paper], [Code]
• (arXiv 2021.03) Rethinking Spatial Dimensions of Vision Transformers, [Paper], [Code]
• (arXiv 2021.03) Going deeper with Image Transformers, [Paper]
• (arXiv 2021.04) LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference, [Paper]
• (arXiv 2021.04) On the Robustness of Vision Transformers to Adversarial Examples, [Paper]
• (arXiv 2021.04) LocalViT: Bringing Locality to Vision Transformers, [Paper], [Code]
• (arXiv 2021.04) Escaping the Big Data Paradigm with Compact Transformers, [Paper], [Code]
• (arXiv 2021.04) Co-Scale Conv-Attentional Image Transformers, [Paper], [Code]
• (arXiv 2021.04) Token Labeling: Training a 85.5% Top-1 Accuracy Vision Transformer with 56M Parameters on ImageNet, [Paper], [Code]
• (arXiv 2021.04) So-ViT: Mind Visual Tokens for Vision Transformer, [Paper]
• (arXiv 2021.04) Multiscale Vision Transformers, [Paper], [Code]
• (arXiv 2021.04) Visformer: The Vision-friendly Transformer, [Paper], [Code]
• (arXiv 2021.04) Improve Vision Transformers Training by Suppressing Over-smoothing, [Paper], [Code]
• (arXiv 2021.04) Twins: Revisiting the Design of Spatial Attention in Vision Transformers, [Paper], [Code]
• (arXiv 2021.04) ConTNet: Why not use convolution and transformer at the same time, [Paper], [Code]
• (arXiv 2021.05) Rethinking the Design Principles of Robust Vision Transformer, [Paper], [Code]
• (arXiv 2021.05) Vision Transformers are Robust Learners, [Paper], [Code]
• (arXiv 2021.05) Rethinking Skip Connection with Layer Normalization in Transformers and ResNets, [Paper], [Code]
• (arXiv 2021.05) Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead, [Paper]
• (arXiv 2021.05) Intriguing Properties of Vision Transformers, [Paper], [Code]
• (arXiv 2021.05) Aggregating Nested Transformers, [Paper]
• (arXiv 2021.05) ResT: An Efficient Transformer for Visual Recognition, [Paper], [Code]
• (arXiv 2021.06) DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification, [Paper], [Code]
• (arXiv 2021.06) When Vision Transformers Outperform ResNets without Pretraining or Strong Data Augmentations, [Paper]
• (arXiv 2021.06) Container: Context Aggregation Network, [Paper]
• (arXiv 2021.06) TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classication, [Paper]
• (arXiv 2021.06) KVT: k-NN Attention for Boosting Vision Transformers, [Paper]
• (arXiv 2021.06) MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens, [Paper], [Code]
• (arXiv 2021.06) Not All Images are Worth 16x16 Words: Dynamic Vision Transformers with Adaptive Sequence Length, [Paper]
• (arXiv 2021.06) Less is More: Pay Less Attention in Vision Transformers, [Paper]
• (arXiv 2021.06) FoveaTer: Foveated Transformer for Image Classification, [Paper]
• (arXiv 2021.06) An Attention Free Transformer, [Paper]
• (arXiv 2021.06) Glance-and-Gaze Vision Transformer, [Paper], [Code]
• (arXiv 2021.06) RegionViT: Regional-to-Local Attention for Vision Transformers, [Paper]
• (arXiv 2021.06) Chasing Sparsity in Vision Transformers: An End-to-End Exploration, [Paper], [Code]
• (arXiv 2021.06) Scaling Vision Transformers, [Paper]
• (arXiv 2021.06) CAT: Cross Attention in Vision Transformer, [Paper], [Code]
• (arXiv 2021.06) On Improving Adversarial Transferability of Vision Transformers, [Paper], [Code]
• (arXiv 2021.06) Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight, [Paper]
• (arXiv 2021.06) Patch Slimming for Efficient Vision Transformers, [Paper]
• (arXiv 2021.06) Transformer in Convolutional Neural Networks, [Paper], [Code]
• (arXiv 2021.06) ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias, [Paper], [Code]
• (arXiv 2021.06) Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer, [Paper]
• (arXiv 2021.06) Refiner: Refining Self-attention for Vision Transformers, [Paper]
• (arXiv 2021.06) Reveal of Vision Transformers Robustness against Adversarial Attacks, [Paper]
• (arXiv 2021.06) Efficient Training of Visual Transformers with Small-Size Datasets, [Paper]
• (arXiv 2021.06) Delving Deep into the Generalization of Vision Transformers under Distribution Shifts, [Paper]
• (arXiv 2021.06) BEIT: BERT Pre-Training of Image Transformers, [Paper], [Code]
• (arXiv 2021.06) XCiT: Cross-Covariance Image Transformers, [Paper], [Code]
• (arXiv 2021.06) How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers, [Paper], [Code1], [Code2]
• (arXiv 2021.06) Exploring Vision Transformers for Fine-grained Classification, [Paper], [Code]
• (arXiv 2021.06) TokenLearner: What Can 8 Learned Tokens Do for Images and Videos, [Paper]
• (arXiv 2021.06) Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixers, [Paper], [Code]
• (arXiv 2021.06) VOLO: Vision Outlooker for Visual Recognition, [Paper], [Code]
• (arXiv 2021.06) IA-RED2: Interpretability-Aware Redundancy Reduction for Vision Transformers, [Paper], [Project]
• (arXiv 2021.06) PVTv2: Improved Baselines with Pyramid Vision Transformer, [Paper], [Code]
• (arXiv 2021.06) Early Convolutions Help Transformers See Better, [Paper]
• (arXiv 2021.06) Multi-Exit Vision Transformer for Dynamic Inference, [Paper]
• (arXiv 2021.07) Augmented Shortcuts for Vision Transformers, [Paper]
• (arXiv 2021.07) Improving the Efficiency of Transformers for Resource-Constrained Devices, [Paper]
• (arXiv 2021.07) CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows, [Paper], [Code]
• (arXiv 2021.07) Focal Self-attention for Local-Global Interactions in Vision Transformers, [Paper]
• (arXiv 2021.07) Cross-view Geo-localization with Evolving Transformer, [Paper]
• (arXiv 2021.07) What Makes for Hierarchical Vision Transformer, [Paper]
• (arXiv 2021.07) Efficient Vision Transformers via Fine-Grained Manifold Distillation, [Paper]
• (arXiv 2021.07) Vision Xformers: Efficient Attention for Image Classification, [Paper]
• (arXiv 2021.07) Long-Short Transformer: Efficient Transformers for Language and Vision, [Paper]
• (arXiv 2021.07) Feature Fusion Vision Transformer for Fine-Grained Visual Categorization, [Paper]
• (arXiv 2021.07) Local-to-Global Self-Attention in Vision Transformers, [Paper], [Code]
• (arXiv 2021.07) Visual Parser: Representing Part-whole Hierarchies with Transformers, [Paper], [Code]
• (arXiv 2021.07) CMT: Convolutional Neural Networks Meet Vision Transformers, [Paper]
• (arXiv 2021.07) Combiner: Full Attention Transformer with Sparse Computation Cost, [Paper]
• (arXiv 2021.07) A Comparison of Deep Learning Classification Methods on Small-scale Image Data set: from Convolutional Neural Networks to Visual Transformers, [Paper]
• (arXiv 2021.07) Contextual Transformer Networks for Visual Recognition, [Paper], [Code]
• (arXiv 2021.07) Rethinking and Improving Relative Position Encoding for Vision Transformer, [Paper], [Code]
• (arXiv 2021.08) CrossFormer: A Versatile Vision Transformer Based on Cross-scale Attention, [Paper], [Code]
• (arXiv 2021.08) Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer, [Paper]
• (arXiv 2021.08) Vision Transformer with Progressive Sampling, [Paper], [Code]
• (arXiv 2021.08) Armour: Generalizable Compact Self-Attention for Vision Transformers, [Paper]
• (arXiv 2021.08) ConvNets vs. Transformers: Whose Visual Representations are More Transferable, [Paper]
• (arXiv 2021.08) Mobile-Former: Bridging MobileNet and Transformer, [Paper]
• (arXiv 2021.08) Do Vision Transformers See Like Convolutional Neural Networks, [Paper]
• (arXiv 2021.08) Exploring and Improving Mobile Level Vision Transformers, [Paper]
• (arXiv 2021.08) A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP, [Paper]
• (arXiv 2021.08) Scaled ReLU Matters for Training Vision Transformers, [Paper]
• (arXiv 2021.09) Towards Transferable Adversarial Attacks on Vision Transformers, [Paper]
• (arXiv 2021.09) DS-Net++: Dynamic Weight Slicing for Efficient Inference in CNNs and Transformers, [Paper], [Code]
• (arXiv 2021.09) Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers, [Paper]
• (arXiv 2021.09) Fine-tuning Vision Transformers for the Prediction of State Variables in Ising Models, [Paper]
• (arXiv 2021.09) UFO-ViT: High Performance Linear Vision Transformer without Softmax, [Paper]
• (arXiv 2021.10) MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer, [Paper]
• (arXiv 2021.10) Adversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNs, [Paper], [Code]
• (arXiv 2021.10) Token Pooling in Visual Transformers, [Paper]
• (arXiv 2021.10) NViT: Vision Transformer Compression and Parameter Redistribution, [Paper]
• (arXiv 2021.10) Adversarial Token Attacks on Vision Transformers, [Paper]
• (arXiv 2021.10) Certified Patch Robustness via Smoothed Vision Transformers, [Paper], [Code]
• (arXiv 2021.10) Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation, [Paper]
• (arXiv 2021.10) SOFT: Softmax-free Transformer with Linear Complexity, [Paper], [Code]
• (arXiv 2021.10) Blending Anti-Aliasing into Vision Transformer, [Paper], [Code]
• (arXiv 2021.11) Can Vision Transformers Perform Convolution, [Paper]
• (arXiv 2021.11) Sliced Recursive Transformer, [Paper], [Code]
• (arXiv 2021.11) Hybrid BYOL-ViT: Efficient approach to deal with small Datasets, [Paper]
• (arXiv 2021.11) Are Transformers More Robust Than CNNs, [Paper], [Code]
• (arXiv 2021.11) iBOT: Image BERT Pre-Training with Online Tokenizer, [Paper]
• (arXiv 2021.11) Improved Robustness of Vision Transformer via PreLayerNorm in Patch Embedding, [Paper]
• (arXiv 2021.11) TransMix: Attend to Mix for Vision Transformers, [Paper], [Code]
• (arXiv 2021.11) Swin Transformer V2: Scaling Up Capacity and Resolution, [Paper], [Code]
• (arXiv 2021.11) Are Vision Transformers Robust to Patch Perturbations, [Paper]
• (arXiv 2021.11) Discrete Representations Strengthen Vision Transformer Robustness, [Paper]
• (arXiv 2021.11) Zero-Shot Certified Defense against Adversarial Patches with Vision Transformers, [Paper]
• (arXiv 2021.11) MetaFormer is Actually What You Need for Vision, [Paper], [Code]
• (arXiv 2021.11) DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion, [Paper], [Code]
• (arXiv 2021.11) Mesa: A Memory-saving Training Framework for Transformers, [Paper], [Code]
• (arXiv 2021.11) Semi-Supervised Vision Transformers, [Paper]
• (arXiv 2021.11) DBIA: Data-free Backdoor Injection Attack against Transformer Networks, [Paper], [Code]
• (arXiv 2021.11) Self-slimmed Vision Transformer, [Paper]
• (arXiv 2021.11) PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers, [Paper], [Code]
• (arXiv 2021.11) SWAT: Spatial Structure Within and Among Tokens, [Paper]
• (arXiv 2021.11) NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition, [Paper], [Code]
• (arXiv 2021.11) Global Interaction Modelling in Vision Transformer via Super Tokens, [Paper]
• (arXiv 2021.11) ATS: Adaptive Token Sampling For Efficient Vision Transformers, [Paper]
• (arXiv 2021.11) Pyramid Adversarial Training Improves ViT Performance, [Paper]
• (arXiv 2021.12) Improved Multiscale Vision Transformers for Classification and Detection, [Paper]
• (arXiv 2021.12) Make A Long Image Short: Adaptive Token Length for Vision Transformers, [Paper]
• (arXiv 2021.12) Dynamic Token Normalization Improves Vision Transformer, [Paper], [Code]
• (arXiv 2021.12) Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training, [Paper]
• (arXiv 2021.12) Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removal, [Paper], [Code]
• (arXiv 2021.12) Visual Transformers with Primal Object Queries for Multi-Label Image Classification, [Paper]
• (arXiv 2021.12) Couplformer:Rethinking Vision Transformer with Coupling Attention Map, [Paper]
• (arXiv 2021.12) AdaViT: Adaptive Tokens for Efficient Vision Transformer, [Paper]
• (arXiv 2021.12) Lite Vision Transformer with Enhanced Self-Attention, [Paper], [Code]
• (arXiv 2021.12) Learned Queries for Efficient Local Attention, [Paper], [Code]
• (arXiv 2021.12) MPViT: Multi-Path Vision Transformer for Dense Prediction, [Paper], [Code]
• (arXiv 2021.12) MIA-Former: Efficient and Robust Vision Transformers via Multi-grained Input-Adaptation, [Paper]
• (arXiv 2021.12) ELSA: Enhanced Local Self-Attention for Vision Transformer, [Paper], [Code]
• (arXiv 2021.12) SimViT: Exploring a Simple Vision Transformer with sliding windows, [Paper], [Code]
• (arXiv 2021.12) Vision Transformer for Small-Size Datasets, [Paper]
• (arXiv 2021.12) ViR: the Vision Reservoir, [Paper]
• (arXiv 2021.12) Augmenting Convolutional networks with attention-based aggregation, [Paper]
• (arXiv 2021.12) Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention, [Paper], [Code]
• (arXiv 2021.12) SPViT: Enabling Faster Vision Transformers via Soft Token Pruning, [Paper]
• (arXiv 2021.12) Stochastic Layers in Vision Transformers, [Paper]
• (arXiv 2022.01) Vision Transformer with Deformable Attention, [Paper], [Code]
• (arXiv 2022.01) PyramidTNT: Improved Transformer-in-Transformer Baselines with Pyramid Architecture, [Paper], [Code]
• (arXiv 2022.01) QuadTree Attention for Vision Transformers, [Paper], [Code]
• (arXiv 2022.01) TerViT: An Efficient Ternary Vision Transformer, [Paper]
• (arXiv 2022.01) UniFormer: Unifying Convolution and Self-attention for Visual Recognition, [Paper], [Code]
• (arXiv 2022.01) Patches Are All You Need?, [Paper], [Code]
• (arXiv 2022.01) Convolutional Xformers for Vision, [Paper], [Code]
• (arXiv 2022.01) When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism, [Paper], [Code]
• (arXiv 2022.01) Training Vision Transformers with Only 2040 Images, [Paper]
• (arXiv 2022.01) O-ViT: Orthogonal Vision Transformer, [Paper]
• (arXiv 2022.01) Aggregating Global Features into Local Vision Transformer, [Paper],[Code]
• (arXiv 2022.01) BOAT: Bilateral Local Attention Vision Transformer, [Paper]
• (arXiv 2022.02) BViT: Broad Attention based Vision Transformer, [Paper],[Code]
• (arXiv 2022.02) How Do Vision Transformers Work, [Paper],[Code]
• (arXiv 2022.02) Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations, [Paper],[Code]
• (arXiv 2022.02) ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond, [Paper]
• (arXiv 2022.02) Learning to Merge Tokens in Vision Transformers, [Paper]
• (arXiv 2022.02) Auto-scaling Vision Transformers without Training, [Paper],[Code]
• (arXiv 2022.03) Aggregated Pyramid Vision Transformer: Split-transform-merge Strategy for Image Recognition without Convolutions, [Paper]
• (arXiv 2022.03) D^2ETR: Decoder-Only DETR with Computationally Efficient Cross-Scale Attention, [Paper]
• (arXiv 2022.03) BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning, [Paper]
• (arXiv 2022.03) Multi-Tailed Vision Transformer for Efficient Inference, [Paper]
• (arXiv 2022.03) ViT-P: Rethinking Data-efficient Vision Transformers from Locality, [Paper]
• (arXiv 2022.03) Coarse-to-Fine Vision Transformer, [Paper],[Code]
• (arXiv 2022.03) Dynamic Group Transformer: A General Vision Transformer Backbone with Dynamic Group Attention, [Paper]
• (arXiv 2022.03) EdgeFormer: Improving Light-weight ConvNets by Learning from Vision Transformers, [Paper]
• (arXiv 2022.03) WaveMix: Resource-efficient Token Mixing for Images, [Paper], [Code]
• (arXiv 2022.03) Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice, [Paper], [Code]
• (arXiv 2022.03) Visualizing and Understanding Patch Interactions in Vision Transformer, [Paper]
• (arXiv 2022.03) EIT: Efficiently Lead Inductive Biases to ViT, [Paper], [Code]
• (arXiv 2022.03) The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy, [Paper], [Code]
• (arXiv 2022.03) Towards Practical Certifiable Patch Defense with Vision Transformer, [Paper]
• (arXiv 2022.03) Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations, [Paper], [Code]
• (arXiv 2022.03) Are Vision Transformers Robust to Spurious Correlations, [Paper], [Code]
• (arXiv 2022.03) Three things everyone should know about Vision Transformers, [Paper]
• (arXiv 2022.03) ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer, [Paper]
• (arXiv 2022.03) GradViT: Gradient Inversion of Vision Transformers, [Paper], [Code]
• (arXiv 2022.03) Learning Patch-to-Cluster Attention in Vision Transformer, [Paper]
• (arXiv 2022.03) Towards Exemplar-Free Continual Learning in Vision Transformers: an Account of Attention, Functional and Weight Regularization, [Paper]
• (arXiv 2022.03) Beyond Fixation: Dynamic Window Visual Transformer, [Paper], [Code]
• (arXiv 2022.03) Give Me Your Attention: Dot-Product Attention Considered Harmful for Adversarial Patch Robustness, [Paper]
• (arXiv 2022.03) Automated Progressive Learning for Efficient Training of Vision Transformers, [Paper], [Code]
• (arXiv 2022.03) Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers, [Paper], [Code]
• (arXiv 2022.03) CaCo: Both Positive and Negative Samples are Directly Learnable via Cooperative-adversarial Contrastive Learning, [Paper], [Code]
• (arXiv 2022.03) SepViT: Separable Vision Transformer, [Paper]
• (arXiv 2022.03) Fine-tuning Image Transformers using Learnable Memory, [Paper]
• (arXiv 2022.03) Parameter-efficient Fine-tuning for Vision Transformers, [Paper]
• (arXiv 2022.03) MaxViT: Multi-Axis Vision Transformer, [Paper]
• (arXiv 2022.04) BatchFormerV2: Exploring Sample Relationships for Dense Representation Learning, [Paper]
• (arXiv 2022.04) Improving Vision Transformers by Revisiting High-frequency Components, [Paper]
• (arXiv 2022.04) MixFormer: Mixing Features across Windows and Dimensions, [Paper], [Code]
• (arXiv 2022.04) DaViT: Dual Attention Vision Transformers, [Paper], [Code]
• (arXiv 2022.04) Evaluating Vision Transformer Methods for Deep Reinforcement Learning from Pixels, [Paper]
• (arXiv 2022.04) MiniViT: Compressing Vision Transformers with Weight Multiplexing, [Paper]
• (arXiv 2022.04) DeiT III: Revenge of the ViT, [Paper]
• (arXiv 2022.04) Neighborhood Attention Transformer, [Paper], [Code]
• (arXiv 2022.04) ResT V2: Simpler, Faster and Stronger, [Paper], [Code]
• (arXiv 2022.04) VSA: Learning Varied-Size Window Attention in Vision Transformers, [Paper], [Code]
• (arXiv 2022.04) OCFormer: One-Class Transformer Network for Image Classification, [Paper]
• (arXiv 2022.04) Adaptive Split-Fusion Transformer, [Paper], [Code]
• (arXiv 2022.04) Understanding The Robustness in Vision Transformers, [Paper], [Code]
• (arXiv 2022.05) Better plain ViT baselines for ImageNet-1k, [Paper], [Code]
• (arXiv 2022.05) EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformers, [Paper], [Code]
• (arXiv 2022.05) ConvMAE: Masked Convolution Meets Masked Autoencoders, [Paper], [Code]
• (arXiv 2022.05) Unraveling Attention via Convex Duality: Analysis and Interpretations of Vision Transformers, [Paper]
• (arXiv 2022.05) TRT-ViT: TensorRT-oriented Vision Transformer, [Paper]
• (arXiv 2022.05) Super Vision Transformer, [Paper], [Code]
• (arXiv 2022.05) Deeper vs Wider: A Revisit of Transformer Configuration, [Paper]
• (arXiv 2022.05) Vision Transformers in 2022: An Update on Tiny ImageNet, [Paper], [Code]
• (arXiv 2022.05) Privacy-Preserving Image Classification Using Vision Transformer, [Paper]
• (arXiv 2022.05) Inception Transformer, [Paper], [Code]
• (arXiv 2022.05) MoCoViT: Mobile Convolutional Vision Transformer, [Paper], [Code]
• (arXiv 2022.05) Breaking the Chain of Gradient Leakage in Vision Transformers, [Paper], [Code]
• (arXiv 2022.05) Hierarchical Vision Transformer for Masked Image Modeling, [Paper], [Code]
• (arXiv 2022.05) Fast Vision Transformers with HiLo Attention, [Paper], [Code]
• (arXiv 2022.05) AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition, [Paper], [Code]
• (arXiv 2022.05) X-ViT: High Performance Linear Vision Transformer without Softmax, [Paper]
• (arXiv 2022.05) Architecture-Agnostic Masked Image Modeling – From ViT back to CNN, [Paper], [Code]
• (arXiv 2022.05) HiViT: Hierarchical Vision Transformer Meets Masked Image Modeling, [Paper]
• (arXiv 2022.05) EfficientViT: Enhanced Linear Attention for High-Resolution Low-Computation Visual Recognition, [Paper], [Code]
• (arXiv 2022.06) EfficientFormer: Vision Transformers at MobileNet Speed, [Paper], [Code]
• (arXiv 2022.06) Optimizing Relevance Maps of Vision Transformers Improves Robustness, [Paper], [Code]
• (arXiv 2022.06) Separable Self-attention for Mobile Vision Transformers, [Paper], [Code]
• (arXiv 2022.06) Spatial Entropy Regularization for Vision Transformers, [Paper]
• (arXiv 2022.06) Peripheral Vision Transformer, [Paper], [Code]
• (arXiv 2022.06) SP-ViT: Learning 2D Spatial Priors for Vision Transformers, [Paper]
• (arXiv 2022.06) FIT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image Classification, [Paper], [Code]
• (arXiv 2022.06) SimA: Simple Softmax-free Attention for Vision Transformers, [Paper], [Code]
• (arXiv 2022.06) Vicinity Vision Transformer, [Paper], [Code]
• (arXiv 2022.06) EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications, [Paper], [Code]
• (arXiv 2022.06) Global Context Vision Transformers, [Paper], [Code]
• (arXiv 2022.06) EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm, [Paper], [Code]
• (arXiv 2022.06) A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers, [Paper]
• (arXiv 2022.06) Robustifying Vision Transformer without Retraining from Scratch by Test-Time Class-Conditional Feature Alignment, [Paper], [Code]
• (arXiv 2022.06) Continual Learning with Transformers for Image Classification, [Paper]
• (arXiv 2022.07) Visual Transformer Meets CutMix for Improved Accuracy, Communication Efficiency, and Data Privacy in Split Learning, [Paper]
• (arXiv 2022.07) Rethinking Query-Key Pairwise Interactions in Vision Transformers, [Paper]
• (arXiv 2022.07) Dynamic Spatial Sparsification for Efficient Vision Transformers and Convolutional Neural Networks, [Paper], [Code]
• (arXiv 2022.07) Softmax-free Linear Transformers, [Paper], [Code]
• (arXiv 2022.07) MaiT: Leverage Attention Masks for More Efficient Image Transformers, [Paper]
• (arXiv 2022.07) Dual Vision Transformer, [Paper], [Code]
• (arXiv 2022.07) Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learning, [Paper], [Code]
• (arXiv 2022.07) Horizontal and Vertical Attention in Transformers, [Paper]
• (arXiv 2022.07) LightViT: Towards Light-Weight Convolution-Free Vision Transformers, [Paper], [Code]
• (arXiv 2022.07) Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios, [Paper]
• (arXiv 2022.07) Image and Model Transformation with Secret Key for Vision Transformer, [Paper]
• (arXiv 2022.07) Convolutional Bypasses Are Better Vision Transformer Adapters, [Paper]
• (arXiv 2022.07) Lightweight Vision Transformer with Cross Feature Attention, [Paper]
• (arXiv 2022.07) Multi-manifold Attention for Vision Transformers, [Paper]
• (arXiv 2022.07) TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers, [Paper], [Code]
• (arXiv 2022.07) Locality Guidance for Improving Vision Transformers on Tiny Datasets, [Paper], [Code]
• (arXiv 2022.07) TinyViT: Fast Pretraining Distillation for Small Vision Transformers, [Paper], [Code]
• (arXiv 2022.07) Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformer, [Paper], [Code]
• (arXiv 2022.07) An Impartial Take to the CNN vs Transformer Robustness Contest, [Paper]
• (arXiv 2022.07) Pro-tuning: Unified Prompt Tuning for Vision Tasks, [Paper]

Clustering

• (arXiv 2022.06) Vision Transformer for Contrastive Clustering, [Paper]

Completion

• (arXiv 2021.03) High-Fidelity Pluralistic Image Completion with Transformers, [Paper], [Code]
• (arXiv 2021.04) TFill: Image Completion via a Transformer-Based Architecture, [Paper], [Code]

Compression

• (arXiv 2021.10) Accelerating Framework of Transformer by hardware Design and Model Compression Co-Optimization, [Paper]
• (arXiv 2021.11) Transformer-based Image Compression, [Paper]
• (arXiv 2021.12) Towards End-to-End Image Compression and Analysis with Transformers, [Paper], [Code]
• (arXiv 2021.12) CSformer: Bridging Convolution and Transformer for Compressive Sensing, [Paper]
• (arXiv 2022.01) Multi-Dimensional Model Compression of Vision Transformer, [Paper]
• (arXiv 2022.02) Entroformer: A Transformer-based Entropy Model for Learned Image Compression, [Paper], [Code]
• (arXiv 2022.03) Unified Visual Transformer Compression, [Paper], [Code]
• (arXiv 2022.03) Transformer Compressed Sensing via Global Image Tokens, [Paper], [supplementary]
• (arXiv 2022.03) Vision Transformer Compression with Structured Pruning and Low Rank Approximation, [Paper]
• (arXiv 2022.04) Searching Intrinsic Dimensions of Vision Transformers, [Paper]
• (arXiv 2022.04) Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging, [Paper]
• (arXiv 2022.06) VCT: A Video Compression Transformer, [Paper], [Code]
• (arXiv 2022.07) TransCL: Transformer Makes Strong and Flexible Compressive Learning, [Paper], [Code]
• (arXiv 2022.08) Meta-DETR: Image-Level Few-Shot Detection with Inter-Class Correlation Exploitation, [Paper], [Code]

Cross-view

• (arXiv 2022.03) Mutual Generative Transformer Learning for Cross-view Geo-localization, [Paper]
• (arXiv 2022.04) TransGeo: Transformer Is All You Need for Cross-view Image Geo-localization, [Paper], [Code]

Crowd

• (arXiv 2021.04) TransCrowd: Weakly-Supervised Crowd Counting with Transformer, [Paper], [Code]
• (arXiv 2021.05) Boosting Crowd Counting with Transformers, [Paper], [Code]
• (arXiv 2021.08) Congested Crowd Instance Localization with Dilated Convolutional Swin Transformer, [Paper]
• (arXiv 2021.09) Audio-Visual Transformer Based Crowd Counting, [Paper], [Code]
• (arXiv 2021.09) CCTrans: Simplifying and Improving Crowd Counting with Transformer, [Paper]
• (arXiv 2022.01) Scene-Adaptive Attention Network for Crowd Counting, [Paper]
• (arXiv 2022.03) An End-to-End Transformer Model for Crowd Localization, [Paper]
• (arXiv 2022.03) Joint CNN and Transformer Network via weakly supervised Learning for efficient crowd counting, [Paper]
• (arXiv 2022.06) Counting Varying Density Crowds Through Density Guided Adaptive Selection CNN and Transformer Estimation, [Paper]

Deblurring

• (arXiv 2022.01) Flow-Guided Sparse Transformer for Video Deblurring,[Paper]
• (arXiv 2022.04) Stripformer: Strip Transformer for Fast Image Deblurring, [Paper]
• (arXiv 2022.04) VDTR: Video Deblurring with Transformer, [Paper], [Code]

Depth

• (arXiv 2020.11) Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers, [Paper], [Code]
• (arXiv 2021.03) Vision Transformers for Dense Prediction, [Paper], [Code]
• (arXiv 2021.03) Transformers Solve the Limited Receptive Field for Monocular Depth Prediction, [Paper], [Code]
• (arXiv 2021.09) Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-supervised Learning, [Paper]
• (arXiv 2022.02) GLPanoDepth: Global-to-Local Panoramic Depth Estimation, [Paper]
• (arXiv 2022.02) Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsics, [Paper]
• (arXiv 2022.03) OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion, [Paper]
• (arXiv 2022.03) PanoFormer: Panorama Transformer for Indoor 360° Depth Estimation, [Paper]
• (arXiv 2022.03) DepthGAN: GAN-based Depth Generation of Indoor Scenes from Semantic Layouts, [Paper]
• (arXiv 2022.03) DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimation, [Paper], [Code]
• (arXiv 2022.04) BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimation, [Paper], [Code]
• (arXiv 2022.04) SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation, [Paper], [Project]
• (arXiv 2022.04) Multi-Frame Self-Supervised Depth with Transformers, [Paper], [Project]
• (arXiv 2022.05) SideRT: A Real-time Pure Transformer Architecture for Single Image Depth Estimation, [Paper]
• (arXiv 2022.05) Depth Estimation with Simplified Transformer, [Paper]
• (arXiv 2022.05) MonoFormer: Towards Generalization of self-supervised monocular depth estimation with Transformers, [Paper]
• (arXiv 2022.06) SparseFormer: Attention-based Depth Completion Network, [Paper]
• (arXiv 2022.06) Forecasting of depth and ego-motion with transformers and self-supervision, [Paper]
• (arXiv 2022.07) Depthformer : Multiscale Vision Transformer For Monocular Depth Estimation With Local Global Information Fusion, [Paper], [Code]

Deepfake Detection

• (arXiv.2021.02) Deepfake Video Detection Using Convolutional Vision Transformer, [Paper]
• (arXiv 2021.04) Deepfake Detection Scheme Based on Vision Transformer and Distillation, [Paper]
• (arXiv 2021.04) M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection, [Paper]
• (arXiv 2021.07) Combining EfficientNet and Vision Transformers for Video Deepfake Detection, [Paper]
• (arXiv 2021.08) Video Transformer for Deepfake Detection with Incremental Learning, [Paper]
• (arXiv 2022.03) Self-supervised Transformer for Deepfake Detection, [Paper], [Code]
• (arXiv 2022.06) Cross-Forgery Analysis of Vision Transformers and CNNs for Deepfake Image Detection, [Paper]
• (arXiv 2022.07) Deepfake Video Detection with Spatiotemporal Dropout Transformer, [Paper]

Dehazing

• (arXiv 2021.09) Hybrid Local-Global Transformer for Image Dehazing, [Paper]
• (arXiv 2022.04) Vision Transformers for Single Image Dehazing, [Paper]

Denoising

• (arXiv 2021.12) Neuromorphic Camera Denoising using Graph Neural Network-driven Transformers, [Paper]
• (arXiv 2022.03) Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsics, [Paper], [Code]
• (arXiv 2022.03) Practical Blind Denoising via Swin-Conv-UNet and Data Synthesis, [Paper], [Code]
• (arXiv 2022.05) Coarse-to-Fine Video Denoising with Dual-Stage Spatial-Channel Transformer, [Paper]
• (arXiv 2022.05) Dense residual Transformer for image denoising, [Paper]
• (arXiv 2022.07) DnSwin: Toward Real-World Denoising via Continuous Wavelet Sliding-Transformer, [Paper]

Detection

• (ECCV'20) DETR: End-to-End Object Detection with Transformers, [Paper], [Code]
• (ICLR'21) Deformable DETR: Deformable Transformers for End-to-End Object Detection, [Paper], [Code]
• (CVPR'21) UP-DETR: Unsupervised Pre-training for Object Detection with Transformers, [Paper], [Code]
• (arXiv 2020.11) End-to-End Object Detection with Adaptive Clustering Transformer, [Paper]
• (arXiv 2020.11) Rethinking Transformer-based Set Prediction for Object Detection, [Paper]
• (arXiv 2020.12) Toward Transformer-Based Object Detection, [Paper]
• (arXiv 2020.12) DETR for Pedestrian Detection, [Paper]
• (arXiv 2021.01) Line Segment Detection Using Transformers without Edges, [Paper]
• (arXiv 2021.01) Fast Convergence of DETR with Spatially Modulated Co-Attention, [Paper]
• (arXiv 2021.02) GEM: Glare or Gloom, I Can Still See You – End-to-End Multimodal Object Detector, [Paper]
• (arXiv 2021.03) SSTN: Self-Supervised Domain Adaptation Thermal Object Detection for Autonomous Driving, [Paper]
• (arXiv 2021.03) Meta-DETR: Few-Shot Object Detection via Unified Image-Level Meta-Learning, [Paper]
• (arXiv 2021.03) TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization, [Paper]
• (arXiv 2021.03) CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification, [Paper]
• (arXiv 2021.03) DA-DETR: Domain Adaptive Detection Transformer by Hybrid Attention, [Paper]
• (arXiv 2021.04) Efficient DETR: Improving End-to-End Object Detector with Dense Prior, [Paper]
• (arXiv 2021.04) Points as Queries: Weakly Semi-supervised Object Detection by Points, [Paper]
• (arXiv 2021.04) CAT: Cross-Attention Transformer for One-Shot Object Detection, [Paper]
• (arXiv 2021.05) Content-Augmented Feature Pyramid Network with Light Linear Transformers, [Paper]
• (arXiv 2021.06) You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection, [Paper]
• (arXiv 2021.06) DETReg: Unsupervised Pretraining with Region Priors for Object Detection, [Paper],[Project]
• (arXiv 2021.06) Oriented Object Detection with Transformer, [Paper]
• (arXiv 2021.06) MODETR: Moving Object Detection with Transformers, [Paper]
• (arXiv 2021.07) ST-DETR: Spatio-Temporal Object Traces Attention Detection Transformer, [Paper]
• (arXiv 2021.07) OODformer: Out-Of-Distribution Detection Transformer, [Paper]
• (arXiv 2021.07) Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers, [Paper],[Code]
• (arXiv 2021.08) Fast Convergence of DETR with Spatially Modulated Co-Attention, [Paper],[Code]
• (arXiv 2021.08) PSViT: Better Vision Transformer via Token Pooling and Attention Sharing, [Paper]
• (arXiv 2021.08) Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation), [Paper],[Code]
• (arXiv 2021.08) Conditional DETR for Fast Training Convergence, [Paper],[Code]
• (arXiv 2021.08) Guiding Query Position and Performing Similar Attention for Transformer-Based Detection Heads, [Paper]
• (arXiv 2021.08) TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios, [Paper]
• (arXiv 2021.09) Anchor DETR: Query Design for Transformer-Based Detector, [Paper],[Code]
• (arXiv 2021.09) SDTP: Semantic-aware Decoupled Transformer Pyramid for Dense Image Prediction, [Paper]
• (arXiv 2021.09) Infrared Small-Dim Target Detection with Transformer under Complex Backgrounds, [Paper]
• (arXiv 2021.10) IViDT: An Efficient and Effective Fully Transformer-based Object Detector, [Paper],[Code]
• (arXiv 2021.10) DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries, [Paper],[Code]
• (arXiv 2021.10) CvT-ASSD: Convolutional vision-Transformer Based Attentive Single Shot MultiBox Detector, [Paper],[Code]
• (arXiv 2021.11) Cross-Modality Fusion Transformer for Multispectral Object Detection, [Paper],[Code]
• (arXiv 2021.11) Benchmarking Detection Transfer Learning with Vision Transformers, [Paper]
• (arXiv 2021.11) BoxeR: Box-Attention for 2D and 3D Transformers, [Paper]
• (arXiv 2021.11) Sparse DETR: Efficient End-to-End Object Detection with Learnable Sparsity, [Paper], [Code]
• (arXiv 2021.12) OW-DETR: Open-world Detection Transformer, [Paper]
• (arXiv 2021.12) Recurrent Glimpse-based Decoder for Detection with Transformer, [Paper], [Code]
• (arXiv 2021.12) BEVDet: High-Performance Multi-Camera 3D Object Detection in Bird-Eye-View, [Paper]
• (arXiv 2021.12) Miti-DETR: Object Detection based on Transformers with Mitigatory Self-Attention Convergence, [Paper]
• (arXiv 2022.01) Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond, [Paper], [Code]
• (arXiv 2022.01) DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR, [Paper], [Code]
• (arXiv 2022.03) DN-DETR: Accelerate DETR Training by Introducing Query DeNoising, [Paper], [Code]
• (arXiv 2022.03) DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection, [Paper], [Code]
• (arXiv 2022.03) Knowledge Amalgamation for Object Detection with Transformers, [Paper]
• (arXiv 2022.03) Accelerating DETR Convergence via Semantic-Aligned Matching, [Paper], [Code]
• (arXiv 2022.03) Progressive End-to-End Object Detection in Crowded Scenes, [Paper], [Code]
• (arXiv 2022.03) Towards Data-Efficient Detection Transformers, [Paper], [Code]
• (arXiv 2022.03) Semantic-aligned Fusion Transformer for One-shot Object Detection, [Paper]
• (arXiv 2022.03) MonoDTR: Monocular 3D Object Detection with Depth-Aware Transformer, [Paper]
• (arXiv 2022.03) TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers, [Paper], [Code]
• (arXiv 2022.03) Open-Vocabulary DETR with Conditional Matching, [Paper]
• (arXiv 2022.03) MonoDETR: Depth-aware Transformer for Monocular 3D Object Detection, [Paper], [Code]
• (arXiv 2022.03) Few-Shot Object Detection with Fully Cross-Transformer, [Paper]
• (arXiv 2022.03) Exploring Plain Vision Transformer Backbones for Object Detection, [Paper]
• (arXiv 2022.03) Omni-DETR: Omni-Supervised Object Detection with Transformers, [Paper], [Code]
• (arXiv 2022.04) CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detection, [Paper]
• (arXiv 2022.04) Unleashing Vanilla Vision Transformer with Masked Image Modeling for Object Detection, [Paper], [Code]
• (arXiv 2022.04) An Extendable, Efficient and Effective Transformer-based Object Detector, [Paper], [Code]
• (arXiv 2022.04) Learning Future Object Prediction with a Spatiotemporal Detection Transformer, [Paper]
• (arXiv 2022.04) DFAM-DETR: Deformable feature based attention mechanism DETR on slender object detection, [Paper]
• (arXiv 2022.04) Graph-DETR3D: Rethinking Overlapping Regions for Multi-View 3D Object Detection, [Paper]
• (arXiv 2022.05) Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning, [Paper]
• (arXiv 2022.05) An Empirical Study of Self-supervised Learning Approaches for Object Detection with Transformers, [Paper], [Code1], [Code2]
• (arXiv 2022.05) Simple Open-Vocabulary Object Detection with Vision Transformers, [Paper], [Code]
• (arXiv 2022.05) Vision Transformer Adapter for Dense Predictions, [Paper], [Code]
• (arXiv 2022.05) Integral Migrating Pre-trained Transformer Encoder-decoders for Visual Object Detection, [Paper]
• (arXiv 2022.05) Boosting Camouflaged Object Detection with Dual-Task Interactive Transformer, [Paper],[Code]
• (arXiv 2022.05) Transformer-based out-of-distribution detection for clinically safe segmentation, [Paper]
• (arXiv 2022.05) AO2-DETR: Arbitrary-Oriented Object Detection Transformer, [Paper],[Code]
• (arXiv 2022.06) Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation, [Paper],[Code]
• (arXiv 2022.06) DETR++: Taming Your Multi-Scale Detection Transformer, [Paper],[Code]
• (arXiv 2022.06) Visual Transformer for Object Detection, [Paper]
• (arXiv 2022.06) Efficient Decoder-free Object Detection with Transformers, [Paper]
• (arXiv 2022.07) QKVA grid: Attention in Image Perspective and Stacked DETR, [Paper],[Code]
• (arXiv 2022.07) Symmetry-Aware Transformer-based Mirror Detection, [Paper],[Code]
• (arXiv 2022.07) Transformer-based Context Condensation for Boosting Feature Pyramids in Object Detection, [Paper]
• (arXiv 2022.07) Defect Transformer: An Efficient Hybrid Transformer Architecture for Surface Defect Detection, [Paper]
• (arXiv 2022.07) Conditional DETR V2: Efficient Detection Transformer with Box Queries, [Paper]
• (arXiv 2022.07) IDET: Iterative Difference-Enhanced Transformers for High-Quality Change Detection, [Paper]
• (arXiv 2022.07) Group DETR: Fast Training Convergence with Decoupled One-to-Many Label Assignment, [Paper]
• (arXiv 2022.07) DETRs with Hybrid Matching, [Paper], [Code]
• (arXiv 2022.07) Semantic-Aligned Matching for Enhanced DETR Convergence and Multi-Scale Feature Fusion, [Paper],[Code]
• (arXiv 2022.07) SiamixFormer: A Siamese Transformer Network For Building Detection And Change Detection From Bi-Temporal Remote Sensing Images, [Paper]

Edge

• (arXiv 2022.03) EDTER: Edge Detection with Transformer, [Paper], [Code]
• (arXiv 2022.06) XBound-Former: Toward Cross-scale Boundary Modeling in Transformers, [Paper], [Code]
• (arXiv 2022.06) Structured Context Transformer for Generic Event Boundary Detection, [Paper]
• (arXiv 2022.06) SC-Transformer++: Structured Context Transformer for Generic Event Boundary Detection, [Paper]

Enhancement

• (arXiv 2021.11) U-shape Transformer for Underwater Image Enhancement, [Paper]
• (arXiv 2022.01) DocEnTr: An End-to-End Document Image Enhancement Transformer, [Paper], [Code]
• (arXiv 2022.04) Underwater Image Enhancement Using Pre-trained Transformer, [Paper]
• (arXiv 2022.04) VISTA: Vision Transformer enhanced by U-Net and Image Colorfulness Frame Filtration for Automatic Retail Checkout, [Paper], [Code]
• (arXiv 2022.05) Reinforced Swin-Convs Transformer for Underwater Image Enhancement, [Paper]
• (arXiv 2022.07) Structural Prior Guided Generative Adversarial Transformers for Low-Light Image Enhancement, [Paper]

Face

• (arXiv 2021.03) Face Transformer for Recognition, [Paper]
• (arXiv 2021.03) Robust Facial Expression Recognition with Convolutional Visual Transformers, [Paper]
• (arXiv 2021.04) TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection, [Paper]
• (arXiv 2021.04) Facial Attribute Transformers for Precise and Robust Makeup Transfer, [Paper]
• (arXiv 2021.04) Learning to Cluster Faces via Transformer, [Paper]
• (arXiv 2021.06) VidFace: A Full-Transformer Solver for Video Face Hallucination with Unaligned Tiny Snapshots, [Paper]
• (arXiv 2021.06) MViT: Mask Vision Transformer for Facial Expression Recognition in the wild, [Paper]
• (arXiv 2021.06) Shuffle Transformer with Feature Alignment for Video Face Parsing, [Paper]
• (arXiv 2021.06) A Latent Transformer for Disentangled and Identity-Preserving Face Editing, [Paper], [Code]
• (arXiv 2021.07) ST-DETR: Spatio-Temporal Object Traces Attention Detection Transformer, [Paper]
• (arXiv 2021.08) FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpainting, [Paper]
• (arXiv 2021.08) Learning Fair Face Representation With Progressive Cross Transformer, [Paper]
• (arXiv 2021.08) TransFER: Learning Relation-aware Facial Expression Representations with Transformers, [Paper]
• (arXiv 2021.09) TANet: A new Paradigm for Global Face Super-resolution via Transformer-CNN Aggregation Network, [Paper]
• (arXiv 2021.09) Expression Snippet Transformer for Robust Video-based Facial Expression Recognition, [Paper],[Code]
• (arXiv 2021.09) Sparse Spatial Transformers for Few-Shot Learning, [Paper],[Code]
• (arXiv 2021.09) MFEViT: A Robust Lightweight Transformer-based Network for Multimodal 2D+3D Facial Expression Recognition, [Paper]
• (arXiv 2021.11) FakeTransformer: Exposing Face Forgery From Spatial-Temporal Representation Modeled By Facial Pixel Variations, [Paper]
• (arXiv 2021.12) SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal, [Paper],[Code]
• (arXiv 2021.12) FaceFormer: Speech-Driven 3D Facial Animation with Transformers, [Paper]
• (arXiv 2021.12) Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition, [Paper]
• (arXiv 2022.01) RestoreFormer: High-Quality Blind Face Restoration From Undegraded Key-Value Pairs, [Paper]
• (arXiv 2022.03) Protecting Celebrities with Identity Consistency Transformer, [Paper]
• (arXiv 2022.03) Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learning, [Paper],[Code]
• (arXiv 2022.03) HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Network, [Paper]
• (arXiv 2022.03) Mask Usage Recognition using Vision Transformer with Transfer Learning and Data Augmentation, [Paper]
• (arXiv 2022.03) Transformer-based Multimodal Information Fusion for Facial Expression Analysis, [Paper]
• (arXiv 2022.03) Adaptive Transformers for Robust Few-shot Cross-domain Face Anti-spoofing, [Paper]
• (arXiv 2022.03) Facial Expression Recognition with Swin Transformer, [Paper]
• (arXiv 2022.03) TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing, [Paper],[Code]
• (arXiv 2022.04) Vision Transformer Equipped with Neural Resizer on Facial Expression Recognition Task, [Paper]
• (arXiv 2022.04) POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition, [Paper],[Code]
• (arXiv 2022.05) Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wild, [Paper]
• (arXiv 2022.05) Towards Robust Blind Face Restoration with Codebook Lookup Transformer, [Paper],[Code]
• (arXiv 2022.07) RePFormer: Refinement Pyramid Transformer for Robust Facial Landmark Detection, [Paper]
• (arXiv 2022.07) TransFA: Transformer-based Representation for Face Attribute Evaluation, [Paper]
• (arXiv 2022.07) FaceFormer: Scale-aware Blind Face Restoration with Transformers, [Paper]
• (arXiv 2022.07) AU-Supervised Convolutional Vision Transformers for Synthetic Facial Expression Recognition, [Paper],[Code]
• (arXiv 2022.07) Hybrid CNN-Transformer Model For Facial Affect Recognition In the ABAW4 Challenge, [Paper]
• (arXiv 2022.07) Facial Expression Recognition using Vanilla ViT backbones with MAE Pretraining, [Paper]

Few-shot Learning

• (arXiv 2021.04) Rich Semantics Improve Few-shot Learning, [Paper], [Code]
• (arXiv 2021.04) Few-Shot Segmentation via Cycle-Consistent Transformer, [Paper]
• (arXiv 2021.09) Sparse Spatial Transformers for Few-Shot Learning, [Paper]
• (arXiv 2021.12) Cost Aggregation Is All You Need for Few-Shot Segmentation, [Paper], [Code]
• (arXiv 2022.01) HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learning, [Paper]
• (arXiv 2022.02) Task-Adaptive Feature Transformer with Semantic Enrichment for Few-Shot Segmentation, [Paper]
• (arXiv 2022.03) Self-Promoted Supervision for Few-Shot Transformer, [Paper], [Code]
• (arXiv 2022.03) Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learning, [Paper], [Code]
• (arXiv 2022.04) CATrans: Context and Affinity Transformer for Few-Shot Segmentation, [Paper]
• (arXiv 2022.05) Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning, [Paper]
• (arXiv 2022.05) Few-Shot Diffusion Models, [Paper]
• (arXiv 2022.06) Prompting Decision Transformer for Few-Shot Policy Generalization, [Paper], [Code]
• (arXiv 2022.07) Learning Cross-Image Object Semantic Relation in Transformer for Few-Shot Fine-Grained Image Classification, [Paper], [Code]
• (arXiv 2022.07) Few-shot Object Counting and Detection, [Paper], [Code]
• (arXiv 2022.07) Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentation, [Paper], [Code]

Fusion

• (arXiv 2022.01) TransFuse: A Unified Transformer-based Image Fusion Framework using Self-supervised Learning, [Paper]
• (arXiv 2022.01) TGFuse: An Infrared and Visible Image Fusion Approach Based on Transformer and Generative Adversarial Network, [Paper]
• (arXiv 2022.04) SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images, [Paper], [Code]
• (arXiv 2022.07) Array Camera Image Fusion using Physics-Aware Transformers, [Paper]

GAN

• (arXiv 2021.02) TransGAN: Two Transformers Can Make One Strong GAN, [Paper], [Code]
• (arXiv 2021.03) Generative Adversarial Transformers, [Paper], [Code]
• (arXiv 2021.04) VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers, [Paper], [Code]
• (arXiv 2021.05) Combining Transformer Generators with Convolutional Discriminators, [Paper], [Code]
• (arXiv 2021.06) ViT-Inception-GAN for Image Colourising, [Paper]
• (arXiv 2021.06) Improved Transformer for High-Resolution GANs, [Paper]
• (arXiv 2021.06) Styleformer: Transformer based Generative Adversarial Networks with Style Vector, [Paper], [Code]
• (arXiv 2021.07) ViTGAN: Training GANs with Vision Transformers, [Paper]
• (arXiv 2021.10) Generating Symbolic Reasoning Problems with Transformer GANs, [Paper]
• (arXiv 2021.10) STransGAN: An Empirical Study on Transformer in GANs, [Paper], [Project]
• (arXiv 2021.12) StyleSwin: Transformer-based GAN for High-resolution Image Generation, [Paper], [Code]
• (arXiv 2022.01) RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmark, [Paper]
• (arXiv 2022.03) Style Transformer for Image Inversion and Editing, [Paper], [Code]
• (arXiv 2022.06) Cycle text2face: cycle text-to-face gan via transformers, [Paper]
• (arXiv 2022.06) Cross-Modal Transformer GAN: A Brain Structure-Function Deep Fusing Framework for Alzheimer's Disease, [Paper]

Gait

• (arXiv 2022.04) Spatial Transformer Network on Skeleton-based Gait Recognition, [Paper]
• (arXiv 2022.06) Exploring Transformers for Behavioural Biometrics: A Case Study in Gait Recognition, [Paper]
• (arXiv 2022.06) GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation, [Paper], [Code]

Gaze

• (arXiv 2021.06) Gaze Estimation using Transformer, [Paper], [Code]
• (arXiv 2022.03) End-to-End Human-Gaze-Target Detection with Transformers, [Paper]
• (arXiv 2022.05) Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning, [Paper]

Hand Gesture

• (arXiv 2022.01) ViT-HGR: Vision Transformer-based Hand Gesture Recognition from High Density Surface EMG Signals, [Paper] 1

HOI

• (CVPR'21) HOTR: End-to-End Human-Object Interaction Detection with Transformers, [Paper], [Code]
• (arXiv 2021.03) QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information, [Paper], [Code]
• (arXiv 2021.03) Reformulating HOI Detection as Adaptive Set Prediction, [Paper], [Code]
• (arXiv 2021.03) End-to-End Human Object Interaction Detection with HOI Transformer, [Paper], [Code]
• (arXiv 2021.05) Visual Composite Set Detection Using Part-and-Sum Transformers, [Paper]
• (arXiv 2021.08) GTNet:Guided Transformer Network for Detecting Human-Object Interactions, [Paper], [Code]
• (arXiv 2021.12) Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer, [Paper], [Code]
• (arXiv 2022.03) Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows, [Paper]
• (arXiv 2022.03) MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection, [Paper]
• (arXiv 2022.04) What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions, [Paper]
• (arXiv 2022.04) End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation, [Paper], [Code]
• (arXiv 2022.04) Category-Aware Transformer Network for Better Human-Object Interaction Detection, [Paper]
• (arXiv 2022.04) Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection, [Paper], [Code]
• (arXiv 2022.04) Human-Object Interaction Detection via Disentangled Transformer, [Paper]
• (arXiv 2022.06) Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection, [Paper], [Code]
• (arXiv 2022.07) Towards Hard-Positive Query Mining for DETR-based Human-Object Interaction Detection, [Paper], [Code]
• (arXiv 2022.07) IGFormer: Interaction Graph Transformer for Skeleton-based Human Interaction Recognition, [Paper]

Hyperspectral

• (arXiv 2021.07) SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers, [Paper], [Code]
• (arXiv 2021.10) 3D-ANAS v2: Grafting Transformer Module on Automatically Designed ConvNet for Hyperspectral Image Classification, [Paper], [Code]
• (arXiv 2021.11) Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction, [Paper]
• (arXiv 2021.11) Learning A 3D-CNN and Transformer Prior for Hyperspectral Image Super-Resolution, [Paper]
• (arXiv 2022.03) HyperTransformer: A Textural and Spectral Feature Fusion Transformer for Pansharpening, [Paper]
• (arXiv 2022.03) Multiscale Convolutional Transformer with Center Mask Pretraining for Hyperspectral Image Classificationtion, [Paper]
• (arXiv 2022.03) Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction, [Paper]
• (arXiv 2022.03) Deep Hyperspectral Unmixing using Transformer Network, [Paper], [Code]
• (arXiv 2022.04) MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction, [Paper], [Code]

Illumination

• (arXiv 2022.05) Illumination Adaptive Transformer, [Paper], [Code]

Incremental Learning

• (arXiv 2021.12) Improving Vision Transformers for Incremental Learning, [Paper]
• (arXiv 2022.03) Meta-attention for ViT-backed Continual Learning, [Paper], [Code]
• (arXiv 2022.03)Towards Exemplar-Free Continual Learning in Vision Transformers: an Account of Attention, Functional and Weight Regularization, [Paper]
• (arXiv 2022.08) D3Former: Debiased Dual Distilled Transformer for Incremental Learning, [Paper], [Code]

In-painting

• (ECCV'20) Learning Joint Spatial-Temporal Transformations for Video Inpainting, [Paper], [Code]
• (arXiv 2021.04) Aggregated Contextual Transformations for High-Resolution Image Inpainting, [Paper], [Code]
• (arXiv 2021.04) Decoupled Spatial-Temporal Transformer for Video Inpainting, [Paper], [Code]
• (arXiv 2022.03) Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding, [Paper], [Code]
• (arXiv 2022.03) MAT: Mask-Aware Transformer for Large Hole Image Inpainting, [Paper], [Code]
• (arXiv 2022.05) Reduce Information Loss in Transformers for Pluralistic Image Inpainting, [Paper]

Instance Segmentation

• (CVPR'21) End-to-End Video Instance Segmentation with Transformers, [Paper], [Code]
• (arXiv 2021.04) ISTR: End-to-End Instance Segmentation with Transformers, [Paper], [Code]
• (arXiv 2021.08) SOTR: Segmenting Objects with Transformers, [Paper], [Code]
• (arXiv 2021.12) SeqFormer: a Frustratingly Simple Model for Video Instance Segmentation, [Paper], [Code]
• (arXiv 2021.12) A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation, [Paper]
• (arXiv 2021.12) SOIT: Segmenting Objects with Instance-Aware Transformers, [Paper], [Code]
• (arXiv 2022.03) Video Instance Segmentation via Multi-scale Spatio-temporal Split Attention Transformer, [Paper], [Code]
• (arXiv 2022.04) Temporally Efficient Vision Transformer for Video Instance Segmentation, [Paper], [Code]
• (arXiv 2022.04) Less than Few: Self-Shot Video Instance Segmentation, [Paper]
• (arXiv 2022.06) Consistent Video Instance Segmentation with Inter-Frame Recurrent Attention, [Paper]
• (arXiv 2022.06) Parallel Pre-trained Transformers (PPT) for Synthetic Data-based Instance Segmentation, [Paper], [Code]
• (arXiv 2022.07) OSFormer: One-Stage Camouflaged Instance Segmentation with Transformers, [Paper], [Code]
• (arXiv 2022.07) In Defense of Online Models for Video Instance Segmentation, [Paper], [Code]
• (arXiv 2022.07) Video Mask Transfiner for High-Quality Video Instance Segmentation, [Paper], [Project]

Knowledge Distillation

• (arXiv 2022.04) DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers, [Paper]
• (arXiv 2022.05) Knowledge Distillation via the Target-aware Transformer, [Paper]
• (arXiv 2022.05) Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillation, [Paper], [Code]

Lane

• (arXiv 2022.03) Laneformer: Object-aware Row-Column Transformers for Lane Detection, [Paper]
• (arXiv 2022.03) PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark, [Paper], [Project]

Layout

• (CVPR'21) Variational Transformer Networks for Layout Generation, [Paper]
• (arXiv 2021.10) The Layout Generation Algorithm of Graphic Design Based on Transformer-CVAE, [Paper]
• (arXiv 2021.12) BLT: Bidirectional Layout Transformer for Controllable Layout Generation, [Paper]
• (arXiv 2022.02) ATEK: Augmenting Transformers with Expert Knowledge for Indoor Layout Synthesis, [Paper]
• (arXiv 2022.03) LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Network, [Paper], [Code]

Lighting

• (arXiv 2022.02) Spatio-Temporal Outdoor Lighting Aggregation on Image Sequences using Transformer Networks, [Paper]

Matching

• (CVPR'21') LoFTR: Detector-Free Local Feature Matching with Transformers, [Paper], [Code]
• (arXiv 2022.02) Local Feature Matching with Transformers for low-end devices, [Paper], [Code]
• (arXiv 2022.02) CATs++: Boosting Cost Aggregation with Convolutions and Transformers, [Paper], [Code]
• (arXiv 2022.03) MatchFormer: Interleaving Attention in Transformers for Feature Matching, [Paper], [Code]
• (arXiv 2022.05) TransforMatcher: Match-to-Match Attention for Semantic Correspondence, [Paper], [Code]
• (arXiv 2022.07) Deep Laparoscopic Stereo Matching with Transformers, [Paper]

Matting

• (arXiv 2022.03) MatteFormer: Transformer-Based Image Matting via Prior-Tokens, [Paper], [Code]

Medical

• (arXiv 2021.02) TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation, [Paper], [Code]
• (arXiv 2021.02) Medical Transformer: Gated Axial-Attention for Medical Image Segmentation, [Paper], [Code]
• (arXiv 2021.03) SpecTr: Spectral Transformer for Hyperspectral Pathology Image Segmentation, [Paper], [Code]
• (arXiv 2021.03) TransBTS: Multimodal Brain Tumor Segmentation Using Transformer, [Paper], [Code]
• (arXiv 2021.03) TransMed: Transformers Advance Multi-modal Medical Image Classification, [Paper]
• (arXiv 2021.03) U-Net Transformer: Self and Cross Attention for Medical Image Segmentation, [Paper]
• (arXiv 2021.03) SUNETR: Transformers for 3D Medical Image Segmentation, [Paper]
• (arXiv 2021.04) DeepProg: A Multi-modal Transformer-based End-to-end Framework for Predicting Disease Prognosis, [Paper]
• (arXiv 2021.04) Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification, [Paper]
• (arXiv 2021.04) Shoulder Implant X-Ray Manufacturer Classification: Exploring with Vision Transformer, [Paper]
• (arXiv 2021.04) Medical Transformer: Universal Brain Encoder for 3D MRI Analysis, [Paper]
• (arXiv 2021.04) Crossmodal Matching Transformer for Interventional in TEVAR, [Paper]
• (arXiv 2021.04) GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathology Image Classification, [Paper]
• (arXiv 2021.04) Pyramid Medical Transformer for Medical Image Segmentation, [Paper]
• (arXiv 2021.05) Anatomy-Guided Parallel Bottleneck Transformer Network for Automated Evaluation of Root Canal Therapy, [Paper]
• (arXiv 2021.05) Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentation, [Paper], [Code]
• (arXiv 2021.05) Is Image Size Important? A Robustness Comparison of Deep Learning Methods for Multi-scale Cell Image Classification Tasks: from Convolutional Neural Networks to Visual Transformers, [Paper]
• (arXiv 2021.05) Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers, [Paper]
• (arXiv 2021.05) Medical Image Segmentation using Squeeze-and-Expansion Transformers, [Paper], [Code]
• (arXiv 2021.05) POCFormer: A Lightweight Transformer Architecture for Detection of COVID-19 Using Point of Care Ultrasound, [Paper]
• (arXiv 2021.05) COTR: Convolution in Transformer Network for End to End Polyp Detection, [Paper]
• (arXiv 2021.05) PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer, [Paper]
• (arXiv 2021.06) TED-net: Convolution-free T2T Vision Transformerbased Encoder-decoder Dilation network for Low-dose CT Denoising, [Paper]
• (arXiv 2021.06) A Multi-Branch Hybrid Transformer Network for Corneal Endothelial Cell Segmentation, [Paper]
• (arXiv 2021.06) Task Transformer Network for Joint MRI Reconstruction and Super-Resolution, [Paper], [Code]
• (arXiv 2021.06) DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation, [Paper]
• (arXiv 2021.06) More than Encoder: Introducing Transformer Decoder to Upsample, [Paper]
• (arXiv 2021.06) Instance-based Vision Transformer for Subtyping of Papillary Renal Cell Carcinoma in Histopathological Image, [Paper]
• (arXiv 2021.06) MTrans: Multi-Modal Transformer for Accelerated MR Imaging, [Paper], [Code]
• (arXiv 2021.06) Multi-Compound Transformer for Accurate Biomedical Image Segmentation, [Paper], [Code]
• (arXiv 2021.07) ResViT: Residual vision transformers for multi-modal medical image synthesis, [Paper]
• (arXiv 2021.07) E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic Depth Perception, [Paper]
• (arXiv 2021.07) UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation, [Paper]
• (arXiv 2021.07) COVID-VIT: Classification of Covid-19 from CT chest images based on vision transformer models, [Paper]
• (arXiv 2021.07) RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting, [Paper], [Code]
• (arXiv 2021.07) Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation, [Paper]
• (arXiv 2021.07) Transformer Network for Significant Stenosis Detection in CCTA of Coronary Arteries, [Paper]
• (arXiv 2021.07) EEG-ConvTransformer for Single-Trial EEG based Visual Stimuli Classification, [Paper]
• (arXiv 2021.07) Visual Transformer with Statistical Test for COVID-19 Classification, [Paper]
• (arXiv 2021.07) TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation, [Paper]
• (arXiv 2021.07) Few-Shot Domain Adaptation with Polymorphic Transformers, [Paper], [Code]
• (arXiv 2021.07) TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation, [Paper]
• (arXiv 2021.07) Surgical Instruction Generation with Transformers, [Paper]
• (arXiv 2021.07) LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation, [Paper], [Code]
• (arXiv 2021.07) TEDS-Net: Enforcing Diffeomorphisms in Spatial Transformers to Guarantee Topology Preservation in Segmentations, [Paper], [Code]
• (arXiv 2021.08) Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers, [Paper], [Code]
• (arXiv 2021.08) Is it Time to Replace CNNs with Transformers for Medical Images, [Paper], [Code]
• (arXiv 2021.09) nnFormer: Interleaved Transformer for Volumetric Segmentation, [Paper], [Code]
• (arXiv 2021.09) UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer, [Paper], [Code]
• (arXiv 2021.09) MISSFormer: An Effective Medical Image Segmentation Transformer, [Paper]
• (arXiv 2021.09) Eformer: Edge Enhancement based Transformer for Medical Image Denoising, [Paper]
• (arXiv 2021.09) Transformer-Unet: Raw Image Processing with Unet, [Paper]
• (arXiv 2021.09) BiTr-Unet: a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation, [Paper]
• (arXiv 2021.09) GT U-Net: A U-Net Like Group Transformer Network for Tooth Root Segmentation, [Paper]
• (arXiv 2021.10) Transformer Assisted Convolutional Network for Cell Instance Segmentation, [Paper]
• (arXiv 2021.10) A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI images, [Paper]
• (arXiv 2021.10) Boundary-aware Transformers for Skin Lesion Segmentation, [Paper], [Code]
• (arXiv 2021.10) Vision Transformer based COVID-19 Detection using Chest X-rays, [Paper]
• (arXiv 2021.10) Combining CNNs With Transformer for Multimodal 3D MRI Brain Tumor Segmentation With Self-Supervised Pretraining, [Paper], [Code]
• (arXiv 2021.10) CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scans, [Paper], [Code]
• (arXiv 2021.10) COVID-19 Detection in Chest X-ray Images Using Swin-Transformer and Transformer in Transformer, [Paper], [Code]
• (arXiv 2021.10) Bilateral-ViT for Robust Fovea Localization, [Paper]
• (arXiv 2021.10) AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation, [Paper]
• (arXiv 2021.10) Vision Transformer for Classification of Breast Ultrasound Images, [Paper]
• (arXiv 2021.11) Federated Split Vision Transformer for COVID-19CXR Diagnosis using Task-Agnostic Training, [Paper]
• (arXiv 2021.11) Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention, [Paper]
• (arXiv 2021.11) Lymph Node Detection in T2 MRI with Transformers, [Paper]
• (arXiv 2021.11) Mixed Transformer U-Net For Medical Image Segmentation, [Paper], [Code]
• (arXiv 2021.11) Transformer for Polyp Detection, [Paper]
• (arXiv 2021.11) DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction, [Paper], [Code]
• (arXiv 2021.11) A Volumetric Transformer for Accurate 3D Tumor Segmentation, [Paper], [Code]
• (arXiv 2021.11) Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis, [Paper], [Code]
• (arXiv 2021.11) MIST-net: Multi-domain Integrative Swin Transformer network for Sparse-View CT Reconstruction, [Paper]
• (arXiv 2021.12) MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classification, [Paper], [Code]
• (arXiv 2021.12) 3D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysis, [Paper], [Code]
• (arXiv 2021.12) Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer, [Paper], [Code]
• (arXiv 2021.12) Pre-training and Fine-tuning Transformers for fMRI Prediction Tasks, [Paper], [Code]
• (arXiv 2021.12) MSHT: Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer, [Paper], [Code]
• (arXiv 2022.01) D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentation, [Paper]
• (arXiv 2022.01) Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images, [Paper], [Code]
• (arXiv 2022.01) Swin Transformer for Fast MRI, [Paper], [Code]
• (arXiv 2022.01) ViTBIS: Vision Transformer for Biomedical Image Segmentation, [Paper]
• (arXiv 2022.01) Improving Across-Dataset Brain Tissue Segmentation Using Transformer, [Paper], [Code]
• (arXiv 2022.01) SegTransVAE: Hybrid CNN -- Transformer with Regularization for medical image segmentation, [Paper], [Code]
• (arXiv 2022.01) ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer, [Paper], [Code]
• (arXiv 2022.01) Fast MRI Reconstruction: How Powerful Transformers Are, [Paper]
• (arXiv 2022.01) Class-Aware Generative Adversarial Transformers for Medical Image Segmentation, [Paper]
• (arXiv 2022.01) RTNet: Relation Transformer Network for Diabetic Retinopathy Multi-lesion Segmentation, [Paper]
• (arXiv 2022.01) Joint Liver and Hepatic Lesion Segmentation using a Hybrid CNN with Transformer Layers, [Paper]
• (arXiv 2022.01) DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstruction, [Paper]
• (arXiv 2022.01) TransPPG: Two-stream Transformer for Remote Heart Rate Estimate, [Paper]
• (arXiv 2022.01) TransBTSV2: Wider Instead of Deeper Transformer for Medical Image Segmentation, [Paper], [Code]
• (arXiv 2022.01) Brain Cancer Survival Prediction on Treatment-na ive MRI using Deep Anchor Attention Learning with Vision Transformer, [Paper]
• (arXiv 2022.02) Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers, [Paper], [Code]
• (arXiv 2022.02) AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation, [Paper]
• (arXiv 2022.02) ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification, [Paper]
• (arXiv 2022.02) A hybrid 2-stage vision transformer for AI-assisted 5 class pathologic diagnosis of gastric endoscopic biopsies, [Paper]
• (arXiv 2022.02) TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgery, [Paper]
• (arXiv 2022.02) RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classification, [Paper]
• (arXiv 2022.03) Using Multi-scale SwinTransformer-HTC with Data augmentation in CoNIC Challenge, [Paper]
• (arXiv 2022.03) CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising, [Paper], [Code]
• (arXiv 2022.03) Self-Supervised Vision Transformers Learn Visual Concepts in Histopathology, [Paper], [Code]
• (arXiv 2022.03) A Multi-scale Transformer for Medical Image Segmentation: Architectures, Model Efficiency, and Benchmarks, [Paper], [Code]
• (arXiv 2022.03) Tempera: Spatial Transformer Feature Pyramid Network for Cardiac MRI Segmentation, [Paper]
• (arXiv 2022.03) Contextual Attention Network: Transformer Meets U-Net, [Paper], [Code]
• (arXiv 2022.03) Characterizing Renal Structures with 3D Block Aggregate Transformers, [Paper]
• (arXiv 2022.03) Uni4Eye: Unified 2D and 3D Self-supervised Pre-training via Masked Image Modeling Transformer for Ophthalmic Image Classification, [Paper]
• (arXiv 2022.03) Active Phase-Encode Selection for Slice-Specific Fast MR Scanning Using a Transformer-Based Deep Reinforcement Learning Framework, [Paper]
• (arXiv 2022.03) Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4, [Paper]
• (arXiv 2022.03) SATr: Slice Attention with Transformer for Universal Lesion Detection, [Paper]
• (arXiv 2022.03) Simulation-Driven Training of Vision Transformers Enabling Metal Segmentation in X-Ray Images, [Paper]
• (arXiv 2022.03) TransFusion: Multi-view Divergent Fusion for Medical Image Segmentation with Transformers, [Paper]
• (arXiv 2022.03) Adaptively Re-weighting Multi-Loss Untrained Transformer for Sparse-View Cone-Beam CT Reconstruction, [Paper]
• (arXiv 2022.03) Contrastive Transformer-based Multiple Instance Learning for Weakly Supervised Polyp Frame Detection, [Paper]
• (arXiv 2022.03) Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution, [Paper], [Code]
• (arXiv 2022.03) Cross-Modality High-Frequency Transformer for MR Image Super-Resolution, [Paper]
• (arXiv 2022.03) CAT-Net: A Cross-Slice Attention Transformer Model for Prostate Zonal Segmentation in MRI, [Paper]
• (arXiv 2022.04) UNetFormer: A Unified Vision Transformer Model and Pre-Training Framework for 3D Medical Image Segmentation, [Paper], [Code]
• (arXiv 2022.04) Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers, [Paper]
• (arXiv 2022.04) CCAT-NET: A Novel Transformer Based Semi-supervised Framework for Covid-19 Lung Lesion Segmentation, [Paper]
• (arXiv 2022.04) Surface Vision Transformers: Flexible Attention-Based Modelling of Biomedical Surfaces, [Paper], [Code]
• (arXiv 2022.04) Low-Dose CT Denoising via Sinogram Inner-Structure Transformer, [Paper]
• (arXiv 2022.04) 3D Shuffle-Mixer: An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume, [Paper]
• (arXiv 2022.04) Continual Hippocampus Segmentation with Transformers, [Paper]
• (arXiv 2022.04) TranSiam: Fusing Multimodal Visual Features Using Transformer for Medical Image Segmentation, [Paper]
• (arXiv 2022.05) Noise-reducing attention cross fusion learning transformer for histological image classification of osteosarcoma, [Paper]
• (arXiv 2022.05) One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputation, [Paper]
• (arXiv 2022.05) Unsupervised Contrastive Learning based Transformer for Lung Nodule Detection, [Paper]
• (arXiv 2022.05) Understanding Transfer Learning for Chest Radiograph Clinical Report Generation with Modified Transformer Architectures, [Paper]
• (arXiv 2022.05) Masked Co-attentional Transformer reconstructs 100x ultra-fast/low-dose whole-body PET from longitudinal images and anatomically guided MRI, [Paper]
• (arXiv 2022.05) Local Attention Graph-based Transformer for Multi-target Genetic Alteration Prediction, [Paper]
• (arXiv 2022.05) A microstructure estimation Transformer inspired by sparse representation for diffusion MRI, [Paper]
• (arXiv 2022.05) An Effective Transformer-based Solution for RSNA Intracranial Hemorrhage Detection Competition, [Paper],[Code]
• (arXiv 2022.05) HoVer-Trans: Anatomy-aware HoVer-Transformer for ROI-free Breast Cancer Diagnosis in Ultrasound Images, [Paper]
• (arXiv 2022.05) ColonFormer: An Efficient Transformer based Method for Colon Polyp Segmentation, [Paper]
• (arXiv 2022.05) Transformer based multiple instance learning for weakly supervised histopathology image segmentation, [Paper]
• (arXiv 2022.05) A graph-transformer for whole slide image classification, [Paper]
• (arXiv 2022.05) BabyNet: Residual Transformer Module for Birth Weight Prediction on Fetal Ultrasound Video, [Paper],[Code]
• (arXiv 2022.05) Transformer based Generative Adversarial Network for Liver Segmentation, [Paper]
• (arXiv 2022.05) A Comparative Study of Gastric Histopathology Sub-size Image Classification: from Linear Regression to Visual Transformer, [Paper],[Code]
• (arXiv 2022.05) Zero-Shot and Few-Shot Learning for Lung Cancer Multi-Label Classification using Vision Transformer, [Paper]
• (arXiv 2022.06) The Fully Convolutional Transformer for Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.06) CellCentroidFormer: Combining Self-attention and Convolution for Cell Detection, [Paper],[Code]
• (arXiv 2022.06) Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives, [Paper]
• (arXiv 2022.06) CVM-Cervix: A Hybrid Cervical Pap-Smear Image Classification Framework Using CNN, Visual Transformer and Multilayer Perceptron, [Paper]
• (arXiv 2022.06) MISSU: 3D Medical Image Segmentation via Self-distilling TransUNet, [Paper],[Code]
• (arXiv 2022.06) mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation, [Paper],[Code]
• (arXiv 2022.06) Patcher: Patch Transformers with Mixture of Experts for Precise Medical Image Segmentation, [Paper]
• (arXiv 2022.06) Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation, [Paper]
• (arXiv 2022.06) Siamese Encoder-based Spatial-Temporal Mixer for Growth Trend Prediction of Lung Nodules on CT Scans, [Paper],[Code]
• (arXiv 2022.06) Transformer-based Personalized Attention Mechanism (PersAM) for Medical Images with Clinical Records, [Paper]
• (arXiv 2022.06) SwinCheX: Multi-label classification on chest X-ray images with transformers, [Paper]
• (arXiv 2022.06) RPLHR-CT Dataset and Transformer Baseline for Volumetric Super-Resolution from CT Scans, [Paper],[Code]
• (arXiv 2022.06) Transformer Lesion Tracker, [Paper],[Code]
• (arXiv 2022.06) SeATrans: Learning Segmentation-Assisted diagnosis model via Transforme, [Paper]
• (arXiv 2022.06) K-Space Transformer for Fast MRIReconstruction with Implicit Representation, [Paper],[Code]
• (arXiv 2022.06) XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attention, [Paper],[Code]
• (arXiv 2022.06) A Projection-Based K-space Transformer Network for Undersampled Radial MRI Reconstruction with Limited Training Subjects, [Paper]
• (arXiv 2022.06) Rectify ViT Shortcut Learning by Visual Saliency, [Paper]
• (arXiv 2022.06) Neural Transformers for Intraductal Papillary Mucosal Neoplasms (IPMN) Classification in MRI images, [Paper]
• (arXiv 2022.06) Toward Unpaired Multi-modal Medical Image Segmentation via Learning Structured Semantic Consistency, [Paper],[Code]
• (arXiv 2022.06) TransResU-Net: Transformer based ResU-Net for Real-Time Colonoscopy Polyp Segmentation, [Paper],[Code]
• (arXiv 2022.06) SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI, [Paper],[Code]
• (arXiv 2022.06) ICOS Protein Expression Segmentation: Can Transformer Networks Give Better Results, [Paper]
• (arXiv 2022.06) Kernel Attention Transformer (KAT) for Histopathology Whole Slide Image Classification, [Paper],[Code]
• (arXiv 2022.06) Context-Aware Transformers For Spinal Cancer Detection and Radiological Grading, [Paper]
• (arXiv 2022.06) The Lighter The Better: Rethinking Transformers in Medical Image Segmentation Through Adaptive Pruning, [Paper],[Code]
• (arXiv 2022.06) C2FTrans: Coarse-to-Fine Transformers for Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.06) LViT: Language meets Vision Transformer in Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.06) PVT-COV19D: Pyramid Vision Transformer for COVID-19 Diagnosis, [Paper]
• (arXiv 2022.07) Rethinking Surgical Captioning: End-to-End Window-Based MLP Transformer Using Patches, [Paper],[Code]
• (arXiv 2022.07) Efficient Lung Cancer Image Classification and Segmentation Algorithm Based on Improved Swin Transformer, [Paper]
• (arXiv 2022.07) Spatiotemporal Feature Learning Based on Two-Step LSTM and Transformer for CT Scans, [Paper]
• (arXiv 2022.07) Adaptive GLCM sampling for transformer-based COVID-19 detection on CT, [Paper]
• (arXiv 2022.07) CNN-based Local Vision Transformer for COVID-19 Diagnosis, [Paper]
• (arXiv 2022.07) Transformer based Models for Unsupervised Anomaly Segmentation in Brain MR Images, [Paper],[Code]
• (arXiv 2022.07) CASHformer: Cognition Aware SHape Transformer for Longitudinal Analysis, [Paper]
• (arXiv 2022.07) Swin Deformable Attention U-Net Transformer (SDAUT) for Explainable Fast MRI, [Paper],[Code]
• (arXiv 2022.07) Multi-Label Retinal Disease Classification using Transformers, [Paper],[Code],[Dataset]
• (arXiv 2022.07) TractoFormer: A Novel Fiber-level Whole Brain Tractography Analysis Framework Using Spectral Embedding and Vision Transformers, [Paper]
• (arXiv 2022.07) Learning Apparent Diffusion Coefficient Maps from Undersampled Radial k-Space Diffusion-Weighted MRI in Mice using a Deep CNN-Transformer Model in Conjunction with a Monoexponential Model, [Paper]
• (arXiv 2022.07) TFCNs: A CNN-Transformer Hybrid Network for Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.07) Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays, [Paper]
• (arXiv 2022.07) RTN: Reinforced Transformer Network for Coronary CT Angiography Vessel-level Image Quality Assessment, [Paper]
• (arXiv 2022.07) CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer with Modality-Correlated Cross-Attention for Brain Tumor Segmentation, [Paper]
• (arXiv 2022.07) Mobile Keystroke Biometrics Using Transformers, [Paper]
• (arXiv 2022.07) Multi-head Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction, [Paper]
• (arXiv 2022.07) HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.07) Focused Decoding Enables 3D Anatomical Detection by Transformers, [Paper],[Code]
• (arXiv 2022.07) High-Resolution Swin Transformer for Automatic Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.07) Improved Super Resolution of MR Images Using CNNs and Vision Transformers, [Paper],[Code]
• (arXiv 2022.07) TransNorm: Transformer Provides a Strong Spatial Normalization Mechanism for a Deep Segmentation Model, [Paper],[Code]
• (arXiv 2022.07) ScaleFormer: Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentation, [Paper],[Code]
• (arXiv 2022.08) TransDeepLab: Convolution-Free Transformer-based DeepLab v3+ for Medical Image Segmentation, [Paper],[Code]

Metric learning

• (arXiv 2022.03) Hyperbolic Vision Transformers: Combining Improvements in Metric Learning, [Paper],[Code]

Motion

• (arXiv 2021.03) Single-Shot Motion Completion with Transformer, [Paper], [Code]
• (arXiv 2021.03) DanceNet3D: Music Based Dance Generation with Parametric Motion Transformer, [Paper]
• (arXiv 2021.03) Multimodal Motion Prediction with Stacked Transformers, [Paper], [Code]
• (arXiv 2021.04) Action-Conditioned 3D Human Motion Synthesis with Transformer VAE, [Paper]
• (arXiv 2021.10) AniFormer: Data-driven 3D Animation with Transformer, [Paper], [Code]
• (arXiv 2021.11) Multi-Person 3D Motion Prediction with Multi-Range Transformers, [Paper], [Code]
• (arXiv 2022.03) ActFormer: A GAN Transformer Framework towards General Action-Conditioned 3D Human Motion Generation, [Paper]
• (arXiv 2022.03) Transformer Inertial Poser: Attention-based Real-time Human Motion Reconstruction from Sparse IMUs, [Paper]
• (arXiv 2022.03) Spatial-Temporal Parallel Transformer for Arm-Hand Dynamic Estimation, [Paper]
• (arXiv 2022.04) HiT-DVAE: Human Motion Generation via Hierarchical Transformer Dynamical VAE, [Paper]
• (arXiv 2022.07) TENET: Transformer Encoding Network for Effective Temporal Flow on Motion Prediction, [Paper]

Mesh

• (arXiv 2022.07) Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformers, [Paper], [Code]

Multi-label

• (arXiv 2021.06) MlTr: Multi-label Classification with Transformer, [Paper], [Code]
• (arXiv 2021.07) Query2Label: A Simple Transformer Way to Multi-Label Classification, [Paper], [Code]
• (arXiv 2021.10) Transformer-based Dual Relation Graph for Multi-label Image Recognition, [Paper], [Code]
• (arXiv 2020.11) General Multi-label Image Classification with Transformers, [Paper]
• (arXiv 2022.03) Graph Attention Transformer Network for Multi-Label Image Classification, [Paper]

Multi-task/modal

• (arXiv 2021.02) Transformer is All You Need: Multimodal Multitask Learning with a Unified Transformer, [Paper], [Code]
• (arXiv 2021.04) MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding, [Paper], [Code]
• (arXiv 2021.04) Multi-Modal Fusion Transformer for End-to-End Autonomous Driving, [Paper]
• (arXiv 2021.04) VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text, [Paper]
• (arXiv 2021.04) Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning, [Paper]
• (arXiv 2021.06) Scene Transformer: A Unified Multi-task Model for Behavior Prediction and Planning, [Paper]
• (arXiv 2021.06) Spatio-Temporal Multi-Task Learning Transformer for Joint Moving Object Detection and Segmentation, [Paper]
• (arXiv 2021.06) A Transformer-based Cross-modal Fusion Model with Adversarial Training, [Paper]
• (arXiv 2021.07) Attention Bottlenecks for Multimodal Fusion, [Paper]
• (arXiv 2021.07) Target-dependent UNITER: A Transformer-Based Multimodal Language Comprehension Model for Domestic Service Robots, [Paper]
• (arXiv 2021.07) Case Relation Transformer: A Crossmodal Language Generation Model for Fetching Instructions, [Paper]
• (arXiv 2021.07) Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers, [Paper], [Code]
• (arXiv 2021.08) StrucTexT: Structured Text Understanding with Multi-Modal Transformers, [Paper]
• (arXiv 2021.08) Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representations, [Paper]
• (arXiv 2021.09) TxT: Crossmodal End-to-End Learning with Transformers, [Paper]
• (arXiv 2021.09) Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers, [Paper]
• (arXiv 2021.09) Temporal Pyramid Transformer with Multimodal Interaction for Video Question Answering, [Paper]
• (arXiv 2021.09) On Pursuit of Designing Multi-modal Transformer for Video Grounding, [Paper], [Code]
• (arXiv 2021.09) Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactions, [Paper]
• (arXiv 2021.09) KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation, [Paper]
• (arXiv 2021.10) Unifying Multimodal Transformer for Bi-directional Image and Text Generation, [Paper], [Code]
• (arXiv 2021.10) VLDeformer: Learning Visual-Semantic Embeddings by Vision-Language Transformer Decomposing, [Paper]
• (arXiv 2021.10) Detecting Dementia from Speech and Transcripts using Transformers, [Paper]
• (arXiv 2021.11) MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition, [Paper]
• (arXiv 2021.11) VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts, [Paper], [Code]
• (arXiv 2021.11) An Empirical Study of Training End-to-End Vision-and-Language Transformers, [Paper], [Code]
• (arXiv 2021.11) CLIP2TV: An Empirical Study on Transformer-based Methods for Video-Text Retrieval, [Paper]
• (arXiv 2021.11) Graph Relation Transformer: Incorporating pairwise object features into the Transformer architecture, [Paper], [Code1], [Code2]
• (arXiv 2021.11) UFO: A UniFied TransfOrmer for Vision-Language Representation Learning, [Paper]
• (arXiv 2021.11) Multi-modal Transformers Excel at Class-agnostic Object Detection, [Paper], [Code]
• (arXiv 2021.11) Sparse Fusion for Multimodal Transformers, [Paper]
• (arXiv 2021.11) VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling, [Paper], [Code]
• (arXiv 2021.11) Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsing, [Paper], [Code]
• (arXiv 2021.11) PolyViT: Co-training Vision Transformers on Images, Videos and Audio, [Paper]
• (arXiv 2021.11) End-to-End Referring Video Object Segmentation with Multimodal Transformers, [Paper], [Code]
• (arXiv 2021.12) TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning, [Paper], [Code]
• (arXiv 2021.12) LMR-CBT: Learning Modality-fused Representations with CB-Transformer for Multimodal Emotion Recognition from Unaligned Multimodal Sequences, [Paper]
• (arXiv 2021.12) LAVT: Language-Aware Vision Transformer for Referring Image Segmentation, [Paper],[Code]
• (arXiv 2021.12) Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation, [Paper]
• (arXiv 2021.12) VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling, [Paper]
• (arXiv 2021.12) VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks, [Paper],[Code]
• (arXiv 2021.12) Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text, [Paper]
• (arXiv 2021.12) Distilled Dual-Encoder Model for Vision-Language Understanding, [Paper],[Code]
• (arXiv 2021.12) Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding, [Paper]
• (arXiv 2021.12) SLIP: Self-supervision meets Language-Image Pre-training, [Paper],[Code]
• (arXiv 2021.12) Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation, [Paper],[Code]
• (arXiv 2022.01) Robust Self-Supervised Audio-Visual Speech Recognition, [Paper],[Code]
• (arXiv 2022.01) Self-Training Vision Language BERTs with a Unified Conditional Model, [Paper]
• (arXiv 2022.01) Uniformer: Unified Transformer for Efficient Spatiotemporal Representation Learning, [Paper],[Code]
• (arXiv 2022.01) BridgeFormer: Bridging Video-text Retrieval with Multiple Choice Questions, [Paper],[Code]
• (arXiv 2022.01) OMNIVORE: A Single Model for Many Visual Modalities, [Paper],[Code]
• (arXiv 2022.01) A Pre-trained Audio-Visual Transformer for Emotion Recognition, [Paper]
• (arXiv 2022.01) Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition, [Paper]
• (arXiv 2022.02) Towards Weakly-Supervised Text Spotting using a Multi-Task Transformer, [Paper]
• (arXiv 2022.03) DXM-TransFuse U-net: Dual Cross-Modal Transformer Fusion U-net for Automated Nerve Identification, [Paper]
• (arXiv 2022.03) LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using Transformers for Cross-Modal Information Retrieval in Histopathology Archives, [Paper]
• (arXiv 2022.03) VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformer, [Paper],[Project]
• (arXiv 2022.03) MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization, [Paper],[Project]
• (arXiv 2022.03) Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation, [Paper]
• (arXiv 2022.03) Inverted Pyramid Multi-task Transformer for Dense Scene Understanding, [Paper]
• (arXiv 2022.03) UNIMO-2: End-to-End Unified Vision-Language Grounded Learning, [Paper],[Project]
• (arXiv 2022.03) Multi-Modal Learning for AU Detection Based on Multi-Head Fused Transformers, [Paper]
• (arXiv 2022.03) UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection, [Paper],[Project]
• (arXiv 2022.03) Multi-modal Multi-label Facial Action Unit Detection with Transformer, [Paper],[Project]
• (arXiv 2022.03) Multimodal Fusion Transformer for Remote Sensing Image Classification, [Paper]
• (arXiv 2022.03) VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers, [Paper]
• (arXiv 2022.04) MultiMAE: Multi-modal Multi-task Masked Autoencoders, [Paper],[Project]
• (arXiv 2022.04) Multi-Task Distributed Learning using Vision Transformer with Random Patch Permutation, [Paper]
• (arXiv 2022.04) MHMS: Multimodal Hierarchical Multimedia Summarization, [Paper]
• (arXiv 2022.04) Multimodal Transformer for Nursing Activity Recognition, [Paper]
• (arXiv 2022.04) Are Multimodal Transformers Robust to Missing Modality?, [Paper]
• (arXiv 2022.04) X-DETR: A Versatile Architecture for Instance-wise Vision-Language Tasks, [Paper]
• (arXiv 2022.04) Towards Lightweight Transformer via Group-wise Transformation for Vision-and-Language Tasks, [Paper]
• (arXiv 2022.04) Multimodal Token Fusion for Vision Transformers, [Paper]
• (arXiv 2022.04) Transformer Decoders with MultiModal Regularization for Cross-Modal Food Retrieval, [Paper], [Code]
• (arXiv 2022.04) ParkPredict+: Multimodal Intent and Motion Prediction for Vehicles in Parking Lots with CNN and Transformer, [Paper]
• (arXiv 2022.05) Transformer-based Cross-Modal Recipe Embeddings with Large Batch Training, [Paper]
• (arXiv 2022.05) MulT: An End-to-End Multitask Learning Transformer, [Paper]), [Project]
• (arXiv 2022.05) Training Vision-Language Transformers from Captions Alone, [Paper], [Code]
• (arXiv 2022.05) GIT: A Generative Image-to-text Transformer for Vision and Language, [Paper]
• (arXiv 2022.05) Multi-Task Learning with Multi-query Transformer for Dense Prediction, [Paper]
• (arXiv 2022.06) VL-BEIT: Generative Vision-Language Pretraining, [Paper], [Code]
• (arXiv 2022.06) AntPivot: Livestream Highlight Detection via Hierarchical Attention Mechanism, [Paper]
• (arXiv 2022.06) A Unified Sequence Interface for Vision Tasks, [Paper]
• (arXiv 2022.06) Multi-scale Cooperative Multimodal Transformers for Multimodal Sentiment Analysis in Videos, [Paper]
• (arXiv 2022.06) Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Tasks, [Paper]
• (arXiv 2022.06) M&M Mix: A Multimodal Multiview Transformer Ensemble, [Paper]
• (arXiv 2022.06) RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval, [Paper]
• (arXiv 2022.07) You Only Need One Detector: Unified Object Detector for Different Modalities based on Vision Transformers, [Paper], [Code]
• (arXiv 2022.07) Open-Vocabulary Multi-Label Classification via Multi-modal Knowledge Transfer, [Paper], [Code]
• (arXiv 2022.07) Audio−Visual Segmentation, [Paper], [Code]
• (arXiv 2022.07) FashionViL: Fashion-Focused Vision-and-Language Representation Learning, [Paper], [Code]
• (arXiv 2022.07) Multimodal Transformer for Automatic 3D Annotation and Object Detection, [Paper], [Code]
• (arXiv 2022.07) UFO: Unified Feature Optimization, [Paper], [Code]
• (arXiv 2022.07) An Ensemble Approach for Multiple Emotion Descriptors Estimation Using Multi-task Learning, [Paper]
• (arXiv 2022.07) STrajNet: Occupancy Flow Prediction via Multi-modal Swin Transformer, [Paper]

Multi-view Stereo

• (arXiv 2021.11) TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers, [Paper], [Code]
• (arXiv 2021.12) Multi-View Stereo with Transformer, [Paper]
• (arXiv 2022.04) MVSTER: Epipolar Transformer for Efficient Multi-View Stereo, [Paper], [Code]
• (arXiv 2022.05) WT-MVSNet: Window-based Transformers for Multi-view Stereo, [Paper], [Code]

NAS

• (CVPR'21) HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers, [Paper], [Code]
• (arXiv.2021.02) Towards Accurate and Compact Architectures via Neural Architecture Transformer, [Paper]
• (arXiv.2021.03) BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search, [Paper], [Code]
• (arXiv.2021.06) Vision Transformer Architecture Search, [Paper], [Code]
• (arXiv.2021.07) AutoFormer: Searching Transformers for Visual Recognition, [Paper], [Code]
• (arXiv.2021.07) GLiT: Neural Architecture Search for Global and Local Image Transformer, [Paper]
• (arXiv.2021.09) Searching for Efficient Multi-Stage Vision Transformers, [Paper]
• (arXiv.2021.10) UniNet: Unified Architecture Search with Convolution, Transformer, and MLP, [Paper]
• (arXiv.2021.11) Searching the Search Space of Vision Transformer, [Paper], [Code]
• (arXiv.2022.01) Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space, [Paper]
• (arXiv.2022.03) Vision Transformer with Convolutions Architecture Search, [Paper]
• (arXiv.2022.03) Training-free Transformer Architecture Search, [Paper]
• (arXiv.2022.06) Neural Prompt Search, [Paper]
• (arXiv.2022.07) UniNet: Unified Architecture Search with Convolution, Transformer, and MLP, [Paper], [Code]

Navigation

• (ICLR'21) VTNet: Visual Transformer Network for Object Goal Navigation, [Paper]
• (arXiv 2021.03) MaAST: Map Attention with Semantic Transformers for Efficient Visual Navigation, [Paper]
• (arXiv 2021.04) Know What and Know Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigation, [Paper]
• (arXiv 2021.05) Episodic Transformer for Vision-and-Language Navigation, [Paper]
• (arXiv 2021.07) Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World, [Paper]
• (arXiv 2021.10) SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language Navigation, [Paper]
• (arXiv 2021.10) History Aware Multimodal Transformer for Vision-and-Language Navigation, [Paper], [Code]
• (arXiv 2021.11) Multimodal Transformer with Variable-length Memory for Vision-and-Language Navigation, [Paper]
• (arXiv 2022.02) Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation, [Paper], [Project]
• (arXiv 2022.03) Monocular Robot Navigation with Self-Supervised Pretrained Vision Transformers, [Paper], [Project]
• (arXiv 2022.03) Object Memory Transformer for Object Goal Navigation, [Paper]
• (arXiv 2022.03) Target-Driven Structured Transformer Planner for Vision-Language Navigation, [Paper], [Code]

Neural Rendering

• (arXiv 2022.03) ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers, [Paper], [Code]
• (arXiv 2022.06) Generalizable Neural Radiance Fields for Novel View Synthesis with Transformer, [Paper]
• (arXiv 2022.06) IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering inIndoor Scenes, [Paper], [Code]
• (arXiv 2022.07) Vision Transformer for NeRF-Based View Synthesis from a Single Input Image, [Paper], [Project]

OCR

• (arXiv 2021.04) Handwriting Transformers, [Paper]
• (arXiv 2021.05) I2C2W: Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition, [Paper]
• (arXiv 2021.05) Vision Transformer for Fast and Efficient Scene Text Recognition, [Paper]
• (arXiv 2021.06) DocFormer: End-to-End Transformer for Document Understanding, [Paper]
• (arXiv 2021.08) A Transformer-based Math Language Model for Handwritten Math Expression Recognition, [Paper]
• (arXiv 2021.09) TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models, [Paper], [Code]
• (arXiv 2021.10) Robustness Evaluation of Transformer-based Form Field Extractors via Form Attacks, [Paper], [Code]
• (arXiv 2021.10) DocTr: Document Image Transformer for Geometric Unwarping and Illumination Correction, [Paper]
• (arXiv 2021.12) Visual-Semantic Transformer for Scene Text Recognition, [Paper]
• (arXiv 2021.12) Transformer-Based Approach for Joint Handwriting and Named Entity Recognition in Historical documents, [Paper]
• (arXiv 2021.12) SPTS: Single-Point Text Spotting, [Paper]
• (arXiv 2022.02) Arbitrary Shape Text Detection using Transformers, [Paper]
• (arXiv 2022.03) DiT: Self-supervised Pre-training for Document Image Transformer, [Paper], [Code]
• (arXiv 2022.03) TrueType Transformer: Character and Font Style Recognition in Outline Format, [Paper]
• (arXiv 2022.03) SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition, [Paper], [Code]
• (arXiv 2022.03) Transformer-based HTR for Historical Documents, [Paper]
• (arXiv 2022.04) Text Spotting Transformers, [Paper], [Code]
• (arXiv 2022.05) Arbitrary Shape Text Detection via Boundary Transformer, [Paper], [Code]
• (arXiv 2022.05) MATrIX - Modality-Aware Transformer for Information eXtraction, [Paper]
• (arXiv 2022.06) Transformer based Urdu Handwritten Text Optical Character Reader, [Paper]
• (arXiv 2022.06) SVG Vector Font Generation for Chinese Characters with Transformer, [Paper]
• (arXiv 2022.07) DPText-DETR: Towards Better Scene Text Detection with Dynamic Points in Transformer, [Paper], [Code]
• (arXiv 2022.07) CoMER: Modeling Coverage for Transformer-based Handwritten Mathematical Expression Recognition, [Paper], [Code]
• (arXiv 2022.08) Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognition, [Paper], [Code]

Octree

• (arXiv 2021.11) Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequences, [Paper], [Code]

Open Set Recognition

• (arXiv 2022.03) Open Set Recognition using Vision Transformer with an Additional Detection Head, [Paper]
• (arXiv 2022.06) OOD Augmentation May Be at Odds with Open-Set Recognition, [Paper]
• (arXiv 2022.07) Scaling Novel Object Detection with Weakly Supervised Detection Transformers, [Paper]

Optical Flow

• (arXiv 2022.03) FlowFormer: A Transformer Architecture for Optical Flow, [Paper], [Project]
• (arXiv 2022.03) CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow, [Paper], [Code]

Panoptic Segmentation

• (arXiv.2020.12) MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers, [Paper]
• (arXiv 2021.09) Panoptic SegFormer, [Paper]
• (arXiv 2021.09) PnP-DETR: Towards Efficient Visual Analysis with Transformers, [Paper], [Code]
• (arXiv 2021.10) An End-to-End Trainable Video Panoptic Segmentation Method using Transformers, [Paper]
• (arXiv 2021.12) Masked-attention Mask Transformer for Universal Image Segmentation, [Paper], [Code]
• (arXiv 2021.12) PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation, [Paper], [Code]
• (arXiv 2022.04) Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation, [Paper], [Code]
• (arXiv 2022.05) CONSENT: Context Sensitive Transformer for Bold Words Classification, [Paper]
• (arXiv 2022.05) CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation, [Paper]
• (arXiv 2022.07) k-means Mask Transformer, [Paper], [Code]
• (arXiv 2022.07) Masked-attention Mask Transformer for Universal Image Segmentation, [Paper], [Code]
• (arXiv 2022.07) Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentation, [Paper], [Code]

Point Cloud

• (ICRA'21) NDT-Transformer: Large-Scale 3D Point Cloud Localisation using the Normal Distribution Transform Representation, [Paper]
• (arXiv 2020.12) Point Transformer, [Paper]
• (arXiv 2020.12) 3D Object Detection with Pointformer, [Paper]
• (arXiv 2020.12) PCT: Point Cloud Transformer, [Paper]
• (arXiv 2021.03) You Only Group Once: Efficient Point-Cloud Processing with Token Representation and Relation Inference Module, [Paper], [Code]
• (arXiv 2021.04) Group-Free 3D Object Detection via Transformers, [Paper], [Code]
• (arXiv 2021.04) M3DETR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers, [Paper]
• (arXiv 2021.04) Dual Transformer for Point Cloud Analysis, [Paper]
• (arXiv 2021.04) Point Cloud Learning with Transformer, [Paper]
• (arXiv 2021.08) SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer, [Paper], [Code]
• (arXiv 2021.08) PTT: Point-Track-Transformer Module for 3D Single Object Tracking in Point Clouds, [Paper], [Code]
• (arXiv 2021.08) Point-Voxel Transformer: An Efficient Approach To 3D Deep Learning, [Paper], [Code]
• (arXiv 2021.08) PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformers, [Paper], [Code]
• (arXiv 2021.08) Improving 3D Object Detection with Channel-wise Transformer, [Paper], [Code]
• (arXiv 2021.09) PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Clouds, [Paper], [Code]
• (arXiv 2021.09) An End-to-End Transformer Model for 3D Object Detection, [Paper]
• (arXiv 2021.10) Spatial-Temporal Transformer for 3D Point Cloud Sequences, [Paper]
• (arXiv 2021.10) PatchFormer: A Versatile 3D Transformer Based on Patch Attention, [Paper]
• (arXiv 2021.11) CpT: Convolutional Point Transformer for 3D Point Cloud Processing, [Paper]
• (arXiv 2021.11) PU-Transformer: Point Cloud Upsampling Transformer, [Paper]
• (arXiv 2021.11) Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling, [Paper], [Code]
• (arXiv 2021.11) Adaptive Channel Encoding Transformer for Point Cloud Analysis, [Paper], [Code]
• (arXiv 2021.11) Fast Point Transformer, [Paper]
• (arXiv 2021.12) Embracing Single Stride 3D Object Detector with Sparse Transformer, [Paper], [Code]
• (arXiv 2021.12) Full Transformer Framework for Robust Point Cloud Registration with Deep Information Interaction, [Paper], [Code]
• (arXiv 2022.02) Geometric Transformer for Fast and Robust Point Cloud Registration, [Paper], [Code]
• (arXiv 2022.02) LighTN: Light-weight Transformer Network for Performance-overhead Tradeoff in Point Cloud Downsampling, [Paper]
• (arXiv 2022.02) PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-step Point Moving Paths, [Paper]
• (arXiv 2022.02) Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer, [Paper], [Code]
• (arXiv 2022.03) Spatiotemporal Transformer Attention Network for 3D Voxel Level Joint Segmentation and Motion Prediction in Point Cloud, [Paper]
• (arXiv 2022.03) 3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification, [Paper]
• (arXiv 2022.03) Masked Autoencoders for Point Cloud Self-supervised Learning, [Paper]
• (arXiv 2022.03) CodedVTR: Codebook-based Sparse Voxel Transformer with Geometric Guidance, [Paper]
• (arXiv 2022.03) Masked Discrimination for Self-Supervised Learning on Point Clouds, [Paper], [Code]
• (arXiv 2022.03) Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Clouds, [Paper], [Code]
• (arXiv 2022.03) V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer, [Paper]
• (arXiv 2022.03) REGTR: End-to-end Point Cloud Correspondences with Transformers, [Paper], [Code]
• (arXiv 2022.03) Stratified Transformer for 3D Point Cloud Segmentation, [Paper], [Code]
• (arXiv 2022.04) HiTPR: Hierarchical Transformer for Place Recognition in Point Cloud, [Paper]
• (arXiv 2022.04) Spatiality-guided Transformer for 3D Dense Captioning on Point Clouds, [Paper], [Code]
• (arXiv 2022.04) Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmap, [Paper]
• (arXiv 2022.04) VNT-Net: Rotational Invariant Vector Neuron Transformers, [Paper]
• (arXiv 2022.05) Towards Model Generalization for Monocular 3D Object Detection, [Paper]
• (arXiv 2022.05) CompleteDT: Point Cloud Completion with Dense Augment Inference Transformers, [Paper]
• (arXiv 2022.05) TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving, [Paper], [Code]
• (arXiv 2022.06) SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving, [Paper]
• (arXiv 2022.06) VN-Transformer: Rotation-Equivariant Attention for Vector Neurons, [Paper]
• (arXiv 2022.06) PST: Plant Segmentation Transformer Enhanced Phenotyping of MLS Oilseed Rape Point Cloud, [Paper]
• (arXiv 2022.07) SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformer, [Paper], [Code]
• (arXiv 2022.07) Geodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmenter, [Paper], [Code]
• (arXiv 2022.07) Graph Neural Network and Spatiotemporal Transformer Attention for 3D Video Object Detection from Point Clouds, [Paper]
• (arXiv 2022.08) Point Primitive Transformer for Long-Term 4D Point Cloud Video Understanding, [Paper]

Pose

• (arXiv 2020.12) End-to-End Human Pose and Mesh Reconstruction with Transformers, [Paper]
• (arXiv 2020.12) TransPose: Towards Explainable Human Pose Estimation by Transformer, [Paper]
• (arXiv 2021.03) 3D Human Pose Estimation with Spatial and Temporal Transformers, [Paper], [Code]
• (arXiv 2021.03) End-to-End Trainable Multi-Instance Pose Estimation with Transformers, [Paper]
• (arXiv 2021.03) Lifting Transformer for 3D Human Pose Estimation in Video, [Paper]
• (arXiv 2021.03) TFPose: Direct Human Pose Estimation with Transformers, [Paper]
• (arXiv 2021.04) Pose Recognition with Cascade Transformers, [Paper], [Code]
• (arXiv 2021.04) TokenPose: Learning Keypoint Tokens for Human Pose Estimation, [Paper]
• (arXiv 2021.04) Skeletor: Skeletal Transformers for Robust Body-Pose Estimation, [Paper]
• (arXiv 2021.04) HandsFormer: Keypoint Transformer for Monocular 3D Pose Estimation of Hands and Object in Interaction, [Paper]
• (arXiv 2021.07) Test-Time Personalization with a Transformer for Human Pose Estimation, [Paper]
• (arXiv 2021.09) Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformers, [Paper], [Code]
• (arXiv 2021.09) GraFormer: Graph Convolution Transformer for 3D Pose Estimation, [Paper], [Code]
• (arXiv 2021.09) T6D-Direct: Transformers for Multi-Object 6D Pose Direct Regression, [Paper]
• (arXiv 2021.10) 6D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learning, [Paper]
• (arXiv 2021.10) Adaptively Multi-view and Temporal Fusing Transformer for 3D Human Pose Estimation, [Paper], [Code]
• (arXiv 2021.10) HRFormer: High-Resolution Transformer for Dense Prediction, [Paper], [Code]
• (arXiv 2021.10) TransFusion: Cross-view Fusion with Transformer for 3D Human Pose Estimation, [Paper], [Code]
• (arXiv 2021.11) MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation, [Paper], [Code]
• (arXiv 2021.11) A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Pose, [Paper]
• (arXiv 2021.12) PE-former: Pose Estimation Transformer, [Paper], [Code]
• (arXiv 2021.12) Geometry-Contrastive Transformer for Generalized 3D Pose Transfer, [Paper], [Code]
• (arXiv 2021.12) DProST: 6-DoF Object Pose Estimation Using Space Carving and Dynamic Projective Spatial Transformer, [Paper], [Code]
• (arXiv 2021.12) Towards Deep Learning-based 6D Bin Pose Estimation in 3D Scans, [Paper]
• (arXiv 2021.12) End-to-End Learning of Multi-category 3D Pose and Shape Estimation, [Paper]
• (arXiv 2022.01) Swin-Pose: Swin Transformer Based Human Pose Estimation, [Paper]
• (arXiv 2022.01) Poseur: Direct Human Pose Regression with Transformers, [Paper]
• (arXiv 2022.02) HeadPosr: End-to-end Trainable Head Pose Estimation using Transformer Encoders, [Paper]
• (arXiv 2022.03) CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimation, [Paper]
• (arXiv 2022.04) BTranspose: Bottleneck Transformers for Human Pose Estimation with Self-Supervised Pre-Training, [Paper]
• (arXiv 2022.04) ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation, [Paper], [Code]
• (arXiv 2022.05) YOLOPose: Transformer-based Multi-Object 6D Pose Estimation using Keypoint Regression, [Paper]
• (arXiv 2022.05) AggPose: Deep Aggregation Vision Transformer for Infant Pose Estimation, [Paper], [Code]
• (arXiv 2022.05) VTP: Volumetric Transformer for Multi-view Multi-person 3D Pose Estimation, [Paper]
• (arXiv 2022.05) Learning Sequential Contexts using Transformer for 3D Hand Pose Estimation, [Paper]
• (arXiv 2022.07) OTPose: Occlusion-Aware Transformer for Pose Estimation in Sparsely-Labeled Videos, [Paper]

Planning

• (arXiv 2021.12) Differentiable Spatial Planning using Transformers, [Paper], [Project]

Pruning & Quantization

• (arXiv 2021.04) Visual Transformer Pruning, [Paper]
• (arXiv 2021.06) Post-Training Quantization for Vision Transformer, [Paper]
• (arXiv 2021.11) PTQ4ViT: Post-Training Quantization Framework for Vision Transformers, [Paper], [Code]
• (arXiv 2021.11) FQ-ViT: Fully Quantized Vision Transformer without Retraining, [Paper]
• (arXiv 2022.01) Q-ViT: Fully Differentiable Quantization for Vision Transformer, [Paper]
• (arXiv 2022.03) Patch Similarity Aware Data-Free Quantization for Vision Transformers, [Paper]
• (arXiv 2022.03) CP-ViT: Cascade Vision Transformer Pruning via Progressive Sparsity Prediction, [Paper]
• (arXiv 2022.07) I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference, [Paper]

Recognition

• (arXiv 2021.03) Global Self-Attention Networks for Image Recognition, [Paper]
• (arXiv 2021.03) TransFG: A Transformer Architecture for Fine-grained Recognition, [Paper]
• (arXiv 2021.05) Are Convolutional Neural Networks or Transformers more like human vision, [Paper]
• (arXiv 2021.07) Transformer with Peak Suppression and Knowledge Guidance for Fine-grained Image Recognition, [Paper]
• (arXiv 2021.07) RAMS-Trans: Recurrent Attention Multi-scale Transformer for Fine-grained Image Recognition, [Paper]
• (arXiv 2021.08) DPT: Deformable Patch-based Transformer for Visual Recognition, [Paper], [Code]
• (arXiv 2021.10) A free lunch from ViT: Adaptive Attention Multi-scale Fusion Transformer for Fine-grained Visual Recognition, [Paper]
• (arXiv 2021.10) MVT: Multi-view Vision Transformer for 3D Object Recognition, [Paper]
• (arXiv 2021.11) AdaViT: Adaptive Vision Transformers for Efficient Image Recognition, [Paper]
• (arXiv 2022.01) TransVPR: Transformer-based place recognition with multi-level attention aggregation, [Paper]
• (arXiv 2022.03) MetaFormer : A Unified Meta Framework for Fine-Grained Recognition, [Paper], [Code]
• (arXiv 2022.04) Diverse Instance Discovery: Vision-Transformer for Instance-Aware Multi-Label Image Recognition, [Paper], [Code]
• (arXiv 2022.07) Forensic License Plate Recognition with Compression-Informed Transformers, [Paper], [Code]

Reconstruction

• (arXiv 2021.03) Multi-view 3D Reconstruction with Transformer, [Paper]
• (arXiv 2021.06) THUNDR: Transformer-based 3D HUmaN Reconstruction with Markers, [Paper]
• (arXiv 2021.06) LegoFormer: Transformers for Block-by-Block Multi-view 3D Reconstruction, [Paper]
• (arXiv 2021.07) TransformerFusion: Monocular RGB Scene Reconstruction using Transformers, [Paper]
• (arXiv 2021.10) 3D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformers, [Paper], [Code]
• (arXiv 2021.11) Reference-based Magnetic Resonance Image Reconstruction Using Texture Transformer, [Paper]
• (arXiv 2021.11) HEAT: Holistic Edge Attention Transformer for Structured Reconstruction, [Paper]
• (arXiv 2021.12) VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusion, [Paper], [Code]
• (arXiv 2022.03) RayTran: 3D pose estimation and shape reconstruction of multiple objects from videos with ray-traced transformers, [Paper]
• (arXiv 2022.05) 3D-C2FT: Coarse-to-fine Transformer for Multi-view 3D Reconstruction, [Paper]
• (arXiv 2022.05) HeatER: An Efficient and Unified Network for Human Reconstruction via Heatmap-based TransformER, [Paper]
• (arXiv 2022.06) Extreme Floorplan Reconstruction by Structure-Hallucinating Transformer Cascades, [Paper]

Registration

• (arXiv 2021.04) ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration, [Paper], [Code]
• (arXiv 2022.02) A Transformer-based Network for Deformable Medical Image Registration, [Paper]
• (arXiv 2022.03) Affine Medical Image Registration with Coarse-to-Fine Vision Transformer, [Paper], [Code]
• (arXiv 2022.04) Symmetric Transformer-based Network for Unsupervised Image Registration, [Paper], [Code]

Re-identification

• (arXiv 2021.02) TransReID: Transformer-based Object Re-Identification, [Paper]
• (arXiv 2021.03) Spatiotemporal Transformer for Video-based Person Re-identification, [Paper]
• (arXiv 2021.04) AAformer: Auto-Aligned Transformer for Person Re-Identification, [Paper]
• (arXiv 2021.04) A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identification, [Paper]
• (arXiv 2021.06) Transformer-Based Deep Image Matching for Generalizable Person Re-identification, [Paper]
• (arXiv 2021.06) Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer, [Paper]
• (arXiv 2021.06) Person Re-Identification with a Locally Aware Transformer, [Paper]
• (arXiv 2021.07) Learning Disentangled Representation Implicitly via Transformer for Occluded Person Re-Identification, [Paper], [Code]
• (arXiv 2021.07) GiT: Graph Interactive Transformer for Vehicle Re-identification, [Paper]
• (arXiv 2021.07) HAT: Hierarchical Aggregation Transformers for Person Re-identification, [Paper]
• (arXiv 2021.09) Pose-guided Inter- and Intra-part Relational Transformer for Occluded Person Re-Identification, [Paper]
• (arXiv 2021.09) OH-Former: Omni-Relational High-Order Transformer for Person Re-Identification, [Paper]
• (arXiv 2021.10) CMTR: Cross-modality Transformer for Visible-infrared Person Re-identification, [Paper]
• (arXiv 2021.11) Self-Supervised Pre-Training for Transformer-Based Person Re-Identification, [Paper], [Code]
• (arXiv 2021.12) Pose-guided Feature Disentangling for Occluded Person Re-identification Based on Transformer, [Paper], [Code]
• (arXiv 2022.01) Short Range Correlation Transformer for Occluded Person Re-Identification, [Paper]
• (arXiv 2022.02) Motion-Aware Transformer For Occluded Person Re-identification, [Paper]
• (arXiv 2022.04) PSTR: End-to-End One-Step Person Search With Transformers, [Paper], [Code]
• (arXiv 2022.04) NFormer: Robust Person Re-identification with Neighbor Transformer, [Paper], [Code]

Restoration

• (arXiv 2021.06) Uformer: A General U-Shaped Transformer for Image Restoration, [Paper], [Code]
• (arXiv 2021.08) SwinIR: Image Restoration Using Swin Transformer, [Paper], [Code]
• (arXiv 2021.11) Restormer: Efficient Transformer for High-Resolution Image Restoration, [Paper], [Code]
• (arXiv 2021.12) U2-Former: A Nested U-shaped Transformer for Image Restoration, [Paper], [Code]
• (arXiv 2021.12) SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-Trained Siamese Transformers, [Paper]

Retrieval

• (CVPR'21') Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformers, [Paper]
• (arXiv 2021.01) Investigating the Vision Transformer Model for Image Retrieval Tasks, [Paper]
• (arXiv 2021.02) Training Vision Transformers for Image Retrieval, [Paper]
• (arXiv 2021.03) Instance-level Image Retrieval using Reranking Transformers, [Paper]
• (arXiv 2021.04) Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval, [Paper]
• (arXiv 2021.04) Self-supervised Video Retrieval Transformer Network, [Paper]
• (arXiv 2021.05) TransHash: Transformer-based Hamming Hashing for Efficient Image Retrieval, [Paper], [Code]
• (arXiv 2021.06) Towards Efficient Cross-Modal Visual Textual Retrieval using Transformer-Encoder Deep Features, [Paper]
• (arXiv 2021.06) All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers, [Paper], [Code]
• (arXiv 2021.09) Vision Transformer Hashing for Image Retrieval, [Paper]
• (arXiv 2022.01) Zero-Shot Sketch Based Image Retrieval using Graph Transformer, [Paper]
• (arXiv 2022.07) TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval, [Paper], [Code]

Robotic

• (arXiv 2022.01) Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation, [Paper], [Code]
• (arXiv 2022.02) When Transformer Meets Robotic Grasping: Exploits Context for Efficient Grasp Detection, [Paper], [Code]
• (arXiv 2022.07) 3D Part Assembly Generation with Instance Encoded Transformer, [Paper]

Salient Object Detection

• (arXiv 2021.04) Transformer Transforms Salient Object Detection and Camouflaged Object Detection, [Paper]
• (arXiv 2021.04) Visual Saliency Transformer, [Paper]
• (arXiv 2021.04) CoSformer: Detecting Co-Salient Object with Transformers, [Paper]
• (arXiv 2021.08) Unifying Global-Local Representations in Salient Object Detection with Transformer, [Paper], [Code]
• (arXiv 2021.08) TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Network, [Paper], [Code]
• (arXiv 2021.08) Boosting Salient Object Detection with Transformer-based Asymmetric Bilateral U-Net, [Paper]
• (arXiv 2021.12) Transformer-based Network for RGB-D Saliency Detection, [Paper]
• (arXiv 2021.12) MTFNet: Mutual-Transformer Fusion Network for RGB-D Salient Object Detection, [Paper]
• (arXiv 2021.12) Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction, [Paper]
• (arXiv 2022.03) DFTR: Depth-supervised Hierarchical Feature Fusion Transformer for Salient Object Detection, [Paper]
• (arXiv 2022.03) GroupTransNet: Group Transformer Network for RGB-D Salient Object Detection, [Paper]
• (arXiv 2022.03) Unsupervised Salient Object Detection with Spectral Cluster Voting, [Paper], [Code]
• (arXiv 2022.05) SelfReformer: Self-Refined Network with Transformer for Salient Object Detection, [Paper]
• (arXiv 2022.06) Dual Swin-Transformer based Mutual Interactive Network for RGB-D Salient Object Detection, [Paper]
• (arXiv 2022.07) TANet: Transformer-based Asymmetric Network for RGB-D Salient Object Detection, [Paper], [Code]
• (arXiv 2022.07) Mirror Complementary Transformer Network for RGB-thermal Salient Object Detection, [Paper], [Code]
• (arXiv 2022.07) SiaTrans: Siamese Transformer Network for RGB-D Salient Object Detection with Depth Image Classification, [Paper]

Scene

• (arXiv 2020.12) SceneFormer: Indoor Scene Generation with Transformers, [Paper]
• (arXiv 2021.05) SCTN: Sparse Convolution-Transformer Network for Scene Flow Estimation, [Paper]
• (arXiv 2021.06) P2T: Pyramid Pooling Transformer for Scene Understanding, [Paper], [Code]
• (arXiv 2021.07) Scenes and Surroundings: Scene Graph Generation using Relation Transformer, [Paper]
• (arXiv 2021.07) Spatial-Temporal Transformer for Dynamic Scene Graph Generation, [Paper]
• (arXiv 2021.09) BGT-Net: Bidirectional GRU Transformer Network for Scene Graph Generation, [Paper]
• (arXiv 2021.11) Compositional Transformers for Scene Generation, [Paper]
• (arXiv 2021.11) Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations, [Paper], [Project]
• (arXiv 2021.12) SGTR: End-to-end Scene Graph Generation with Transformer, [Paper]
• (arXiv 2022.01) RelTR: Relation Transformer for Scene Graph Generation, [Paper], [Code]
• (arXiv 2022.03) Relationformer: A Unified Framework for Image-to-Graph Generation, [Paper]
• (arXiv 2022.05) ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions, [Paper], [Code]
• (arXiv 2022.06) Object Scene Representation Transformer, [Paper], [Project]

Self-supervised Learning

• (arXiv 2021.03) Can Vision Transformers Learn without Natural Images? [Paper], [Code]
• (arXiv 2021.04) An Empirical Study of Training Self-Supervised Visual Transformers, [Paper]
• (arXiv 2021.04) SiT: Self-supervised vIsion Transformer, [Paper]], [Code]
• (arXiv 2021.04) VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text, [Paper], [Code]
• (arXiv 2021.04) Emerging Properties in Self-Supervised Vision Transformers, [Paper], [Code]
• (arXiv 2021.05) Self-Supervised Learning with Swin Transformers, [Paper], [Code]
• (arXiv 2021.06) MST: Masked Self-Supervised Transformer for Visual Representation, [Paper]
• (arXiv 2021.06) Efficient Self-supervised Vision Transformers for Representation Learning, [Paper]
• (arXiv 2021.09) Localizing Objects with Self-Supervised Transformers and no Labels, [Paper]
• (arXiv 2021.10) Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learning, [Paper], [Code]
• (arXiv 2022.01) RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-training, [Paper], [Code]
• (arXiv 2022.02) Self-Supervised Transformers for Unsupervised Object Discovery using Normalized Cut, [Paper], [Project]
• (arXiv 2022.03) Mugs: A Multi-Granular Self-Supervised Learning Framework, [Paper], [Code]
• (arXiv 2022.04) A Transformer-Based Contrastive Learning Approach for Few-Shot Sign Language Recognition, [Paper]
• (arXiv 2022.04) DILEMMA: Self-Supervised Shape and Texture Learning with Transformers, [Paper]
• (arXiv 2022.04) Self-supervised Vision Transformers for Joint SAR-optical Representation Learning, [Paper]
• (arXiv 2022.05) UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog, [Paper]
• (arXiv 2022.05) Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality, [Paper], [Code]
• (arXiv 2022.05) Self-Supervised Pre-training of Vision Transformers for Dense Prediction Tasks, [Paper], [Code]
• (arXiv 2022.05) A Closer Look at Self-supervised Lightweight Vision Transformers, [Paper]
• (arXiv 2022.06) Where are my Neighbors? Exploiting Patches Relations in Self-Supervised Vision Transformer, [Paper], [Code]
• (arXiv 2022.06) Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning, [Paper], [Code]
• (arXiv 2022.06) Exploring Feature Self-relation for Self-supervised Transformer, [Paper]
• (arXiv 2022.06) Position Labels for Self-Supervised Vision Transformer, [Paper]
• (arXiv 2022.06) Adapting Self-Supervised Vision Transformers by Probing Attention-Conditioned Masking Consistency, [Paper], [Code]
• (arXiv 2022.06) Patch-level Representation Learning for Self-supervised Vision Transformers, [Paper], [Code]
• (arXiv 2022.07) Hierarchically Self-Supervised Transformer for Human Skeleton Representation Learning, [Paper], [Code]

Semantic Segmentation

• (arXiv 2020.12) Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers, [Paper], [Code]
• (arXiv 2021.01) Trans2Seg: Transparent Object Segmentation with Transformer, [Paper], [Code]
• (arXiv 2021.05) Segmenter: Transformer for Semantic Segmentation, [Paper], [Code]
• (arXiv 2021.06) SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers, [Paper], [Code]
• (arXiv 2021.06) Fully Transformer Networks for Semantic Image Segmentation, [Paper]
• (arXiv 2021.06) Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images, [Paper]
• (arXiv 2021.06) OffRoadTranSeg: Semi-Supervised Segmentation using Transformers on OffRoad environments, [Paper]
• (arXiv 2021.07) Looking Outside the Window: Wider-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images, [Paper]
• (arXiv 2021.07) A Unified Efficient Pyramid Transformer for Semantic Segmentation, [Paper]
• (arXiv 2021.08) Boosting Few-shot Semantic Segmentation with Transformers, [Paper], [Code]
• (arXiv 2021.08) Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformer, [Paper], [Code]
• (arXiv 2021.08) Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentation, [Paper], [Code]
• (arXiv 2021.08) Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistance, [Paper], [Code]
• (arXiv 2021.08) Evaluating Transformer based Semantic Segmentation Networks for Pathological Image Segmentation, [Paper]
• (arXiv 2021.08) Semantic Segmentation on VSPW Dataset through Aggregation of Transformer Models, [Paper]
• (arXiv 2021.09) Efficient Hybrid Transformer: Learning Global-local Context for Urban Sence Segmentation, [Paper]
• (arXiv 2021.11) HRViT: Multi-Scale High-Resolution Vision Transformer, [Paper]
• (arXiv 2021.11) Dynamically pruning segformer for efficient semantic segmentation, [Paper]
• (arXiv 2021.11) APANet: Adaptive Prototypes Alignment Network for Few-Shot Semantic Segmentation, [Paper]
• (arXiv 2021.11) Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers, [Paper]
• (arXiv 2021.11) GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentation, [Paper]
• (arXiv 2021.12) iSegFormer: Interactive Image Segmentation with Transformers, [Paper], [Code]
• (arXiv 2021.12) SeMask: Semantically Masked Transformers for Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.01) Lawin Transformer: Improving Semantic Segmentation Transformer with Multi-Scale Representations via Large Window Attention, [Paper], [Code]
• (arXiv 2022.01) Pyramid Fusion Transformer for Semantic Segmentation, [Paper]
• (arXiv 2022.01) Dual-Flattening Transformers through Decomposed Row and Column Queries for Semantic Segmentation, [Paper]
• (arXiv 2022.01) GroupViT: Semantic Segmentation Emerges from Text Supervision, [Paper], [Code]
• (arXiv 2022.03) Transformer-based Knowledge Distillation for Efficient Semantic Segmentation of Road-driving Scenes, [Paper], [Code]
• (arXiv 2022.03) Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.03) Multi-class Token Transformer for Weakly Supervised Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.03) Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformers, [Paper], [Code]
• (arXiv 2022.03) BEVSegFormer: Bird’s Eye View Semantic Segmentation From Arbitrary Camera Rigs, [Paper]
• (arXiv 2022.03) CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers, [Paper], [Code]
• (arXiv 2022.03) TransCAM: Transformer Attention-based CAM Refinement for Weakly Supervised Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.03) Smoothing Matters: Momentum Transformer for Domain Adaptive Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.03) WegFormer: Transformers for Weakly Supervised Semantic Segmentation, [Paper]
• (arXiv 2022.03) StructToken : Rethinking Semantic Segmentation with Structural Prior, [Paper]
• (arXiv 2022.03) Feature Selective Transformer for Semantic Image Segmentation, [Paper]
• (arXiv 2022.03) Semantic Segmentation by Early Region Proxy, [Paper], [Code]
• (arXiv 2022.03) ReSTR: Convolution-free Referring Image Segmentation Using Transformers, [Paper], [Code]
• (arXiv 2022.03) Dynamic Focus-aware Positional Queries for Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.03) TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.04) Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers, [Paper], [Code]
• (arXiv 2022.05) Cross-view Transformers for real-time Map-view Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.05) Transformer Scale Gate for Semantic Segmentation, [Paper]
• (arXiv 2022.06) Discovering Object Masks with Transformers for Unsupervised Semantic Segmentation, [Paper], [Code]
• (arXiv 2022.06) Semantic Labeling of High Resolution Images Using EfficientUNets and Transformers, [Paper]
• (arXiv 2022.07) Improving Semantic Segmentation in Transformers using Hierarchical Inter-Level Attention, [Paper], [Code]
• (arXiv 2022.07) Self-attention on Multi-Shifted Windows for Scene Segmentation, [Paper], [Code]
• (arXiv 2022.07) eX-ViT: A Novel eXplainable Vision Transformer for Weakly Supervised Semantic Segmentation, [Paper]
• (arXiv 2022.07) Visual Representation Learning with Transformer: A Sequence-to-Sequence Perspective, [Paper], [Code]

Shape

• (WACV'21) End-to-end Lane Shape Prediction with Transformers, [Paper], [Code]
• (arXiv 2022.01) ShapeFormer: Transformer-based Shape Completion via Sparse Representation, [Paper], [Project]
• (arXiv 2022.03) AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation, [Paper], [Code]

SLAM

• (arXiv 2022.06) AFT-VO: Asynchronous Fusion Transformers for Multi-View Visual Odometry Estimation, [Paper]

Super-Resolution

• (CVPR'20) Learning Texture Transformer Network for Image Super-Resolution, [Paper], [Code]
• (arXiv 2021.06) LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation, [Paper]
• (arXiv 2021.06) Video Super-Resolution Transformer, [Paper], [Code]
• (arXiv 2021.08) Light Field Image Super-Resolution with Transformers, [Paper], [Code]
• (arXiv 2021.08) Efficient Transformer for Single Image Super-Resolution, [Paper]
• (arXiv 2021.09) Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution, [Paper]
• (arXiv 2021.12) Implicit Transformer Network for Screen Content Image Continuous Super-Resolution, [Paper]
• (arXiv 2021.12) On Efficient Transformer and Image Pre-training for Low-level Vision, [Paper], [Code]
• (arXiv 2022.01) Detail-Preserving Transformer for Light Field Image Super-Resolution, [Paper], [Code]
• (arXiv 2022.03) Rich CNN-Transformer Feature Aggregation Networks for Super-Resolution, [Paper]
• (arXiv 2022.03) HIPA: Hierarchical Patch Transformer for Single Image Super Resolution, [Paper]
• (arXiv 2022.03) RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolution, [Paper], [Code]
• (arXiv 2022.04) Learning Trajectory-Aware Transformer for Video Super-Resolution, [Paper], [Code]
• (arXiv 2022.04) BSRT: Improving Burst Super-Resolution with Swin Transformer and Flow-Guided Deformable Alignment, [Paper], [Code]
• (arXiv 2022.04) Self-Calibrated Efficient Transformer for Lightweight Super-Resolution, [Paper], [Code]
• (arXiv 2022.04) CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution, [Paper]
• (arXiv 2022.04) A New Dataset and Transformer for Stereoscopic Video Super-Resolution, [Paper], [Code]
• (arXiv 2022.04) Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformer, [Paper], [Code]
• (arXiv 2022.05) Activating More Pixels in Image Super-Resolution Transformer, [Paper], [Code]
• (arXiv 2022.06) Bilateral Network with Channel Splitting Network and Transformer for Thermal Image Super-Resolution, [Paper]
• (arXiv 2022.07) Rethinking Alignment in Video Super-Resolution Transformers, [Paper], [Code]
• (arXiv 2022.07) Reference-based Image Super-Resolution with Deformable Attention Transformer, [Paper], [Code]

Synthesis

• (arXiv 2020.12) Taming Transformers for High-Resolution Image Synthesis, [Paper], [Code]
• (arXiv 2021.04) Geometry-Free View Synthesis: Transformers and no 3D Priors, [Paper]
• (arXiv 2021.05) High-Resolution Complex Scene Synthesis with Transformers, [Paper]
• (arXiv 2021.06) The Image Local Autoregressive Transformer, [Paper]
• (arXiv 2021.10) ATISS: Autoregressive Transformers for Indoor Scene Synthesis, [Paper], [Project]
• (arXiv 2021.11) Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers, [Paper]
• (arXiv 2022.02) MaskGIT: Masked Generative Image Transformer, [Paper]
• (arXiv 2022.07) Diverse Dance Synthesis via Keyframes with Transformer Controllers, [Paper]

Text-to-Image/Video

• (arXiv 2021.01) VisualSparta: Sparse Transformer Fragment-level Matching for Large-scale Text-to-Image Search, [Paper]
• (arXiv 2021.05) CogView: Mastering Text-to-Image Generation via Transformers, [Paper]
• (arXiv 2022.02) DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative Transformers, [Paper],[Code]
• (arXiv 2022.05) CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers, [Paper],[Code]
• (arXiv 2022.05) CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers, [Paper],[Code]

Tracking

• (EMNLP'19) Effective Use of Transformer Networks for Entity Tracking, [Paper], [Code]
• (CVPR'21) Transformer Tracking, [Paper], [Code]
• (CVPR'21) Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking, [Paper], [Code]
• (arXiv 2020.12) TransTrack: Multiple-Object Tracking with Transformer, [Paper], [Code]
• (arXiv 2021.01) TrackFormer: Multi-Object Tracking with Transformers, [Paper]
• (arXiv 2021.03) TransCenter: Transformers with Dense Queries for Multiple-Object Tracking, [Paper]
• (arXiv 2021.03) Learning Spatio-Temporal Transformer for Visual Tracking, [Paper], [Code]
• (arXiv 2021.04) Multitarget Tracking with Transformers, [Paper]
• (arXiv 2021.04) Spatial-Temporal Graph Transformer for Multiple Object Tracking, [Paper]
• (arXiv 2021.05) MOTR: End-to-End Multiple-Object Tracking with TRansformer, [Paper], [Code]
• (arXiv 2021.05) TrTr: Visual Tracking with Transformer, [Paper], [Code]
• (arXiv 2021.08) HiFT: Hierarchical Feature Transformer for Aerial Tracking, [Paper], [Code]
• (arXiv 2021.10) Siamese Transformer Pyramid Networks for Real-Time UAV Tracking, [Paper], [Code]
• (arXiv 2021.10) 3D Object Tracking with Transformer, [Paper], [Code]
• (arXiv 2021.12) SwinTrack: A Simple and Strong Baseline for Transformer Tracking, [Paper], [Code]
• (arXiv 2021.12) PTTR: Relational 3D Point Cloud Object Tracking with Transformer, [Paper], [Code]
• (arXiv 2021.12) Learning Tracking Representations via Dual-Branch Fully Transformer Networks, [Paper], [Code]
• (arXiv 2021.12) Efficient Visual Tracking with Exemplar Transformers, [Paper], [Code]
• (arXiv 2022.03) Transforming Model Prediction for Tracking, [Paper], [Code]
• (arXiv 2022.03) MixFormer: End-to-End Tracking with Iterative Mixed Attention, [Paper], [Code]
• (arXiv 2022.03) Global Tracking Transformers, [Paper], [Code]
• (arXiv 2022.03) Keypoints Tracking via Transformer Networks, [Paper], [Code]
• (arXiv 2022.03) High-Performance Transformer Tracking, [Paper], [Code]
• (arXiv 2022.03) Efficient Visual Tracking via Hierarchical Cross-Attention Transformer, [Paper], [Code]
• (arXiv 2022.03) Unified Transformer Tracker for Object Tracking, [Paper], [Code]
• (arXiv 2022.03) Global Tracking via Ensemble of Local Trackers, [Paper]
• (arXiv 2022.03) MeMOT: Multi-Object Tracking with Memory, [Paper]
• (arXiv 2022.05) SparseTT: Visual Tracking with Sparse Transformers, [Paper], [Code]
• (arXiv 2022.05) Transformer Tracking with Cyclic Shifting Window Attention, [Paper], [Code]
• (arXiv 2022.05) Transformers for Multi-Object Tracking on Point Clouds, [Paper]
• (arXiv 2022.05) Joint Spatial-Temporal and Appearance Modeling with Transformer for Multiple Object Tracking, [Paper], [Code]
• (arXiv 2022.07) AiATrack: Attention in Attention for Transformer Visual Tracking, [Paper], [Code]
• (arXiv 2022.07) 3D Siamese Transformer Network for Single Object Tracking on Point Clouds, [Paper], [Code]
• (arXiv 2022.08) Local Perception-Aware Transformer for Aerial Tracking, [Paper], [Code]

Traffic

• (arXiv 2021.05) Novelty Detection and Analysis of Traffic Scenario Infrastructures in the Latent Space of a Vision Transformer-Based Triplet Autoencoder, [Paper]
• (arXiv 2021.11) DetectorNet: Transformer-enhanced Spatial Temporal Graph Neural Network for Traffic Prediction, [Paper]
• (arXiv 2021.11) ProSTformer: Pre-trained Progressive Space-Time Self-attention Model for Traffic Flow Forecasting, [Paper]
• (arXiv 2022.01) SwinUNet3D -- A Hierarchical Architecture for Deep Traffic Prediction using Shifted Window Transformers, [Paper], [Code]
• (arXiv 2022.02) TransFollower: Long-Sequence Car-Following Trajectory Prediction through Transformer, [Paper]
• (arXiv 2022.03) LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Prediction, [Paper]
• (arXiv 2022.03) Under the Hood of Transformer Networks for Trajectory Forecasting, [Paper]
• (arXiv 2022.05) HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encoding, [Paper]
• (arXiv 2022.06) S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Driving, [Paper], [Code]
• (arXiv 2022.07) Pyramid Transformer for Traffic Sign Detection, [Paper], [Code]
• (arXiv 2022.07) Applying Spatiotemporal Attention to Identify Distracted and Drowsy Driving with Vision Transformers, [Paper]
• (arXiv 2022.07) Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer, [Paper]

Transfer learning

• (arXiv 2021.06) Transformer-Based Source-Free Domain Adaptation, [Paper], [Code]
• (arXiv 2021.08) TVT: Transferable Vision Transformer for Unsupervised Domain Adaptation, [Paper]
• (arXiv 2021.09) CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation, [Paper]
• (arXiv 2021.10) Investigating Transfer Learning Capabilities of Vision Transformers and CNNs by Fine-Tuning a Single Trainable Block, [Paper]
• (arXiv 2021.10) Dispensed Transformer Network for Unsupervised Domain Adaptation, [Paper]
• (arXiv 2021.11) Exploiting Both Domain-specific and Invariant Knowledge via a Win-win Transformer for Unsupervised Domain Adaptation, [Paper]
• (arXiv 2021.12) Pre-Training Transformers for Domain Adaptation, [Paper]
• (arXiv 2022.01) Domain Adaptation via Bidirectional Cross-Attention Transformer, [Paper]
• (arXiv 2022.03) Towards Unsupervised Domain Adaptation via Domain-Transformer, [Paper]
• (arXiv 2022.03) DATR: Domain-adaptive transformer for multi-domain landmark detection, [Paper]
• (arXiv 2022.03) simCrossTrans: A Simple Cross-Modality Transfer Learning for Object Detection with ConvNets or Vision Transformers, [Paper], [Code]
• (arXiv 2022.04) Safe Self-Refinement for Transformer-based Domain Adaptation, [Paper], [Code]
• (arXiv 2022.05) Improving Transferability for Domain Adaptive Detection Transformers, [Paper], [Code]
• (arXiv 2022.05) Cross-Domain Object Detection with Mean-Teacher Transformer, [Paper]
• (arXiv 2022.06) Cross-domain Detection Transformer based on Spatial-aware and Semantic-aware Token Alignment, [Paper]

Translation

• (arXiv 2021.10) Tensor-to-Image: Image-to-Image Translation with Vision Transformers, [Paper]
• (arXiv 2022.03) UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation, [Paper], [Code]
• (arXiv 2022.03) InstaFormer: Instance-Aware Image-to-Image Translation with Transformer, [Paper]
• (arXiv 2022.03) ITTR: Unpaired Image-to-Image Translation with Transformers, [Paper]

Texture

• (arXiv 2021.09) 3D Human Texture Estimation from a Single Image with Transformers, [Paper], [Code]
• (arXiv 2022.02) Paying U-Attention to Textures: Multi-Stage Hourglass Vision Transformer for Universal Texture Synthesis, [Paper]

Unsupervised learning

• (arXiv 2022.02) Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Images, [Paper]
• (arXiv 2022.07) SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery, [Paper]

Video

• (ECCV'20) Multi-modal Transformer for Video Retrieval, [Paper]
• (ICLR'21) Support-set bottlenecks for video-text representation learning, [Paper]
• (arXiv 2021.01) SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation, [Paper]
• (arXiv 2021.02) Video Transformer Network, [Paper]
• (arXiv 2021.02) Is Space-Time Attention All You Need for Video Understanding? [Paper], [Code]
• (arXiv.2021.02) A Straightforward Framework For Video Retrieval Using CLIP, [Paper], [Code]
• (arXiv 2021.03) Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning, [Paper]
• (arXiv 2021.03) Enhancing Transformer for Video Understanding Using Gated Multi-Level Attention and Temporal Adversarial Training, [Paper]
• (arXiv 2021.03) MDMMT: Multidomain Multimodal Transformer for Video Retrieval, [Paper]
• (arXiv 2021.03) An Image is Worth 16x16 Words, What is a Video Worth? [Paper]
• (arXiv 2021.03) ViViT: A Video Vision Transformer, [paper]
• (arXiv 2021.04) Composable Augmentation Encoding for Video Representation Learning, [Paper]
• (arXiv 2021.04) Temporal Query Networks for Fine-grained Video Understanding, [Paper], [Project]
• (arXiv 2021.04) Higher Order Recurrent Space-Time Transformer, [Paper], [Code]
• (arXiv 2021.04) VideoGPT: Video Generation using VQ-VAE and Transformers, [Paper], [Code]
• (arXiv 2021.04) VidTr: Video Transformer Without Convolutions, [Paper]
• (arXiv 2021.05) Local Frequency Domain Transformer Networks for Video Prediction, [Paper]
• (arXiv 2021.05) End-to-End Video Object Detection with Spatial-Temporal Transformers, [Paper], [Code]
• (arXiv 2021.06) Anticipative Video Transformer, [Paper], [Project]
• (arXiv 2021.06) TransVOS: Video Object Segmentation with Transformers, [Paper]
• (arXiv 2021.06) Associating Objects with Transformers for Video Object Segmentation, [Paper]
• (arXiv 2021.06) Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers, [Paper]
• (arXiv 2021.06) Space-time Mixing Attention for Video Transformer, [Paper]
• (arXiv 2021.06) Video Instance Segmentation using Inter-Frame Communication Transformers, [Paper]
• (arXiv 2021.06) Long-Short Temporal Contrastive Learning of Video Transformers, [Paper]
• (arXiv 2021.06) Video Swin Transformer, [Paper], [Code]
• (arXiv 2021.06) Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detection, [Paper]
• (arXiv 2021.07) Ultrasound Video Transformers for Cardiac Ejection Fraction Estimation, [Paper], [Code]
• (arXiv 2021.07) Generative Video Transformer: Can Objects be the Words, [Paper]
• (arXiv 2021.07) Convolutional Transformer based Dual Discriminator Generative Adversarial Networks for Video Anomaly Detection, [Paper]
• (arXiv 2021.08) Token Shift Transformer for Video Classification, [Paper], [Code]
• (arXiv 2021.08) Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering, [Paper]
• (arXiv 2021.08) Video Relation Detection via Tracklet based Visual Transformer, [Paper], [Code]
• (arXiv 2021.08) MM-ViT: Multi-Modal Video Transformer for Compressed Video Action Recognition, [Paper]
• (arXiv 2021.08) ZS-SLR: Zero-Shot Sign Language Recognition from RGB-D Videos, [Paper]
• (arXiv 2021.09) FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting, [Paper], [Code]
• (arXiv 2021.09) Hierarchical Multimodal Transformer to Summarize Videos, [Paper]
• (arXiv 2021.10) Object-Region Video Transformers, [Paper], [Code]
• (arXiv 2021.10) Can't Fool Me: Adversarially Robust Transformer for Video Understanding, [Paper], [Code]
• (arXiv 2021.11) Livestock Monitoring with Transformer, [Paper]
• (arXiv 2021.11) Sparse Adversarial Video Attacks with Spatial Transformations, [Paper], [Code]
• (arXiv 2021.11) PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer, [Paper], [Code]
• (arXiv 2021.11) Efficient Video Transformers with Spatial-Temporal Token Selection, [Paper]
• (arXiv 2021.11) Video Frame Interpolation Transformer, [Paper]
• (arXiv 2021.12) Self-supervised Video Transformer, [Paper], [Code]
• (arXiv 2021.12) BEVT: BERT Pretraining of Video Transformers, [Paper]
• (arXiv 2021.12) TBN-ViT: Temporal Bilateral Network with Vision Transformer for Video Scene Parsing, [Paper]
• (arXiv 2021.12) Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval, [Paper]
• (arXiv 2021.12) DualFormer: Local-Global Stratified Transformer for Efficient Video Recognition, [Paper]
• (arXiv 2021.12) A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformer, [Paper], [Code]
• (arXiv 2021.12) Mask2Former for Video Instance Segmentation, [Paper], [Code]
• (arXiv 2021.12) LocFormer: Enabling Transformers to Perform Temporal Moment Localization on Long Untrimmed Videos With a Feature Sampling Approach, [Paper]
• (arXiv 2021.12) Video Joint Modelling Based on Hierarchical Transformer for Co-summarization, [Paper]
• (arXiv 2021.12) Siamese Network with Interactive Transformer for Video Object Segmentation, [Paper], [Code]
• (arXiv 2022.01) Multiview Transformers for Video Recognition,[Paper]
• (arXiv 2022.01) TransVOD: End-to-end Video Object Detection with Spatial-Temporal Transformers,[Paper]
• (arXiv 2022.01) MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition,[Paper]
• (arXiv 2022.01) Explore and Match: End-to-End Video Grounding with Transformer,[Paper]
• (arXiv 2022.01) VRT: A Video Restoration Transformer,[Paper], [Code]
• (arXiv 2022.02) Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval, [Paper], [Code]
• (arXiv 2022.02) Audio Visual Scene-Aware Dialog Generation with Transformer-based Video Representations, [Paper]
• (arXiv 2022.02) Instantaneous Physiological Estimation using Video Transformers, [Paper], [Code]
• (arXiv 2022.03) Spatio-temporal Vision Transformer for Super-resolution Microscopy, [Paper], [Code]
• (arXiv 2022.03) ViTransPAD: Video Transformer using convolution and self-attention for Face Presentation Attack Detection, [Paper]
• (arXiv 2022.03) End-to-End Video Text Spotting with Transformer, [Paper], [Code]
• (arXiv 2022.03) Associating Objects with Scalable Transformers for Video Object Segmentation, [Paper], [Code]
• (arXiv 2022.03) Self-supervised Video-centralised Transformer for Video Face Clustering, [Paper]
• (arXiv 2022.03) VPTR: Efficient Transformers for Video Prediction, [Paper], [Code]
• (arXiv 2022.03) Deformable Video Transformer, [Paper]
• (arXiv 2022.04) Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer, [Paper], [Code]
• (arXiv 2022.05) Video Frame Interpolation with Transformer, [Paper], [Code]
• (arXiv 2022.05) TubeFormer-DeepLab: Video Mask Transformer, [Paper]
• (arXiv 2022.06) Recurrent Video Restoration Transformer with Guided Deformable Attention, [Paper], [Code]
• (arXiv 2022.06) Patch-based Object-centric Transformers for Efficient Video Generation, [Paper], [Code]
• (arXiv 2022.06) Transformer-based Self-Supervised Fish Segmentation in Underwater Videos, [Paper]
• (arXiv 2022.06) MaskViT: Masked Visual Pre-Training for Video Prediction, [Paper], [Code]
• (arXiv 2022.07) STVGFormer: Spatio-Temporal Video Grounding with Static-Dynamic Cross-Modal Understanding, [Paper]
• (arXiv 2022.07) Dual-Stream Transformer for Generic Event Boundary Captioning, [Paper], [Code]
• (arXiv 2022.07) Cross-Attention Transformer for Video Interpolation, [Paper], [Code]
• (arXiv 2022.07) Snipper: A Spatiotemporal Transformer for Simultaneous Multi-Person 3D Pose Estimation Tracking and Forecasting on a Video Snippet, [Paper], [Code]
• (arXiv 2022.07) Time Is MattEr: Temporal Self-supervision for Video Transformers, [Paper], [Code]
• (arXiv 2022.07) TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolation, [Paper], [Code]
• (arXiv 2022.07) DeVIS: Making Deformable Transformers Work for Video Instance Segmentation, [Paper], [Code]
• (arXiv 2022.07) Video Swin Transformers for Egocentric Video Understanding @ Ego4D Challenges 2022, [Paper]

Visual Grounding

• (arXiv 2021.04) TransVG: End-to-End Visual Grounding with Transformers, [Paper]
• (arXiv 2021.05) Visual Grounding with Transformers, [Paper]
• (arXiv 2021.06) Referring Transformer: A One-step Approach to Multi-task Visual Grounding, [Paper]
• (arXiv 2021.08) Word2Pix: Word to Pixel Cross Attention Transformer in Visual Grounding, [Paper]
• (arXiv 2021.08) TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual Grounding, [Paper]
• (arXiv 2021.09) Multimodal Incremental Transformer with Visual Grounding for Visual Dialogue Generation, [Paper]
• (arXiv 2022.02) ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer, [Paper]
• (arXiv 2022.03) TubeDETR: Spatio-Temporal Video Grounding with Transformers, [Paper], [Code]
• (arXiv 2022.04) Multi-View Transformer for 3D Visual Grounding, [Paper], [Code]
• (arXiv 2022.06) TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer, [Paper], [Code]

Visual Question Answering

• (arXiv 2021.12) LaTr: Layout-Aware Transformer for Scene-Text VQA, [Paper]
• (arXiv 2022.01) On the Efficacy of Co-Attention Transformer Layers in Visual Question Answering, [Paper]
• (arXiv 2022.01) Transformer Module Networks for Systematic Generalization in Visual Question Answering, [Paper]
• (arXiv 2022.01) Towards Efficient and Elastic Visual Question Answering with Doubly Slimmable Transformer, [Paper]
• (arXiv 2022.04) Hypergraph Transformer: Weakly-supervised Multi-hop Reasoning for Knowledge-based Visual Question Answering, [Paper], [Code]
• (arXiv 2022.06) DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessment, [Paper], [Code]
• (arXiv 2022.06) Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer, [Paper], [Code]
• (arXiv 2022.07) Weakly Supervised Grounding for VQA in Vision-Language Transformers, [Paper], [Code]
• (arXiv 2022.07) Video Graph Transformer for Video Question Answering, [Paper], [Code]

Visual Reasoning

• (arXiv 2021.11) Recurrent Vision Transformer for Solving Visual Reasoning Problems, [Paper]
• (arXiv 2022.04) RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning, [Paper], [Code]
• (arXiv 2022.06) SAViR-T: Spatially Attentive Visual Reasoning with Transformers, [Paper]

Visual Relationship Detection

• (arXiv 2021.04) RelTransformer: Balancing the Visual Relationship Detection from Local Context, Scene and Memory, [Paper]
• (arXiv 2021.05) Visual Composite Set Detection Using Part-and-Sum Transformers, [Paper]
• (arXiv 2021.08) Discovering Spatial Relationships by Transformers for Domain Generalization, [Paper]
• (arXiv 2022.06) VReBERT: A Simple and Flexible Transformer for Visual Relationship Detection, [Paper]

Voxel

• (arXiv 2021.05) SVT-Net: A Super Light-Weight Network for Large Scale Place Recognition using Sparse Voxel Transformers, [Paper]
• (arXiv 2021.09) Voxel Transformer for 3D Object Detection, [Paper]
• (arXiv 2022.06) Unifying Voxel-based Representation with Transformer for 3D Object Detection, [Paper], [Code]

Weakly Supervised Learning

• (arXiv 2021.12) LCTR: On Awakening the Local Continuity of Transformer for Weakly Supervised Object Localization, [Paper]
• (arXiv 2022.01) CaFT: Clustering and Filter on Tokens of Transformer for Weakly Supervised Object Localization, [Paper]
• (arXiv 2022.04) ViTOL: Vision Transformer for Weakly Supervised Object Localization, [Paper], [Code]
• (arXiv 2022.07) Weakly Supervised Object Localization via Transformer with Implicit Spatial Calibration, [Paper], [Code]

Zero-Shot Learning

• (arXiv 2021.08) Multi-Head Self-Attention via Vision Transformer for Zero-Shot Learning, [Paper]
• (arXiv 2021.12) Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks, [Paper]
• (arXiv 2021.12) TransZero: Attribute-guided Transformer for Zero-Shot Learning, [Paper], [Code]
• (arXiv 2021.12) TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning, [Paper], [Code]
• (arXiv 2022.03) Hybrid Routing Transformer for Zero-Shot Learning, [Paper]

Others

• (CVPR'21') Transformer Interpretability Beyond Attention Visualization, [Paper], [Code]
• (CVPR'21') Pre-Trained Image Processing Transformer, [Paper]
• (ICCV'21) PlaneTR: Structure-Guided Transformers for 3D Plane Recovery, [Paper], [Code]
• (arXiv 2021.01) Learn to Dance with AIST++: Music Conditioned 3D Dance Generation, [Paper], [Code]
• (arXiv 2021.01) Transformer Guided Geometry Model for Flow-Based Unsupervised Visual Odometry, [Paper]
• (arXiv 2021.04) Cloth Interactive Transformer for Virtual Try-On, [Paper], [Code]
• (arXiv 2021.04) Fourier Image Transformer, [Paper], [Code]
• (arXiv 2021.05) Attention for Image Registration (AiR): an unsupervised Transformer approach, [Paper]
• (arXiv 2021.05) IntFormer: Predicting pedestrian intention with the aid of the Transformer architecture, [Paper]
• (arXiv 2021.06) A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer, [Paper]
• (arXiv 2021.06) Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information, [Paper]
• (arXiv 2021.06) StyTr2: Unbiased Image Style Transfer with Transformers, [Paper]
• (arXiv 2021.06) Semantic Correspondence with Transformers, [Paper]
• (arXiv 2021.06) Unified Questioner Transformer for Descriptive Question Generation in Goal-Oriented Visual Dialogue, [Paper]
• (arXiv 2021.07) Grid Partitioned Attention: Efficient Transformer Approximation with Inductive Bias for High Resolution Detail Generation, [Paper], [Code]
• (arXiv 2021.07) Image Fusion Transformer, [Paper], [Code]
• (arXiv 2021.07) PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution, [Paper]
• (arXiv 2021.07) PPT Fusion: Pyramid Patch Transformer for a Case Study in Image Fusion, [Paper]
• (arXiv 2021.08) Applications of Artificial Neural Networks in Microorganism Image Analysis: A Comprehensive Review from Conventional Multilayer Perceptron to Popular Convolutional Neural Network and Potential Visual Transformer, [Paper]
• (arXiv 2021.08) Paint Transformer: Feed Forward Neural Painting with Stroke Prediction, [Paper], [Code]
• (arXiv 2021.08) The Right to Talk: An Audio-Visual Transformer Approach, [Paper], [Code]
• (arXiv 2021.08) Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion, [Paper], [Code]
• (arXiv 2021.08) Vision-Language Transformer and Query Generation for Referring Segmentation, [Paper], [Code]
• (arXiv 2021.08) Investigating transformers in the decomposition of polygonal shapes as point collections, [Paper]
• (arXiv 2021.08) Convolutional Neural Network (CNN) vs Visual Transformer (ViT) for Digital Holography, [Paper]
• (arXiv 2021.08) Construction material classification on imbalanced datasets for construction monitoring automation using Vision Transformer (ViT) architecture, [Paper]
• (arXiv 2021.08) Spatial Transformer Networks for Curriculum Learning, [Paper]
• (arXiv 2021.09) TransforMesh: A Transformer Network for Longitudinal modeling of Anatomical Meshes, [Paper]
• (arXiv 2021.09) CTRL-C: Camera calibration TRansformer with Line-Classification, [Paper], [Code]
• (arXiv 2021.09) The Animation Transformer: Visual Correspondence via Segment Matching, [Paper]
• (arXiv 2021.09) Semi-Supervised Wide-Angle Portraits Correction by Multi-Scale Transformer, [Paper]
• (arXiv 2021.09) PETA: Photo Albums Event Recognition using Transformers Attention, [Paper], [Code]
• (arXiv 2021.10) ProTo: Program-Guided Transformer for Program-Guided Tasks, [Paper]
• (arXiv 2021.10) TranSalNet: Visual saliency prediction using transformers, [Paper]
• (arXiv 2021.10) Development and testing of an image transformer for explainable autonomous driving systems, [Paper]
• (arXiv 2021.10) Leveraging redundancy in attention with Reuse Transformers, [Paper]
• (arXiv 2021.10) Vis-TOP: Visual Transformer Overlay Processor, [Paper]
• (arXiv 2021.10) TNTC: two-stream network with transformer-based complementarity for gait-based emotion recognition, [Paper]
• (arXiv 2021.11) The self-supervised channel-spatial attention-based transformer network for automated, accurate prediction of crop nitrogen status from UAV imagery, [Paper]
• (arXiv 2021.11) TRIG: Transformer-Based Text Recognizer with Initial Embedding Guidance, [Paper]
• (arXiv 2021.11) Grounded Situation Recognition with Transformers, [Paper], [Code]
• (arXiv 2021.11) Ice hockey player identification via transformers, [Paper]
• (arXiv 2021.11) Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes, [Paper]
• (arXiv 2021.11) Attention-based Dual-stream Vision Transformer for Radar Gait Recognition,[Paper]
• (arXiv 2021.11) TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions,[Paper], [Code]
• (arXiv 2021.11) BuildFormer: Automatic building extraction with vision transformer,[Paper]
• (arXiv 2021.12) DoodleFormer: Creative Sketch Drawing with Transformers,[Paper]
• (arXiv 2021.12) Transformer based trajectory prediction,[Paper]
• (arXiv 2021.12) Deep ViT Features as Dense Visual Descriptors,[Paper], [Project]
• (arXiv 2021.12) Hformer: Hybrid CNN-Transformer for Fringe Order Prediction in Phase Unwrapping of Fringe Projection,[Paper]
• (arXiv 2021.12) 3D Question Answering,[Paper]
• (arXiv 2021.12) Light Field Neural Rendering,[Paper], [Project]
• (arXiv 2021.12) Nonlinear Transform Source-Channel Coding for Semantic Communications, [Paper]
• (arXiv 2021.12) APRIL: Finding the Achilles' Heel on Privacy for Vision Transformers, [Paper]
• (arXiv 2022.01) Splicing ViT Features for Semantic Appearance Transfer, [Paper], [Project]
• (arXiv 2022.01) A Transformer-Based Siamese Network for Change Detection, [Paper], [Code]
• (arXiv 2022.01) Learning class prototypes from Synthetic InSAR with Vision Transformers, [Paper]
• (arXiv 2022.01) Swin transformers make strong contextual encoders for VHR image road extraction, [Paper]
• (arXiv 2022.01) Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners, [Paper]
• (arXiv 2022.01) Spectral Compressive Imaging Reconstruction Using Convolution and Spectral Contextual Transformer, [Paper]
• (arXiv 2022.01) VAQF: Fully Automatic Software-hardware Co-design Framework for Low-bit Vision Transformer, [Paper]
• (arXiv 2022.01) Continual Transformers: Redundancy-Free Attention for Online Inference, [Paper]
• (arXiv 2022.01) Disentangled Latent Transformer for Interpretable Monocular Height Estimation, [Paper], [Code]
• (arXiv 2022.01) A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localization, [Paper], [Code]
• (arXiv 2022.01) Transformer-based SAR Image Despeckling, [Paper], [Code]
• (arXiv 2022.01) Pre-Trained Language Transformers are Universal Image Classifiers, [Paper]
• (arXiv 2022.01) Dual-Tasks Siamese Transformer Framework for Building Damage Assessment, [Paper]
• (arXiv 2022.01) DocSegTr: An Instance-Level End-to-End Document Image Segmentation Transformer, [Paper]
• (arXiv 2022.01) Generalised Image Outpainting with U-Transformer, [Paper]
• (arXiv 2022.02) Spherical Transformer, [Paper]
• (arXiv 2022.02) Exploiting Spatial Sparsity for Event Cameras with Visual Transformers, [Paper]
• (arXiv 2022.02) Spatial Transformer K-Means, [Paper]
• (arXiv 2022.02) RNGDet: Road Network Graph Detection by Transformer in Aerial Images, [Paper]
• (arXiv 2022.02) Image-to-Graph Transformers for Chemical Structure Recognition, [Paper]
• (arXiv 2022.02) ProFormer: Learning Data-efficient Representations of Body Movement with Prototype-based Feature Augmentation and Visual Transformers, [Paper], [Code]
• (arXiv 2022.03) TableFormer: Table Structure Understanding with Transformers, [Paper]
• (arXiv 2022.03) Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology, [Paper]
• (arXiv 2022.03) A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detection, [Paper], [Code]
• (arXiv 2022.03) PreTR: Spatio-Temporal Non-Autoregressive Trajectory Prediction Transformer, [Paper]
• (arXiv 2022.03) Cascade Transformers for End-to-End Person Search, [Paper], [Code]
• (arXiv 2022.03) SepTr: Separable Transformer for Audio Spectrogram Processing, [Paper], [Code]
• (arXiv 2022.03) CNNs and Transformers Perceive Hybrid Images Similar to Humans, [Paper], [Code]
• (arXiv 2022.03) Disentangling Patterns and Transformations from One Sequence of Images with Shape-invariant Lie Group Transformer, [Paper]
• (arXiv 2022.03) ViT-FOD: A Vision Transformer based Fine-grained Object Discriminator, [Paper]
• (arXiv 2022.03) Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysis, [Paper]
• (arXiv 2022.04) Event Transformer. A sparse-aware solution for efficient event data processing, [Paper]
• (arXiv 2022.04) OutfitTransformer: Learning Outfit Representations for Fashion Recommendation, [Paper]
• (arXiv 2022.04) Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition, [Paper]
• (arXiv 2022.04) Event Transformer, [Paper]
• (arXiv 2022.04) Residual Swin Transformer Channel Attention Network for Image Demosaicing, [Paper]
• (arXiv 2022.04) Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer, [Paper]
• (arXiv 2022.04) DRT: A Lightweight Single Image Deraining Recursive Transformer, [Paper]
• (arXiv 2022.04) ClothFormer:Taming Video Virtual Try-on in All Module, [Paper], [Code]
• (arXiv 2022.04) Deeper Insights into ViTs Robustness towards Common Corruptions, [Paper]
• (arXiv 2022.04) Self-Driving Car Steering Angle Prediction: Let Transformer Be a Car Again, [Paper]
• (arXiv 2022.05) Where in the World is this Image? Transformer-based Geo-localization in the Wild, [Paper]
• (arXiv 2022.05) Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis, [Paper]
• (arXiv 2022.05) SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbation, [Paper]
• (arXiv 2022.05) SymFormer: End-to-end symbolic regression using transformer-based architecture, [Paper]
• (arXiv 2022.05) Surface Analysis with Vision Transformers, [Paper]
• (arXiv 2022.06) Draft-and-Revise: Effective Image Generation with Contextual RQ-Transformer, [Paper]
• (arXiv 2022.06) Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Prediction, [Paper], [Code]
• (arXiv 2022.06) Learning to Estimate Shapley Values with Vision Transformers, [Paper]
• (arXiv 2022.06) CtrlFormer: Learning Transferable State Representation for Visual Control via Transformer, [Paper]
• (arXiv 2022.06) SpA-Former:Transformer image shadow detection and removal via spatial attention, [Paper]
• (arXiv 2022.06) CRFormer: A Cross-Region Transformer for Shadow Removal, [Paper]
• (arXiv 2022.07) Interaction Transformer for Human Reaction Generation, [Paper]
• (arXiv 2022.07) FishFormer: Annulus Slicing-based Transformer for Fisheye Rectification with Efficacy Domain Exploration, [Paper]
• (arXiv 2022.07) MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing, [Paper]
• (arXiv 2022.07) Earthformer: Exploring Space-Time Transformers for Earth System Forecasting, [Paper]
• (arXiv 2022.07) Trans4Map: Revisiting Holistic Top-down Mapping from Egocentric Images to Allocentric Semantics with Vision Transformers, [Paper], [Code]
• (arXiv 2022.07) DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generation, [Paper], [Code]
• (arXiv 2022.07) Imaging through the Atmosphere using Turbulence Mitigation Transformer, [Paper], [Project]
• (arXiv 2022.07) iColoriT: Towards Propagating Local Hint to the Right Region in Interactive Colorization by Leveraging Vision Transformer, [Paper]
• (arXiv 2022.07) Learning Parallax Transformer Network for Stereo Image JPEG Artifacts Removal, [Paper]
• (arXiv 2022.07) Explainable vision transformer enabled convolutional neural network for plant disease identification: PlantXViT, [Paper]
• (arXiv 2022.07) Magic ELF: Image Deraining Meets Association Learning and Transformer, [Paper], [Code]
• (arXiv 2022.07) Self-Distilled Vision Transformer for Domain Generalization, [Paper], [Code]
• (arXiv 2022.07) Online Continual Learning with Contrastive Vision Transformer, [Paper]

Contact & Feedback

If you have any suggestions about this project, feel free to contact me.

• [e-mail: yzhangcst[at]gmail.com]