vision-transformer

There are 30 repositories under vision-transformer topic.

open-mmlab / mmdetection
OpenMMLab Detection Toolbox and Benchmark
cascade-rcnn convnext detr fast-rcnn faster-rcnn glip grounding-dino instance-segmentation mask-rcnn object-detection panoptic-segmentation pytorch retinanet rtmdet semisupervised-learning ssd swin-transformer transformer vision-transformer yolo
Language:Python 31954
LaTeX-OCR
lukas-blecher / LaTeX-OCR
pix2tex: Using a ViT to convert images of equations into LaTeX code.
dataset deep-learning im2latex im2markup im2text image-processing image2text latex latex-ocr machine-learning math-ocr ocr python pytorch transformer vision-transformer vit
Language:Python 15920
NielsRogge / Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
bert gpt-2 layoutlm pytorch transformers vision-transformer
Language:Jupyter Notebook 11333
FoundationVision / VAR
[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
auto-regressive-model autoregressive-models diffusion-models generative-ai generative-model gpt gpt-2 image-generation large-language-models neurips transformers vision-transformer
Language:Jupyter Notebook 8471
omniparse
adithya-s-k / omniparse
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
ingestion-api ocr omniparser parse-server parser-library vision-transformer web-crawler whisper-api
Language:Python 6725
JingyunLiang / SwinIR
SwinIR: Image Restoration Using Swin Transformer (official repository)
image-super-resolution image-denoising compression-artifact-reduction image-deblocking transformer real-world-image-super-resolution lightweight-image-super-resolution image-restoration low-level-vision vision-transformer image-sr restoration super-resolution denoising deblocking decompression
Language:Python 5158
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer computer-vision papers attention-mechanisms self-attention vit detr transformers
4959
huawei-noah / Efficient-AI-Backbones
Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
convolutional-neural-networks efficient-inference ghostnet imagenet model-compression pretrained-models pytorch tensorflow transformer vision-transformer
Language:Python 4326
open-mmlab / mmpretrain
OpenMMLab Pre-training Toolbox and Benchmark
beit clip constrastive-learning convnext deep-learning image-classification mae masked-image-modeling mobilenet moco multimodal pretrained-models pytorch resnet self-supervised-learning swin-transformer vision-transformer
Language:Python 3761
google-research / scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
attention computer-vision deep-learning jax research transformers vision-transformer
Language:Python 3704
towhee-io / towhee
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
computer-vision convolutional-networks embedding-vectors embeddings feature-extraction feature-vector image-processing image-retrieval llm machine-learning milvus pipeline towhee transformer unstructured-data video-processing vision-transformer vit
Language:Python 3429
mit-han-lab / efficientvit
Efficient vision foundation models for high-resolution generation and perception.
deep-compression-autoencoder efficient-diffusion-model efficientvit high-resolution imagenet segment-anything segmentation vision-transformer
Language:Python 3121
InternLM / InternLM-XComposer
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
chatgpt visual-language-learning multi-modality foundation gpt-4 instruction-tuning mllm multimodal vision-language-model language-model large-language-model large-vision-language-model llm vision-transformer gpt supervised-finetuning
Language:Python 2899
baaivision / EVA
EVA Series: Visual Representation Fantasies from BAAI
foundation-models representation-learning vision-transformer
Language:Python 2596
OpenGVLab / InternVideo
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
foundation-models video-understanding vision-transformer action-recognition masked-autoencoder multimodal open-set-recognition spatio-temporal-action-localization temporal-action-localization video-question-answering video-retrieval zero-shot-classification zero-shot-retrieval benchmark contrastive-learning self-supervised instruction-tuning video-data video-dataset video-clip
Language:Python 2098
hila-chefer / Transformer-Explainability
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
attention-matrix attention-visualization bert bert-model cvpr2021 deep-learning explainability perturbation transformer-interpretability vision-transformer visualize-classifications vit
Language:Jupyter Notebook 1949
alibaba / EasyCV
An all-in-one toolkit for computer vision
classification computer-vision object-detection pytorch self-supervised-learning transformers vision-transformer
Language:Python 1923
NVlabs / MambaVision
[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
deep-learning foundation-models image-classification mamba self-attention vision-transformer visual-recognition hybrid-models huggingface-transformers transformers instance-segmentation object-detection semantic-segmentation
Language:Python 1844
Blaizzy / mlx-vlm
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
apple-silicon florence2 idefics llava llm local-ai mlx molmo paligemma pixtral vision-framework vision-language-model vision-transformer
Language:Python 1815
microsoft / Cream
This is a collection of our NAS and Vision Transformer work.
automl efficiency knowledge-distillation nas rpe vision-transformer vit-compression
Language:Python 1809
ViTAE-Transformer / ViTPose
The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"
deep-learning distillation mae pose-estimation pytorch self-supervised-learning vision-transformer
Language:Python 1808
MCG-NJU / VideoMAE
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
action-recognition mae masked-autoencoder neurips-2022 pytorch self-supervised-learning transformer video-analysis video-representation-learning video-transformer video-understanding vision-transformer
Language:Python 1601
JingyunLiang / VRT
VRT: A Video Restoration Transformer (official repository)
deblurring denoising low-level-vision restoration sr super-resolution transformer video video-deblurring video-denoising video-restoration video-sr video-super-resolution vision-transformer
Language:Python 1495
czczup / ViT-Adapter
[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions
adapter object-detection semantic-segmentation vision-transformer
Language:Python 1437
emcf / thepipe
Get clean data from tricky documents, powered by vision-language models ⚡
multimodal pdf vision-transformer large-language-models web scrapers document openai python scraping vision-language-model structured-data unstructured-data
Language:Python 1398
pprp / awesome-attention-mechanism-in-cv
Awesome List of Attention Modules and Plug&Play Modules in Computer Vision
pytorch-attention attention-model attention-mechanisms implementation vision-transformer plugandplay computer-vision
Language:Python 1229
yitu-opensource / T2T-ViT
ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
t2t-transformer vision-transformer vit
Language:Jupyter Notebook 1188
NVlabs / VoxFormer
Official PyTorch implementation of VoxFormer [CVPR 2023 Highlight]
3d-scene-understanding artificial-intelligence autonomous-driving autonomous-vehicles computer-vision semantic-scene-completion vision-transformer 3d-perception occupancy-grid-map machine-learning voxel-proceessing 2d-to-3d deep-learning semantickitti
Language:Python 1168
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models vision-transformer large-language-models transformer-models multimodal-models
1113
lightly-ai / lightly-train
All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.
computer-vision contrastive-learning deep-learning dinov2 dinov3 distillation embeddings eomt machine-learning object-detection pretrained-models python pytorch rtdetr rtdetrv2 self-supervised self-supervised-learning semantic-segmentation vision-transformer yolo
Language:Python 1067
OFA-Sys / ONE-PEACE
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
foundation-models multimodal representation-learning vision-language audio-language vision-and-language vision-transformer contrastive-loss
Language:Python 1053
jacobgil / vit-explain
Explainability for Vision Transformers
deep-learning explainable-ai pytorch transformer vision-transformer
Language:Python 1015
WangLibo1995 / GeoSeg
UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery, ISPRS. Also, including other vision transformers and CNNs for satellite, aerial image and UAV image segmentation.
cnn deep-learning pytorch pytorch-lightning remote-sensing-image segmentation semantic-segmentation timm vision-transformer
Language:Python 983
sithu31296 / semantic-segmentation
SOTA Semantic Segmentation Models in PyTorch
semantic-segmentation pytorch transformer vision-transformer cityscapes ade20k camvid coco-stuff pascal-context deep-learning dataset
Language:Python 928
LeapLabTHU / DAT
Repository of Vision Transformer with Deformable Attention (CVPR2022) and DAT++: Spatially Dynamic Vision Transformerwith Deformable Attention
deep-learning deformable-attention image-classification pytorch vision-transformer
Language:Python 910
hustvl / YOLOS
[NeurIPS 2021] You Only Look at One Sequence
vision-transformer transformer object-detection computer-vision
Language:Jupyter Notebook 883