vision-transformer

There are 24 repositories under vision-transformer topic.

open-mmlab / mmdetection
OpenMMLab Detection Toolbox and Benchmark
object-detection instance-segmentation fast-rcnn faster-rcnn mask-rcnn cascade-rcnn ssd retinanet pytorch panoptic-segmentation rtmdet semisupervised-learning swin-transformer transformer vision-transformer yolo convnext detr glip grounding-dino
Language:Python 31674
LaTeX-OCR
lukas-blecher / LaTeX-OCR
pix2tex: Using a ViT to convert images of equations into LaTeX code.
machine-learning transformer im2latex deep-learning image2text latex dataset pytorch im2markup ocr latex-ocr vit math-ocr vision-transformer image-processing python im2text
Language:Python 15258
NielsRogge / Transformers-Tutorials
This repository contains demos I made with the Transformers library by HuggingFace.
transformers pytorch bert vision-transformer layoutlm gpt-2
Language:Jupyter Notebook 11220
FoundationVision / VAR
[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
auto-regressive-model diffusion-models image-generation transformers autoregressive-models generative-ai generative-model gpt gpt-2 large-language-models vision-transformer neurips
Language:Jupyter Notebook 8393
omniparse
adithya-s-k / omniparse
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
ingestion-api ocr omniparser parse-server parser-library vision-transformer web-crawler whisper-api
Language:Python 6687
JingyunLiang / SwinIR
SwinIR: Image Restoration Using Swin Transformer (official repository)
image-super-resolution image-denoising compression-artifact-reduction image-deblocking transformer real-world-image-super-resolution lightweight-image-super-resolution image-restoration low-level-vision vision-transformer image-sr restoration super-resolution denoising deblocking decompression
Language:Python 5074
cmhungsteve / Awesome-Transformer-Attention
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer computer-vision papers attention-mechanisms self-attention vit detr transformers
4926
huawei-noah / Efficient-AI-Backbones
Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
convolutional-neural-networks efficient-inference imagenet model-compression tensorflow pytorch ghostnet transformer pretrained-models vision-transformer
Language:Python 4305
open-mmlab / mmpretrain
OpenMMLab Pre-training Toolbox and Benchmark
image-classification resnet mobilenet pytorch deep-learning swin-transformer beit clip constrastive-learning convnext mae masked-image-modeling moco pretrained-models self-supervised-learning vision-transformer multimodal
Language:Python 3741
google-research / scenic
Scenic: A Jax Library for Computer Vision Research and Beyond
jax computer-vision deep-learning research attention transformers vision-transformer
Language:Python 3661
towhee-io / towhee
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
machine-learning convolutional-networks embedding-vectors embeddings computer-vision image-processing video-processing feature-extraction image-retrieval unstructured-data feature-vector transformer milvus towhee vision-transformer vit pipeline llm
Language:Python 3422
mit-han-lab / efficientvit
Efficient vision foundation models for high-resolution generation and perception.
high-resolution imagenet efficientvit segment-anything segmentation vision-transformer deep-compression-autoencoder efficient-diffusion-model
Language:Python 3067
InternLM / InternLM-XComposer
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
chatgpt visual-language-learning multi-modality foundation gpt-4 instruction-tuning mllm multimodal vision-language-model language-model large-language-model large-vision-language-model llm vision-transformer gpt supervised-finetuning
Language:Python 2892
baaivision / EVA
EVA Series: Visual Representation Fantasies from BAAI
foundation-models representation-learning vision-transformer
Language:Python 2568
OpenGVLab / InternVideo
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
foundation-models video-understanding vision-transformer action-recognition masked-autoencoder multimodal open-set-recognition spatio-temporal-action-localization temporal-action-localization video-question-answering video-retrieval zero-shot-classification zero-shot-retrieval benchmark contrastive-learning self-supervised instruction-tuning video-data video-dataset video-clip
Language:Python 2048
alibaba / EasyCV
An all-in-one toolkit for computer vision
self-supervised-learning transformers classification computer-vision object-detection pytorch vision-transformer
Language:Python 1891
hila-chefer / Transformer-Explainability
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
attention-matrix attention-visualization bert bert-model cvpr2021 deep-learning explainability perturbation transformer-interpretability vision-transformer visualize-classifications vit
Language:Jupyter Notebook 1870
microsoft / Cream
This is a collection of our NAS and Vision Transformer work.
nas automl vision-transformer rpe vit-compression efficiency knowledge-distillation
Language:Python 1741
ViTAE-Transformer / ViTPose
The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"
deep-learning distillation mae pose-estimation pytorch self-supervised-learning vision-transformer
Language:Python 1737
NVlabs / MambaVision
[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
deep-learning foundation-models image-classification mamba self-attention vision-transformer visual-recognition hybrid-models huggingface-transformers transformers instance-segmentation object-detection semantic-segmentation
Language:Python 1727
Blaizzy / mlx-vlm
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
llava llm mlx vision-transformer apple-silicon idefics local-ai paligemma vision-framework vision-language-model florence2 molmo pixtral
Language:Python 1633
MCG-NJU / VideoMAE
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
self-supervised-learning action-recognition video-understanding masked-autoencoder transformer vision-transformer video-transformer mae pytorch video-representation-learning video-analysis neurips-2022
Language:Python 1570
JingyunLiang / VRT
VRT: A Video Restoration Transformer (official repository)
deblurring denoising low-level-vision restoration sr super-resolution transformer video video-deblurring video-denoising video-restoration video-sr video-super-resolution vision-transformer
Language:Python 1429
czczup / ViT-Adapter
[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions
adapter object-detection semantic-segmentation vision-transformer
Language:Python 1352
emcf / thepipe
Get clean data from tricky documents, powered by vision-language models ⚡
multimodal pdf vision-transformer large-language-models web scrapers document openai python scraping vision-language-model structured-data unstructured-data
Language:Python 1300
yitu-opensource / T2T-ViT
ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
t2t-transformer vision-transformer vit
Language:Jupyter Notebook 1184
pprp / awesome-attention-mechanism-in-cv
Awesome List of Attention Modules and Plug&Play Modules in Computer Vision
pytorch-attention attention-model attention-mechanisms implementation vision-transformer plugandplay computer-vision
Language:Python 1166
NVlabs / VoxFormer
Official PyTorch implementation of VoxFormer [CVPR 2023 Highlight]
3d-scene-understanding artificial-intelligence autonomous-driving autonomous-vehicles computer-vision semantic-scene-completion vision-transformer 3d-perception occupancy-grid-map machine-learning voxel-proceessing 2d-to-3d deep-learning semantickitti
Language:Python 1106
OFA-Sys / ONE-PEACE
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
foundation-models multimodal representation-learning vision-language audio-language vision-and-language vision-transformer contrastive-loss
Language:Python 1052
jacobgil / vit-explain
Explainability for Vision Transformers
vision-transformer pytorch explainable-ai deep-learning transformer
Language:Python 1003
uncbiag / Awesome-Foundation-Models
A curated list of foundation models for vision and language tasks
foundation-models vision-transformer large-language-models transformer-models multimodal-models
974
WangLibo1995 / GeoSeg
UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery, ISPRS. Also, including other vision transformers and CNNs for satellite, aerial image and UAV image segmentation.
pytorch-lightning remote-sensing-image vision-transformer deep-learning pytorch timm cnn segmentation semantic-segmentation
Language:Python 951
sithu31296 / semantic-segmentation
SOTA Semantic Segmentation Models in PyTorch
semantic-segmentation pytorch transformer vision-transformer cityscapes ade20k camvid coco-stuff pascal-context deep-learning dataset
Language:Python 929
hustvl / YOLOS
[NeurIPS 2021] You Only Look at One Sequence
computer-vision object-detection transformer vision-transformer
Language:Jupyter Notebook 862
NVlabs / FasterViT
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
ade20k backbone coco deep-learning foundation-models image-classification image-net object-detection pre-trained-model self-attention semantic-segmentation vision-transformer visual-recognition
Language:Python 841
LeapLabTHU / DAT
Repository of Vision Transformer with Deformable Attention (CVPR2022) and DAT++: Spatially Dynamic Vision Transformerwith Deformable Attention
deep-learning deformable-attention image-classification pytorch vision-transformer
Language:Python 840