masked-image-modeling

There are 8 repositories under masked-image-modeling topic.

open-mmlab / mmpretrain
OpenMMLab Pre-training Toolbox and Benchmark
image-classification resnet mobilenet pytorch deep-learning swin-transformer beit clip constrastive-learning convnext mae masked-image-modeling moco pretrained-models self-supervised-learning vision-transformer multimodal
Language:Python 3764
open-mmlab / mmselfsup
OpenMMLab Self-Supervised Learning Toolbox and Benchmark
self-supervised-learning unsupervised-learning pytorch moco simclr simsiam mae masked-image-modeling beit
Language:Python 3288
SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert cnn convnet convolutional-neural-networks deep-learning iclr iclr2023 instance-segmentation mae mask-rcnn masked-autoencoder masked-image-modeling object-detection pre-trained-model pretrain pretraining pytorch self-supervised-learning sparse-convolution ssl
Language:Python 1361
microsoft / SimMIM
This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling".
self-supervised-learning masked-image-modeling image-classification swin-transformer
Language:Python 1004
Westlake-AI / openmixup
CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
pytorch awesome-list awesome-mim awesome-mixup contrastive-learning data-augmentation image-classifcation imagenet masked-image-modeling mixup self-supervised-learning semi-supervised-learning vision-transformer deep-learning benchmark automix data-generation machine-learning
Language:Python 658
Alpha-VL / ConvMAE
ConvMAE: Masked Convolution Meets Masked Autoencoders
backbone computer-vision masked-image-modeling object-detection semantic-segmentation mae
Language:Python 518
Lupin1998 / Awesome-MIM
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
awesome-list awesome-mim masked-image-modeling self-supervised-learning vision-transformer masked-autoencoder computer-vision deep-learning pre-training bert gpt generative-models mae masked-modeling representation-learning
Language:Python 347
hustvl / MIMDet
[ICCV 2023] You Only Look at One Partial Sequence
computer-vision object-detection vision-transformer masked-image-modeling mae transformer instance-segmentation
Language:Python 342
implus / UM-MAE
Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
ade20k coco hierarchical-vision-transformer imagenet-classification mae masked-autoencoder masked-image-modeling pyramid-vision-transformer self-supervised-learning swin-transformer
Language:Jupyter Notebook 244
lxtGH / CAE
This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"
context-autoencoder masked-image-modeling self-supervised-learning
Language:Python 198
LayneH / GreenMIM
[NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.
efficient-deep-learning masked-image-modeling pytorch self-supervised-learning vision-transformer
Language:Python 175
Sense-X / MixMIM
MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning
masked-image-modeling transformer
Language:Python 146
dvlab-research / MOOD
Official PyTorch implementation of MOOD series: (1) MOODv1: Rethinking Out-of-distributionDetection: Masked Image Modeling Is All You Need. (2) MOODv2: Masked Image Modeling for Out-of-Distribution Detection.
outlier-detection cvpr2023 ood-detection pytorch masked-image-modeling
Language:Python 135
Atten4Vis / CAE
This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"
context-autoencoder masked-image-modeling self-supervised-learning vision-transformer
Language:Python 118
salesforce / MUST
PyTorch code for MUST
clip masked-image-modeling self-training unsupervised-learning zero-shot-classification zero-shot-learning
Language:Python 107
Haochen-Wang409 / HPM
[CVPR'23 & TPAMI'25] Hard Patches Mining for Masked Image Modeling & Bootstrap Masked Visual Modeling via Hard Patch Mining
ade20k coco computer-vision cvpr2023 imagenet masked-autoencoder masked-image-modeling pattern-recognition self-supervised-learning unsupervised-learning
Language:Python 105
mae-scalable-vision-learners
ariG23498 / mae-scalable-vision-learners
A TensorFlow 2.x implementation of Masked Autoencoders Are Scalable Vision Learners
tensorflow2 keras self-supervised-learning autoencoder masked-image-modeling
Language:Jupyter Notebook 84
liuxingbin / dbot
[ICLR2024] Exploring Target Representations for Masked Autoencoders
dbot ssl masked-image-modeling unsupervised-learning representation-learning
Language:Python 57
aicip / Cross-Scale-MAE
[NIPS'23] Official Code of the paper "Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensing"
computer-vision masked-image-modeling remote-sensing representation-learning self-supervised-learning
Language:Python 49
bwconrad / can
PyTorch reimplementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".
contrastive-learning masked-image-modeling pytorch pytorch-lightning self-supervised-learning
Language:Python 39
FengheTan9 / MambaMIM
[MedIA 2025] MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentation
mamba mamba-state-space-models masked-image-modeling medical-image-segmentation medical-imaging
Language:Python 37
stoneMo / DeepAVFusion
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
attention-mechanism audio-visual-correspondence audio-visual-learning multimodal-learning self-supervised-learning sound-source-localization sound-source-separation transformer-architecture masked-autoencoder masked-image-modeling
Language:Python 34
haofanwang / awesome-vision-language-modeling
Recent Advances in Vision-Language Pre-training!
vision-language pre-training masked-language-models masked-image-modeling
29
Westlake-AI / A2MIM
[ICML 2023] Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN
convolutional-neural-networks imagenet masked-image-modeling pytorch self-supervised-learning vision-transformer masked-autoencoder autoregressive mae object-detection semantic-segmentation transfer-learning a2mim
Language:Python 28
AndreaCossu / continual-pretraining-nlp-vision
Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357
continual-learning forgetting image-classification lifelong-learning masked-image-modeling masked-language-models pretrained-models qnli self-supervised senteval sentiment-analysis transformers
Language:Jupyter Notebook 22
FengheTan9 / Hi-End-MAE
[MedIA 2025] Hi-End-MAE: Hierarchical encoder-driven masked autoencoders are stronger vision learners for medical image segmentation
foundation-models masked-autoencoder masked-image-modeling medical-image-analysis medical-image-segmentation self-supervised-learning
Language:Python 22
lixiaotong97 / mc-BEiT
[ECCV 2022] Official pytorch implementation of "mc-BEiT: Multi-choice Discretization for Image BERT Pre-training" in European Conference on Computer Vision (ECCV) 2022.
eccv2022 masked-image-modeling pre-training
Language:Python 22
FengheTan9 / HySparK
[MICCAI 2024] HySparK: Hybrid Sparse Masking for Large Scale Medical Image Pre-Training
hybrid-model masked-image-modeling medical-image-segmentation medical-imaging self-supervised-learning cnn transformer
Language:Python 21
JunlinHan / CropMix
Code of CropMix: Sampling a Rich Input Distribution via Multi-Scale Cropping
computer-vision contrastive-learning data-augmentation deep-learning image-classification machine-learning masked-image-modeling representation-learning self-supervised-learning
Language:Jupyter Notebook 17
AndyShih12 / mac
PyTorch implementation for "Training and Inference on Any-Order Autoregressive Models the Right Way", NeurIPS 2022 Oral, TPM 2023 Best Paper Honorable Mention
autoregressive-models generative-models masked-image-modeling masked-language-modeling pytorch tractable-inference tractable-models any-order-autoregressive-models
Language:Python 15
yifanzhang-pro / M-MAE
[ICML 2024] Matrix Variational Masked Autoencoder (M-MAE) for ICML paper "Information Flow in Self-Supervised Learning" (https://arxiv.org/abs/2309.17281)
masked-autoencoder masked-image-modeling non-contrastive-learning self-supervised-learning foundation-models pretraining
Language:Python 15
LumenPallidium / energy_transformer
Pytorch implementation of an energy transformer - an energy-based reccurrent variant of the transformer.
energy-transformer hopfield-network masked-image-modeling pytorch transformer
Language:Python 14
mkang315 / PK-YOLO
[WACV'25] Official implementation of "PK-YOLO: Pretrained Knowledge Guided YOLO for Brain Tumor Detection in Multiplane MRI Slices".
br35h-brain-tumor-detection-2020 computer-vision-algorithms deep-learning-framework deep-neural-networks detr focal-loss lesion-detection masked-autoencoder masked-image-modeling medical-image-analysis medical-image-computing medical-image-processing mri-brain multiplane-images object-detection pretrained-models pretraining self-supervised-learning sparse-convolution yolo
Language:Python 14
naver-ai / lut
[ECCV 2024] Official PyTorch implementation of LUT "Learning with Unmasked Tokens Drives Stronger Vision Learners"
eccv2024 imagenet masked-autoencoder masked-image-modeling representation-learning self-supervised-learning
Language:Python 13
asbjrnmunk / amaes
Masked Autoencoder Pretraining on 3D Brain MRI
brain-mri masked-autoencoder masked-image-modeling pretrained-models segmentation self-supervised-learning
Language:Python 11
CRazorback / MDM
[TMI'24] "Masked Deformation Modeling for Volumetric Brain MRI Self-supervised Pre-training".
diffeomorphism masked-image-modeling neuroimaging self-supervised-learning
Language:Python 8