masked-image-modeling

There are 8 repositories under masked-image-modeling topic.

open-mmlab / mmpretrain
OpenMMLab Pre-training Toolbox and Benchmark
image-classification resnet mobilenet pytorch deep-learning swin-transformer beit clip constrastive-learning convnext mae masked-image-modeling moco pretrained-models self-supervised-learning vision-transformer multimodal
Language:Python 3383
open-mmlab / mmselfsup
OpenMMLab Self-Supervised Learning Toolbox and Benchmark
self-supervised-learning unsupervised-learning pytorch moco simclr simsiam mae masked-image-modeling beit
Language:Python 3169
SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert convnet convolutional-neural-networks masked-image-modeling pre-trained-model self-supervised-learning sparse-convolution ssl cnn iclr iclr2023 deep-learning object-detection pytorch instance-segmentation mask-rcnn mae masked-autoencoder pretrain pretraining
Language:Python 1422
microsoft / SimMIM
This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling".
image-classification masked-image-modeling self-supervised-learning swin-transformer
Language:Python 915
Westlake-AI / openmixup
CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
automix awesome-list awesome-mim awesome-mixup benchmark contrastive-learning data-augmentation data-generation deep-learning image-classifcation imagenet machine-learning masked-image-modeling mixup pytorch self-supervised-learning semi-supervised-learning vision-transformer
Language:Python 613
Alpha-VL / ConvMAE
ConvMAE: Masked Convolution Meets Masked Autoencoders
backbone computer-vision mae masked-image-modeling object-detection semantic-segmentation
Language:Python 476
hustvl / MIMDet
[ICCV 2023] You Only Look at One Partial Sequence
computer-vision instance-segmentation mae masked-image-modeling object-detection transformer vision-transformer
Language:Python 335
Lupin1998 / Awesome-MIM
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
awesome-list awesome-mim bert computer-vision deep-learning generative-models gpt mae masked-autoencoder masked-image-modeling masked-modeling pre-training representation-learning self-supervised-learning vision-transformer
Language:Python 289
implus / UM-MAE
Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
ade20k coco hierarchical-vision-transformer imagenet-classification mae masked-autoencoder masked-image-modeling pyramid-vision-transformer self-supervised-learning swin-transformer
Language:Jupyter Notebook 238
lxtGH / CAE
This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"
context-autoencoder masked-image-modeling self-supervised-learning
Language:Python 190
LayneH / GreenMIM
[NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.
efficient-deep-learning masked-image-modeling pytorch self-supervised-learning vision-transformer
Language:Python 169
dvlab-research / MOOD
Official PyTorch implementation of MOOD series: (1) MOODv1: Rethinking Out-of-distributionDetection: Masked Image Modeling Is All You Need. (2) MOODv2: Masked Image Modeling for Out-of-Distribution Detection.
cvpr2023 masked-image-modeling ood-detection outlier-detection pytorch
Language:Python 133
Sense-X / MixMIM
MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning
masked-image-modeling transformer
Language:Python 128
salesforce / MUST
PyTorch code for MUST
clip masked-image-modeling self-training unsupervised-learning zero-shot-classification zero-shot-learning
Language:Python 105
Haochen-Wang409 / HPM
[CVPR'23] Hard Patches Mining for Masked Image Modeling
ade20k coco computer-vision cvpr2023 imagenet masked-autoencoder masked-image-modeling pattern-recognition self-supervised-learning unsupervised-learning
Language:Python 85
Atten4Vis / CAE
This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"
context-autoencoder masked-image-modeling self-supervised-learning vision-transformer
Language:Python 83
mae-scalable-vision-learners
ariG23498 / mae-scalable-vision-learners
A TensorFlow 2.x implementation of Masked Autoencoders Are Scalable Vision Learners
autoencoder keras masked-image-modeling self-supervised-learning tensorflow2
Language:Jupyter Notebook 75
liuxingbin / dbot
[ICLR2024] Exploring Target Representations for Masked Autoencoders
dbot masked-image-modeling representation-learning ssl unsupervised-learning
Language:Python 52
bwconrad / can
PyTorch reimplementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".
contrastive-learning masked-image-modeling pytorch pytorch-lightning self-supervised-learning
Language:Python 36
aicip / Cross-Scale-MAE
Official Code of the paper "Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensing"
computer-vision masked-image-modeling remote-sensing representation-learning self-supervised-learning
Language:Python 33
haofanwang / awesome-vision-language-modeling
Recent Advances in Vision-Language Pre-training!
masked-image-modeling masked-language-models pre-training vision-language
27
lixiaotong97 / mc-BEiT
[ECCV 2022] Official pytorch implementation of "mc-BEiT: Multi-choice Discretization for Image BERT Pre-training" in European Conference on Computer Vision (ECCV) 2022.
eccv2022 masked-image-modeling pre-training
Language:Python 22
Westlake-AI / A2MIM
[ICML 2023] Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN
convolutional-neural-networks imagenet masked-image-modeling pytorch self-supervised-learning vision-transformer masked-autoencoder autoregressive mae object-detection semantic-segmentation transfer-learning a2mim
Language:Python 22
russellllaputa / MIRL
[NeurIPS 2023] Masked Image Residual Learning for Scaling Deeper Vision Transformers
masked-autoencoder masked-image-modeling masked-image-residual-learning self-supervised-learning
Language:Python 19
JunlinHan / CropMix
Code of CropMix: Sampling a Rich Input Distribution via Multi-Scale Cropping
computer-vision contrastive-learning data-augmentation deep-learning image-classification machine-learning masked-image-modeling representation-learning self-supervised-learning
Language:Jupyter Notebook 16
stoneMo / DeepAVFusion
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
attention-mechanism audio-visual-correspondence audio-visual-learning multimodal-learning self-supervised-learning sound-source-localization sound-source-separation transformer-architecture masked-autoencoder masked-image-modeling
Language:Python 16
AndreaCossu / continual-pretraining-nlp-vision
Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357
continual-learning forgetting image-classification lifelong-learning masked-image-modeling masked-language-models pretrained-models qnli self-supervised senteval sentiment-analysis transformers
Language:Jupyter Notebook 15
FengheTan9 / MambaMIM
MambaMIM: Pre-training Mamba with State Space Token-interpolation
mamba mamba-state-space-models masked-image-modeling medical-image-segmentation medical-imaging
Language:Python 14
AndyShih12 / mac
PyTorch implementation for "Training and Inference on Any-Order Autoregressive Models the Right Way", NeurIPS 2022 Oral, TPM 2023 Best Paper Honorable Mention
autoregressive-models generative-models masked-image-modeling masked-language-modeling pytorch tractable-inference tractable-models any-order-autoregressive-models
Language:Python 11
yifanzhang-pro / M-MAE
Official implementation of Matrix Variational Masked Autoencoder (M-MAE) for ICML paper "Information Flow in Self-Supervised Learning" (https://arxiv.org/abs/2309.17281)
masked-autoencoder masked-image-modeling non-contrastive-learning self-supervised-learning foundation-models pretraining
Language:Python 11
LumenPallidium / energy_transformer
Pytorch implementation of an energy transformer - an energy-based reccurrent variant of the transformer.
energy-transformer hopfield-network masked-image-modeling pytorch transformer
Language:Python 10
FengheTan9 / HySparK
[MICCAI 2024] HySparK: Hybrid Sparse Masking for Large Scale Medical Image Pre-Training
cnn hybrid-model masked-image-modeling medical-image-segmentation medical-imaging self-supervised-learning transformer
6
bwconrad / masked-distillation
Pytorch reimplementation of "A Unified View of Masked Image Modeling".
masked-image-modeling pytorch pytorch-lightning self-supervised-learning vision-transformer
Language:Python 4
maple-research-lab / AdPE
code for "AdPE: Adversarial Positional Embeddings for Pretraining Vision Transformers via MAE+"
image-classification mae masked-image-modeling self-supervised-learning vision-transformer masked-autoencoder
Language:Python 4
self-supervised-wafermaps
faris-k / self-supervised-wafermaps
Self-Supervised Representation Learning of Semiconductor Wafer Maps using PyTorch
contrastive-learning pytorch self-supervised-learning semiconductor embeddings image-retrieval masked-image-modeling representation-learning
Language:Jupyter Notebook 3
chadHGY / CAM
Learning Cortical Anomaly through Masked Encoding for Unsupervised Heterogeneity Mapping.
3d-mesh anomaly-detection deep-learning masked-image-modeling neuroscience self-supervised-learning surface unsupervised-learning
Language:Python 2