masked-autoencoder

There are 5 repositories under masked-autoencoder topic.

SparK
keyu-tian / SparK
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
bert cnn convnet convolutional-neural-networks deep-learning iclr iclr2023 instance-segmentation mae mask-rcnn masked-autoencoder masked-image-modeling object-detection pre-trained-model pretrain pretraining pytorch self-supervised-learning sparse-convolution ssl
Language:Python 1412
MCG-NJU / VideoMAE
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
self-supervised-learning action-recognition video-understanding masked-autoencoder transformer vision-transformer video-transformer mae pytorch video-representation-learning video-analysis neurips-2022
Language:Python 1303
OpenGVLab / InternVideo
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
foundation-models video-understanding vision-transformer action-recognition masked-autoencoder multimodal open-set-recognition spatio-temporal-action-localization temporal-action-localization video-question-answering video-retrieval zero-shot-classification zero-shot-retrieval benchmark contrastive-learning self-supervised instruction-tuning video-data video-dataset video-clip
Language:Python 1260
EdisonLeeeee / Awesome-Masked-Autoencoders
A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).
mae masked-autoencoder self-supervised-learning
754
Lupin1998 / Awesome-MIM
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
awesome-list awesome-mim masked-image-modeling self-supervised-learning vision-transformer masked-autoencoder computer-vision deep-learning pre-training bert gpt generative-models mae masked-modeling representation-learning
Language:Python 284
implus / UM-MAE
Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
ade20k coco hierarchical-vision-transformer imagenet-classification mae masked-autoencoder masked-image-modeling pyramid-vision-transformer self-supervised-learning swin-transformer
Language:Jupyter Notebook 237
uncbiag / SimpleClick
SimpleClick: Interactive Image Segmentation with Simple Vision Transformers (ICCV 2023)
interactive-segmentation masked-autoencoder pytorch vision-transformers
Language:Python 207
xyzforever / BEVT
PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
action-recognition bert deep-learning masked-autoencoder pytorch video-understanding foundation-models self-supervised-learning video-representation-learning
Language:Python 156
implus / mae_segmentation
reproduction of semantic segmentation using masked autoencoder (mae)
mae self-supervised-learning semantic-segmentation masked-autoencoder vit vision-transformer
Language:Python 152
ruiwang2021 / mvd
[CVPR2023] Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning (https://arxiv.org/abs/2212.04500)
action-recognition masked-autoencoder self-supervised-learning video-representation-learning video-understanding vision-transformer cvpr2023
Language:Python 101
nttcslab / msm-mae
Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations
audio deep-learning masked-autoencoder
Language:Jupyter Notebook 86
Haochen-Wang409 / HPM
[CVPR'23] Hard Patches Mining for Masked Image Modeling
ade20k coco computer-vision cvpr2023 imagenet masked-autoencoder masked-image-modeling pattern-recognition self-supervised-learning unsupervised-learning
Language:Python 84
TonyLianLong / CrossMAE
Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
computer-vision deep-learning mae masked-autoencoder self-supervised-learning
Language:Python 82
habla-liaa / encodecmae
Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'
audio deep-learning encodec masked-autoencoder representation-learning
Language:Python 79
NeRF-MAE
zubair-irshad / NeRF-MAE
[ECCV 2024] Pytorch code for our ECCV'24 paper NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields
3d 3d-deep-learning 3d-detection 3d-unet instant-ngp masked-autoencoder multi-view nerf neural-radiance-fields representation-learning self-supervised-learning transformers vision-transformers feature-pyramid-network region-proposal-network differentiable-rendering neural-rendering semantic-segmantation super-resoluion vit
Language:Python 68
nttcslab / m2d
Masked Modeling Duo: Towards a Universal Audio Pre-training Framework
audio masked-autoencoder self-supervised-learning masked-modeling-duo
Language:Jupyter Notebook 61
rishikksh20 / AudioMAE-pytorch
Unofficial PyTorch implementation of Masked Autoencoders that Listen
autoencoder masked-autoencoder self-supervised-learning speech tts speech-synthesis
Language:Python 61
HKUDS / MAERec
[SIGIR'2023] "MAERec: Graph Masked Autoencoder for Sequential Recommendation"
graph-neural-networks masked-autoencoder recommender-systems self-supervised-learning sequential-recommendation
Language:Python 51
MCG-NJU / VideoMAE-Action-Detection
[NeurIPS 2022 Spotlight] VideoMAE for Action Detection
pytorch mae masked-autoencoder neurips-2022 transformer video-transformer video-understanding videomae action-detection
Language:Python 47
recursionpharma / maes_microscopy
Official repo for Recursion's accepted spotlight paper at NeurIPS 2023 Generative AI & Biology workshop.
computer-vision deep-learning masked-autoencoder microscopy biology generative-ai phenomics
Language:Python 29
lyhkevin / MT-Net
Multi-scale Transformer Network for Cross-Modality MR Image Synthesis (IEEE TMI)
deep-learning masked-autoencoder mri multi-modal pytorch synthesis
Language:Python 28
shlokk / mae-contrastive
Official implementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".
contrastive-learning masked-autoencoder pytorch self-supervised-learning
Language:Python 27
Westlake-AI / A2MIM
[ICML 2023] Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN
a2mim autoregressive convolutional-neural-networks imagenet mae masked-autoencoder masked-image-modeling object-detection pytorch self-supervised-learning semantic-segmentation transfer-learning vision-transformer
Language:Python 22
sunilhoho / EVEREST
Official Pytorch implementation of EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Spatiotemporal Tokens [ICML2024].
masked-autoencoder representation-learning self-supervised-learning video-learning video-representation-learning
Language:Python 21
jakhac / CSMAE
Cross-Sensor Masked Autoencoder for Content Based Image Retrieval in Remote Sensing
deep-learning image-retrieval masked-autoencoder remote-sensing
Language:Python 19
liruiw / Dec-SSL
Understanding Self-Supervised Learning in a Decentralized Setting
decentralized-learni self-supervised-learning contrastive-learning federated-learning masked-autoencoder
Language:Python 19
russellllaputa / MIRL
[NeurIPS 2023] Masked Image Residual Learning for Scaling Deeper Vision Transformers
masked-image-modeling self-supervised-learning masked-image-residual-learning masked-autoencoder
Language:Python 19
bayartsogt-ya / albert-mongolian
ALBERT trained on Mongolian text corpus
albert pretrained-model pretrain language-model mongolian transformers masked-autoencoder
Language:Jupyter Notebook 18
mvrl / BirdSAT
A PyTorch implementation of "BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping"
fine-grained-classification masked-autoencoder species-distribution-mapping
Language:Python 14
stoneMo / DeepAVFusion
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
attention-mechanism audio-visual-correspondence audio-visual-learning multimodal-learning self-supervised-learning sound-source-localization sound-source-separation transformer-architecture masked-autoencoder masked-image-modeling
Language:Python 13
samsad35 / VQ-MAE-S-code
A Vector Quantized Masked AutoEncoder for speech emotion recognition
emotion-recognition masked-autoencoder self-supervised-learning vector-quantization speech
Language:Python 12
waldo-vision / models
Repository for model development and training
artificial-intelligence machine-learning masked-autoencoder vision-transformer
Language:Python 12
JJLi0427 / CNN_Masked_Autoencoder
Design a patches masked autoencoder by CNN
cnn masked-autoencoder minist pytorch
Language:Python 11
yifanzhang-pro / M-MAE
Official implementation of Matrix Variational Masked Autoencoder (M-MAE) for ICML paper "Information Flow in Self-Supervised Learning" (https://arxiv.org/abs/2309.17281)
foundation-models masked-autoencoder masked-image-modeling non-contrastive-learning pretraining self-supervised-learning
Language:Python 11
Ryan21wy / HSIMAE
HSIMAE: A Unified Masked Autoencoder with large-scale pretraining for Hyperspectral Image Classification
hyperspectral-image-classification large-scale-pretraining masked-autoencoder
Language:Python 10
jonahanton / SSL_audio
Codebase for Imperial MSc AI Individual Project - Self-Supervised Learning for Audio Inference
audio-processing audioset barlow-twins byol deep-learning machine-learning masked-autoencoder self-supervised-learning
Language:Python 9