There are 5 repositories under masked-autoencoder topic.
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
[ECCV2024] Video Foundation Models & Data for Multimodal Understanding
A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
SimpleClick: Interactive Image Segmentation with Simple Vision Transformers (ICCV 2023)
PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
reproduction of semantic segmentation using masked autoencoder (mae)
[CVPR2023] Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning (https://arxiv.org/abs/2212.04500)
Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations
[CVPR'23] Hard Patches Mining for Masked Image Modeling
Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'
[ECCV 2024] Pytorch code for our ECCV'24 paper NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields
Unofficial PyTorch implementation of Masked Autoencoders that Listen
[NeurIPS 2022 Spotlight] VideoMAE for Action Detection
Official repo for Recursion's accepted spotlight paper at NeurIPS 2023 Generative AI & Biology workshop.
Official implementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".
[ICML 2023] Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN
Official Pytorch implementation of EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Spatiotemporal Tokens [ICML2024].
[NeurIPS 2023] Masked Image Residual Learning for Scaling Deeper Vision Transformers
ALBERT trained on Mongolian text corpus
A PyTorch implementation of "BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping"
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
A Vector Quantized Masked AutoEncoder for speech emotion recognition
Repository for model development and training
Design a patches masked autoencoder by CNN
Official implementation of Matrix Variational Masked Autoencoder (M-MAE) for ICML paper "Information Flow in Self-Supervised Learning" (https://arxiv.org/abs/2309.17281)
HSIMAE: A Unified Masked Autoencoder with large-scale pretraining for Hyperspectral Image Classification
Codebase for Imperial MSc AI Individual Project - Self-Supervised Learning for Audio Inference