Does the MAE pre-trained model transfer well to CIFAR？

[Zhaokun Zhou]

Hello, I am doing the task of mae transfering to cifar, and I find that MAE is no better than supervised pre-trained vit on small data sets. Could you give me some advice？

[Alex Li]

I found that MAE pretraining helps with CIFAR-100. Maybe you could try that?