Giters

facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Use your own pre-trained model for downstream segmentation

yyy1998-i opened this issue · comments

commented

I would like to ask you a question, I pre-train on my medical image data set (6k) according to the official pre-training code, and then the downstream task is segmentation, but the fine-tuning results with my own pre-training model is always inferior to the author's pre-training model with imagenet, which is why, is my pre-training data is still too small?

commented

Hey,
Your dataset seems too small compared to Imagenet-1K. A suggestion - you should initialize your model using the pre-trained model weights of Imagenet and then continue pre-training on your medical image dataset, which you can use for your downstream task. Please let me know how this goes for you.

commented

Hey, Your dataset seems too small compared to Imagenet-1K. A suggestion - you should initialize your model using the pre-trained model weights of Imagenet and then continue pre-training on your medical image dataset, which you can use for your downstream task. Please let me know how this goes for you.

Ok, thank you very much for your reply. Next, I will try according to what you said. Thanks again

commented

Hello,
Have you tried this approach? and Can you tell me what were your results?