Evaluating model checkpoint on validation set
DatHuynh opened this issue · comments
Have anyone tried to evaluate Resnet 101 image classification checkpoint (trained on V2 data) on the validation set?
I got a weird result: only 26 MAP score which contradicts with this paper Learning From Noisy Large-Scale DatasetsWith Minimal Supervision where they got 61 MAP on V1 dataset.
Could it be because I resize the image to the maximum size of 256 when downloading them?
Thanks in advance.
The evaluation metrics is not a standard mAP score. Maybe you shoule check the paper and find how they modify the mAP calculator.