Evaluation on mars dataset
Terminator8758 opened this issue · comments
In your code, the evaluation of MARS dataset does not seem to exclude the junk images in the gallery (ID=0999 in your re-organized dataset)? According to MARS official evaluation(https://github.com/liangzheng06/MARS-evaluation/), those images should be removed when evaluating.
@Terminator8758
Thanks for your comment! You are right.Sorry that I did not remove those junk images in MARS evaluation.
I did a simple test on some trained model, and found the removal of junk images result in a performance improvement of 0.5~1 point. I will update the code and the new performances as soon as possible.