PreResNet-110 on Cifar100, Top1 error rate is 26.47 rather than 23.65.

Question

PreResNet-110 on Cifar100, Top1 error rate is 26.47 rather than 23.65.

WeixiangXu opened this issue 5 years ago · comments

wxxu commented 5 years ago

I trained PreResNet-110 on Cifar100 as training recipes. And I get top1 error rate: 26.47%.

Kai Hu · Answer 1 · Wed Nov 06 2019 11:40:07 GMT+0800 (China Standard Time)

Same here, cannot reach 23.65. But I can only get 28. Could you give me some hints about the dropped accuracy?

PatatiPatata · Answer 2 · Mon Dec 30 2019 15:55:07 GMT+0800 (China Standard Time)

Same here, I get top1 error rate ~ 28%

Kai Hu · Answer 3 · Tue Dec 31 2019 01:56:17 GMT+0800 (China Standard Time)

@BeierZhu Now I can confirm it should be 28%.
Please see this issue #36 (comment).

The reason is that some people use the easier version which is indeed PreResNet 164 with Bottleneck (higher accuracy) while the current version is PreResNet110 with BasicBlock.