How to get results reported in paper for cifar-10?

Question

How to get results reported in paper for cifar-10?

arunpatala opened this issue 6 years ago · comments

Thanks for a very interesting paper!! I was trying out your code and was not able to get the results posted in paper but got the results shown on GitHub page.

CIFAR10 PreAct ResNet-18 results of 3.9% are reported in the paper. But the GitHub page gives it 4.24%. Are there any other setting to change like epochs, weight decay etc?

Thanks

hongyi-zhang · Answer 1 · Mon Feb 26 2018 05:25:27 GMT+0800 (China Standard Time)

Hi, thanks for your interest! For unknown reasons we were not able to reproduce the 3.9% result (at least with the current pytorch-cifar repo). We already updated the ICLR submission with the new numbers; will do so for the arXiv version as well.

Best,
Hongyi

arunpatala · Answer 2 · Wed Feb 28 2018 21:58:46 GMT+0800 (China Standard Time)

Thanks. I was able to get 3.9% by running for longer epochs. I tried with 400 epochs.

hongyi-zhang · Answer 3 · Sat Mar 03 2018 11:41:01 GMT+0800 (China Standard Time)

Thanks for your input! Closing the issue.