Question on validation loss
Sirius083 opened this issue · comments
I have implemented your code on cifar100
when halving the learning rate, the test loss suddenly decrease , then increase
while the validation error keeps unchanged.
Did tensorpack maintain a shadow value and show the EMA of cost? (reset this value after learning rate change)
Any suggesstion would be appreciated
Thanks in advance