YixuanLi / densenet-tensorflow

DenseNet Implementation in Tensorflow

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question on validation loss

Sirius083 opened this issue · comments

I have implemented your code on cifar100
when halving the learning rate, the test loss suddenly decrease , then increase
while the validation error keeps unchanged.
Did tensorpack maintain a shadow value and show the EMA of cost? (reset this value after learning rate change)
cifar100_d_40_k_12

Any suggesstion would be appreciated
Thanks in advance