PiecewiseConstantWarmUpDecay incorrect implementation causes skipping to the almost minimal LR
or-toledano opened this issue · comments
see PR #34
Steps to reproduce:
set lr_decay_epoch to a list with length >=3
See that the second learning rate is wrong and won't decrease from its value