Some optimizers skip the first iteration and only yield for i > 0
rueckstiess opened this issue · comments
Thomas Rückstieß commented
why?
consistency!
Justin Bayer commented
BECAUSE!! :)
Can you point me to where that happens?
Thomas Rückstieß commented
https://github.com/BRML/climin/blob/master/climin/gd.py#L30
many minimizers have that "i > 0" condition: gd, rprop, *bfgs family but others don't, e.g. bayesian.
Justin Bayer commented
Ah, ok, thanks.