Janus-Shiau / lookahead_tensorflow

Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow

Can you test your lookahead on cifar-10 tasks

mapingshuo opened this issue 5 years ago · comments

mapingshuo commented 5 years ago

Can you test your lookahead on cifar-10 tasks

Jia-Yau Shiau commented 5 years ago

I'll try it when I'm available.

My guess is: lookahead won't produce the best results all the time, but guarantee a better convergence.