singhranjodh / pytorch.cyclic.learning.rate

Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)

pytorch.cyclic.learning.rate

This is an accompanying repo for my article explaining the Cycling Learning Rate.

References:

• Cyclical Learning Rates for Training Neural Networks 2015, Leslie N. Smith
• fast.ai library where this was taught to participants
• Brad Kenstler's Keras implementation of CLR
• PyTorch implementation (under review)