Adabound
keras implement ofrefer to AdaBound.
Usage
You can use AdaBound just like any other keras optimizers.
from keras.optimizers import Adam
from Adabound import Adabound
my_adam=Adam(lr=0.001)
my_adabound=Adabound(lr=1e-3, final_lr=0.1) or
my_adabound=Adabound(lr=1e-3, betas=(0.9, 0.999),final_lr=0.1,gamma=1e-3,epsilon=1e-8,)
Demo
Implement cifr10 classification with the Adabound Optimizer.
Requirements
- keras>=2.2.0
- tensorflow>=1.8.0