This is an implementation of Googles Yogi-Optimizer in Keras (tf.keras)
The NeurIPS-Paper can be found here: http://papers.nips.cc/paper/8186-adaptive-methods-for-nonconvex-optimization.pdf
My implementation is heavily based on Keras own Adam implementation which can be found here: https://github.com/tensorflow/tensorflow/blob/r1.12/tensorflow/python/keras/optimizers.py
A Colab Notebook using the same code can be found here: https://colab.research.google.com/drive/1xXh2xJdGjrcZ4XjUXWaSQ2osBR09UBG6
Thanks to the authors of the paper for their contribution.