juntang-zhuang / Adabelief-Optimizer

Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

scripts for the toy examples?

XuezheMax opened this issue · comments

Would you please share the scripts to produce the results of the toy examples and to generate the gif files?
Thanks!

thanks for asking. Code for that part is somehow messy, and I'm busy with experiments on RNN and transformer models recently, as many post in the reddit discussion, so I might delay publishing code for toys.

Hi, are you ready now to share the scripts for toy exmaples?

commented

I'm trying to write the script to produce the results of toy examples.
I hope it helps somewhat.
https://github.com/seiyab/adabelief-toy-examples-pytorch
I'm sorry not to achieve the exactly same results/