juntang-zhuang / Adabelief-Optimizer

Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Suppressing weight decoupling and rectification messages

gunsodo opened this issue · comments

Is there a way to suppress these messages by setting some parameters explicitly when they are enabled?

Weight decoupling enabled in AdaBelief
Rectification enabled in AdaBelief

I skimmed through the code and did not notice there is any parameter that we do so. I apologize if I have overlooked any part of the code/documentation. Thank you in advance for your reply.

Environment

  • adabelief_pytorch 0.2.1
  • Python 3.8.10

Sorry, these two messages are not allowed to be disabled in the current implementation. Maybe you can consider putting the print function

inside the if condition here and disabling it.