HyperRangerMod do not work

[Had]

/content/DemonRangerOptimizer/optimizers.py in step(self, display, activate_IA, closure)
    883                 denom = vt.pow_(group['p']).add_(group['eps'])
    884 
--> 885                 n = state['lr']/denom
    886 
    887                 if beta3 > 0.0:  # apply AdaMod

KeyError: 'lr'

[Saurabh]

I added state['lr'] = group['lr'] after line 814, since it is done in class HyperRanger.

[Had]

Yes, its just a typo

[Jishnu Ray Chowdhury]

Thanks for pointing out. Updated it.