decay-momentum

There are 0 repository under decay-momentum topic.

JRC1995 / DemonRangerOptimizer
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
qhadam demon decay-momentum adamod radam adam gradient-centralization lookahead amsgrad iterate-averaging adamw ranger qhranger optimizer adaptive-optimizer hypergradient-descent hd-adam hd-sgd nosadam nostalgic-adam
Language:Python 23