hypergradient-descent

There are 0 repository under hypergradient-descent topic.

JRC1995 / DemonRangerOptimizer
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
qhadam demon decay-momentum adamod radam adam gradient-centralization lookahead amsgrad iterate-averaging adamw ranger qhranger optimizer adaptive-optimizer hypergradient-descent hd-adam hd-sgd nosadam nostalgic-adam
Language:Python 25
GiovanniPoli / OptimzersHD
University project on the optimization of neural networks through hyper gradient based algorithms.
neural-networks algorithms optimization hypergradient-descent
Language:Python 0

JRC1995 / DemonRangerOptimizer