qhadam

There are 0 repository under qhadam topic.

JRC1995 / DemonRangerOptimizer
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
qhadam demon decay-momentum adamod radam adam gradient-centralization lookahead amsgrad iterate-averaging adamw ranger qhranger optimizer adaptive-optimizer hypergradient-descent hd-adam hd-sgd nosadam nostalgic-adam
Language:Python 23
timvvvht / Neural-Networks-and-Optimizers-from-scratch
Neural Networks and optimizers from scratch in NumPy, featuring newer optimizers such as DemonAdam or QHAdam.
neural-networks backpropagation neural-networks-from-scratch numpy mnist-dataset optimizers demon-adam nesterov-accelerated-sgd rmsprop adadelta qhadam
Language:Jupyter Notebook 5