large-batch-optimization

There are 0 repository under large-batch-optimization topic.

KhoiDOO / tvlars
TVLARS - A Fast Convergence Optimizer for Large Batch Training
large-batch-optimization layer-wise-relevance-propagation learning-rate learning-rate-scheduling optimization optimization-algorithms warmup
Language:Python 0
vinnik-dmitry07 / full-batch
Super-Convergence on CIFAR10
adamw large-batch-optimization lion lion-optimizer madgrad second-order-optimization sharpness-aware-minimization sophia super-convergence weight-decay cifar10
Language:Python