adaptive-gradient-clipping

There are 0 repository under adaptive-gradient-clipping topic.

vballoli / nfnets-pytorch
NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
pytorch image-classification deepmind adaptive-gradient-clipping nfnets sota paper sgd
Language:Python 341
VITA-Group / BNN_NoBN
[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
binary-neural-networks batch-normalization normalization-free-training normalizer-free weight-standardization adaptive-gradient-clipping
Language:Python 54
andreped / GradientAccumulator
:dart: Accumulated Gradients for TensorFlow 2
tensorflow accumulated-gradients tensorflow2 tf2 batch-size memory-constraints gradient-accumulation distributed-training float16 mixed-precision deep-learning keras adaptive-gradient-clipping gpu tpu huggingface accumulated-batch-normalization multi-gpu hacktoberfest
Language:Python 49