Cerebras / online-normalization

Online Normalization for Training Neural Networks (Companion Repository)

Cerebras/online-normalization Issues

Issue with the line from online_norm_pytorch import _C
Updated 3 years ago2
Installation error
Closed 3 years ago2
eval mode for pytorch implementation
Closed 3 years ago1
For data parallel, does each GPU hold different running statistics using online norm?
Closed 4 years ago1
Contribute implementation to TF Addons?
Updated 4 years ago
Does ON in PyTorch require that batch_size > 1?
Closed 4 years ago2