radaimi / Towards-Understanding-Regularization-in-Normalization-Layers-in-Deep-Neural-Networks

Exploring the effect of regularization in normalization layers, including batch normalization, layer normalization, group normalization, and instance normalization by running several experiments and visualizing validation performance, neural nets weights, and distribution.

Towards Understanding Regularization in Normalization Layers in Deep Neural Networks

Exploring the effect of regularization in normalization layers, including batch normalization, layer normalization, group normalization, and instance normalization by running several experiments and visualizing validation performance, neural nets weights, and distribution.