hendrycks / init

A general weight initialization and how to use batch normalization with dropout

Adjusting for Dropout Variance in Batch Normalization and Weight Initialization

This software allows users to reproduce the results in Adjusting for Dropout Variance in Batch Normalization and Weight Initialization, Dan Hendrycks and Kevin Gimpel 2016.

https://arxiv.org/abs/1607.02488

Execution

Please install Tensorflow, Lasagne, and Python 3+.