david9ml / LSUV-keras

Simple implementation of the LSUV initialization in keras

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Layer-sequential unit-variance (LSUV) initialization for Keras

This is sample code for LSUV and initializations, implemented in python script within Keras framework.

Usage:

from lsuv_init import LSUVinit
...
batch_size = 32
model = LSUVinit(model,train_imgs[:batch_size,:,:,:]) 

LSUV initialization is described in:

Mishkin, D. and Matas, J.,(2015). All you need is a good init. ICLR 2016 arXiv:1511.06422.

Original Caffe implementation https://github.com/ducha-aiki/LSUVinit

Torch re-implementation https://github.com/yobibyte/torch-lsuv

About

Simple implementation of the LSUV initialization in keras


Languages

Language:Python 100.0%