Giters

EsterHlav / Dynamical-Isometry-from-Orthogonality-Neural-Nets

Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthogonal regularizer on RNNs with SeqMNIST dataset.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

EsterHlav/Dynamical-Isometry-from-Orthogonality-Neural-Nets Stargazers