dynamical-isometry

There are 0 repository under dynamical-isometry topic.

• fwcore / mean-field-theory-deep-learning

  paper lists and information on mean-field theory of deep learning

  mean-field-theorydeep-neural-networkspaper-listdynamical-isometry
  78

• EsterHlav / Dynamical-Isometry-from-Orthogonality-Neural-Nets

  Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthogonal regularizer on RNNs with SeqMNIST dataset.

  dynamical-isometryrnnkerasorthogonalinitializationneuralnetworksmathematicsmathematics-machine-learning
  Language:Jupyter Notebook 17

• omrijsharon / torchogonal

  Make your deep neural network Dynamically Isometric. Farewell to vanishing and exploding gradients

  deep-learningdynamical-isometryorthogonal-projectionsvd
  Language:Python 2