jrbtaylor / ortho-rnn

Investigating a soft constraint on the recurrent weight matrix orthogonality. Comparison to gradient clipping on sequential MNIST.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ortho-rnn

Investigating a soft constraint on the recurrent weight matrix orthogonality. Comparison to gradient clipping on sequential MNIST.

About

Investigating a soft constraint on the recurrent weight matrix orthogonality. Comparison to gradient clipping on sequential MNIST.


Languages

Language:Python 100.0%