achyudh / wdrop-lstm

Implementation of weight-dropped LSTMs from the paper "Regularizing and optimizing LSTM language models" by Merity et al.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Weight-Dropped-LSTM

Implementation of weight-dropped LSTMs from the paper "Regularizing and optimizing LSTM language models" [1]. This implementation is based on https://github.com/salesforce/awd-lstm-lm.

References:

[1] Merity, Stephen, Nitish Shirish Keskar, and Richard Socher. "Regularizing and optimizing LSTM language models." arXiv preprint arXiv:1708.02182 (2017).

About

Implementation of weight-dropped LSTMs from the paper "Regularizing and optimizing LSTM language models" by Merity et al.


Languages

Language:Python 100.0%