buptpriswang / lmkit

language models toolkits with hierarchical softmax setting

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

lmkit

accepted paper

Exploration of Tree-based Hierarchical Softmax for Recurrent Language Models. IJCAI 2017.

  1. original: Recurrent Language Model (RNNLM) with LSTM/GRU cells

  2. Nce: noise contrastive estimation for RNNLM

  3. Blackout: Blackout approximation for RNNLM

  4. p-tHSM: paralleled tree-based hierarchical softmax for RNNLM

  5. tHSM: traditional tree-based hierarchical softmax with Huffman coding for RNNLM

About

language models toolkits with hierarchical softmax setting


Languages

Language:Python 88.4%Language:Shell 8.7%Language:Cuda 3.0%