nishnik / poincare_embeddings

NumPy implementation of Poincaré Embeddings for Learning Hierarchical Representations (Facebook Research)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

poincare_embeddings

NumPy implementation of Poincaré Embeddings for Learning Hierarchical Representations (Facebook Research).
Link to paper
Link to blog

poincare.py contains the crude implementation, poincare_adam.py contains my experiments with adam.

Sample results:

Without adam, three levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/3_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/3_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/3_181.png

With adam, three levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam3_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam3_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam3_181.png

Without adam, four levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/4_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/4_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/4_181.png

With adam, four levels deep:

Initial

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam4_init.png

Epoch 1

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam4_1.png

Epoch 181

https://github.com/nishnik/poincare_embeddings/blob/master/plots/adam4_181.png

About

NumPy implementation of Poincaré Embeddings for Learning Hierarchical Representations (Facebook Research)

License:MIT License


Languages

Language:Python 100.0%