Paper:Distributed Representations of Words and Phrases and their Compositionality
Reference:《动手学深度学习》10.3节
Dataset:Penn Tree Bank
Pytorch version: 1.1.0
After 20 epochs, top 5 words closest to "chip" are as follows:
word | cosine-similarity |
---|---|
memory | 0.5467423796653748 |
intel | 0.49802717566490173 |
chips | 0.4644008278846741 |
briefly | 0.4278477728366852 |
manufactures | 0.4056882858276367 |