EleutherAI / the-pile

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

import fasttext_pybind as fasttext fails with undefined symbol

HughPH opened this issue · comments

This is with fasttext 0.9.2

(pile) hugh@gpuserver:/mnt/store2/the-pile$ python the_pile/pile.py --interleave_output 30 --using pile_repro
Traceback (most recent call last):
  File "the_pile/pile.py", line 3, in <module>
    import fasttext
  File "/home/hugh/anaconda3/envs/pile/lib/python3.7/site-packages/fasttext/__init__.py", line 12, in <module>
    from .FastText import train_supervised
  File "/home/hugh/anaconda3/envs/pile/lib/python3.7/site-packages/fasttext/FastText.py", line 12, in <module>
    import fasttext_pybind as fasttext
ImportError: /home/hugh/anaconda3/envs/pile/lib/python3.7/site-packages/fasttext_pybind.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZNSt15__exception_ptr13exception_ptr10_M_releaseEv

With any version prior to 0.9.0 (and after 0.5.x) I get a different error:

Traceback (most recent call last):
  File "the_pile/pile.py", line 3, in <module>
    import fasttext
  File "/home/hugh/anaconda3/envs/pile/lib/python3.7/site-packages/fasttext/__init__.py", line 1, in <module>
    from .fasttext import skipgram
ImportError: /home/hugh/anaconda3/envs/pile/lib/python3.7/site-packages/fasttext/fasttext.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZSt28__throw_bad_array_new_lengthv

All code is entirely unchanged from this repo.