Installation woes

Question

Installation woes

yuvalpinter opened this issue 4 years ago · comments

Hi,
I've been having trouble using this repo, even just for replication or inference on a new phrase (using existing models). Some issues include:

The deprecation of Python 2.7 (which is probably going to be out of scope for maintaining an old project)
Various torch incompatibilities
Unidentified sklearn version (latest doesn't have a cross_validation module)
kenlm doesn't conform with any setup I tried.

Something that can solve, hopefully, all of these is a requirements file or a yaml for conda envs.

Yuval Pinter · Answer 1 · Tue May 05 2020 11:53:49 GMT+0800 (China Standard Time)

ok this was painful but i may have found a conda .yml env file that works:

name: simplicity
channels:
  - pytorch
  - conda-forge
  - defaults
dependencies:
  - _libgcc_mutex=0.1=main
  - attrs=19.3.0=py_0
  - backports=1.0=py_2
  - backports.functools_lru_cache=1.6.1=py_0
  - backports.shutil_get_terminal_size=1.0.0=py27_2
  - backports_abc=0.5=py_0
  - blas=1.0=mkl
  - bleach=3.1.5=pyh9f0ad1d_0
  - boto=2.49.0=py_0
  - boto3=1.13.2=pyh9f0ad1d_0
  - botocore=1.16.2=pyh9f0ad1d_0
  - brotlipy=0.7.0=py27h516909a_1000
  - bz2file=0.98=py_0
  - ca-certificates=2020.4.5.1=hecc5488_0
  - cachetools=3.1.1=py_0
  - certifi=2019.11.28=py27h8c360ce_1
  - cffi=1.13.2=py27h2e261b9_0
  - chardet=3.0.4=py27h8c360ce_1006
  - configargparse=1.1=py_0
  - configparser=3.7.3=py27h8c360ce_2
  - contextlib2=0.6.0.post1=py_0
  - cpuonly=1.0=0
  - cryptography=2.8=py27h2c19f6a_2
  - cuda92=1.0=0
  - cudatoolkit=10.1.243=h6bb024c_0
  - cycler=0.10.0=py27_0
  - dbus=1.13.14=hb2f20db_0
  - decorator=4.4.2=py_0
  - defusedxml=0.6.0=py_0
  - docutils=0.15.2=py27_0
  - entrypoints=0.3=py27h8c360ce_1001
  - enum34=1.1.6=py27_1
  - expat=2.2.6=he6710b0_0
  - fontconfig=2.13.0=h9420a91_0
  - freetype=2.9.1=h8a8886c_1
  - functools32=3.2.3.2=py27_1
  - future=0.18.2=py27_0
  - futures=3.3.0=py27_0
  - gensim=3.8.0=py27h962f231_0
  - glib=2.63.1=h5a9c865_0
  - google-api-core=1.16.0=py27_1
  - google-auth=1.14.1=pyh9f0ad1d_0
  - google-cloud-core=1.3.0=py_0
  - google-cloud-storage=1.28.0=pyh9f0ad1d_0
  - google-resumable-media=0.5.0=py_1
  - googleapis-common-protos=1.51.0=py27_1
  - gst-plugins-base=1.14.0=hbbd80ab_1
  - gstreamer=1.14.0=hb453b48_1
  - icu=58.2=he6710b0_3
  - idna=2.9=py_1
  - importlib-metadata=1.5.0=py27h8c360ce_1
  - importlib_metadata=1.5.0=1
  - intel-openmp=2020.0=166
  - ipaddress=1.0.23=py_0
  - ipykernel=4.10.0=py27_0
  - ipython=5.8.0=py27_0
  - ipython_genutils=0.2.0=py27_0
  - jinja2=2.11.2=pyh9f0ad1d_0
  - jmespath=0.9.5=py_0
  - jpeg=9b=h024ee3a_2
  - jsonschema=3.2.0=py27h8c360ce_1
  - jupyter_client=5.3.4=py27_0
  - jupyter_core=4.6.1=py27_0
  - jupyterlab=0.33.12=py27_0
  - jupyterlab_launcher=0.11.2=py_0
  - kiwisolver=1.1.0=py27he6710b0_0
  - libedit=3.1.20181209=hc058e9b_0
  - libffi=3.2.1=hd88cf55_4
  - libgcc-ng=9.1.0=hdf63c60_0
  - libgfortran-ng=7.3.0=hdf63c60_0
  - libpng=1.6.37=hbc83047_0
  - libprotobuf=3.11.4=h8b12597_0
  - libsodium=1.0.16=h1bed415_0
  - libstdcxx-ng=9.1.0=hdf63c60_0
  - libtiff=4.1.0=h2733197_0
  - libuuid=1.0.3=h1bed415_2
  - libxcb=1.13=h1bed415_1
  - libxml2=2.9.9=hea5a465_1
  - markupsafe=1.1.1=py27hdf8410d_1
  - matplotlib=2.2.3=py27hb69df0a_0
  - mistune=0.8.4=py27hdf8410d_1001
  - mkl=2020.0=166
  - mkl-service=2.3.0=py27he904b0f_0
  - mkl_fft=1.0.15=py27ha843d7b_0
  - mkl_random=1.1.0=py27hd6b4f25_0
  - more-itertools=5.0.0=py27_0
  - nbconvert=5.6.1=py27_0
  - nbformat=4.4.0=py_1
  - ncurses=6.2=he6710b0_1
  - networkx=2.2=py27_1
  - ninja=1.9.0=py27hfd86e86_0
  - notebook=5.7.8=py27_1
  - numpy=1.16.6=py27hbc911f0_0
  - numpy-base=1.16.6=py27hde5b4d6_0
  - olefile=0.46=py_0
  - openssl=1.1.1g=h516909a_0
  - packaging=20.1=py_0
  - pandas=0.24.2=py27he6710b0_0
  - pandoc=2.9.2.1=0
  - pandocfilters=1.4.2=py_1
  - pathlib2=2.3.5=py27_0
  - pcre=8.43=he6710b0_0
  - pexpect=4.7.0=py27_0
  - pickleshare=0.7.5=py27_0
  - pillow=6.2.1=py27h34e0f95_0
  - pip=19.3.1=py27_0
  - prometheus_client=0.7.1=py_0
  - prompt_toolkit=1.0.15=py27_0
  - protobuf=3.11.4=py27he1b5a44_0
  - ptyprocess=0.6.0=py27_0
  - pyasn1=0.4.8=py_0
  - pyasn1-modules=0.2.7=py_0
  - pycparser=2.20=py_0
  - pygments=2.5.2=py_0
  - pyopenssl=19.1.0=py_1
  - pyparsing=2.4.7=py_0
  - pyqt=5.9.2=py27h05f1152_2
  - pyrsistent=0.15.7=py27hdf8410d_1
  - pysocks=1.7.1=py27h8c360ce_1
  - python=2.7.18=h02575d3_0
  - python-dateutil=2.8.1=py_0
  - python-levenshtein=0.12.0=py27h516909a_1001
  - python_abi=2.7=1_cp27mu
  - pytorch=0.4.1=py27_cuda9.2.148_cudnn7.1.4_1
  - pytz=2020.1=py_0
  - pyzmq=18.1.0=py27he6710b0_0
  - qt=5.9.7=h5867ecd_1
  - readline=8.0=h7b6447c_0
  - requests=2.23.0=pyh8c360ce_2
  - rsa=4.0=py_0
  - s3transfer=0.3.3=py27_0
  - scandir=1.10.0=py27h7b6447c_0
  - scikit-learn=0.20.3=py27hd81dba3_0
  - scipy=1.2.1=py27h7c811a0_0
  - send2trash=1.5.0=py_0
  - setuptools=44.0.0=py27_0
  - simplegeneric=0.8.1=py27_2
  - singledispatch=3.4.0.3=py27_0
  - sip=4.19.8=py27hf484d3e_0
  - six=1.13.0=py27_0
  - smart_open=2.0.0=pyh9f0ad1d_0
  - sqlite=3.31.1=h62c20be_1
  - subprocess32=3.5.4=py27h7b6447c_0
  - termcolor=1.1.0=py27_1
  - terminado=0.8.3=py27h8c360ce_1
  - testpath=0.4.4=py_0
  - tk=8.6.8=hbc83047_0
  - torchfile=0.1.0=py_0
  - tornado=5.1.1=py27h7b6447c_0
  - traitlets=4.3.3=py27_0
  - typing=3.7.4.1=py27_0
  - urllib3=1.25.9=py_0
  - visdom=0.1.8.9=0
  - wcwidth=0.1.9=py_0
  - webencodings=0.5.1=py_1
  - websocket-client=0.57.0=py27h8c360ce_1
  - wheel=0.33.6=py27_0
  - xz=5.2.5=h7b6447c_0
  - zeromq=4.3.1=he6710b0_3
  - zipp=1.0.0=py_0
  - zlib=1.2.11=h7b6447c_3
  - zstd=1.3.7=h0b5b093_0
  - pip:
    - kenlm==0.0.0

(kenlm has to be installed from source as per here).

Vivek Kulkarni · Answer 2 · Tue May 05 2020 12:07:25 GMT+0800 (China Standard Time)

Ok! Let me know if this serves your needs. I will anyways plan to move this to Python 3.