data61 / clkhash

CLK hash: hash pii for entity matching

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Notebook tests not working on Windows machines.

gusmith opened this issue · comments

Example of failure for Windows and Python 3.6:

Building wheels for collected packages: anonlink, jellyfish, snowballstemmer, pandocfilters, prometheus-client
  Building wheel for anonlink (setup.py): started
  Building wheel for anonlink (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: 'C:\hostedtoolcache\windows\Python\3.6.8\x64\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\VSSADM~1\\AppData\\Local\\Temp\\pip-install-cn5q_1ii\\anonlink\\setup.py'"'"'; __file__='"'"'C:\\Users\\VSSADM~1\\AppData\\Local\\Temp\\pip-install-cn5q_1ii\\anonlink\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d 'C:\Users\VSSADM~1\AppData\Local\Temp\pip-wheel-s2yr0v1v' --python-tag cp36
       cwd: C:\Users\VSSADM~1\AppData\Local\Temp\pip-install-cn5q_1ii\anonlink\
  Complete output (38 lines):
  C:\hostedtoolcache\windows\Python\3.6.8\x64\lib\distutils\extension.py:131: UserWarning: Unknown Extension options: 'include'
    warnings.warn(msg)
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build\lib.win-amd64-3.6
  creating build\lib.win-amd64-3.6\anonlink
  copying anonlink\benchmark.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\blocking.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\candidate_generation.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\concurrency.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\serialization.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\stats.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\typechecking.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\_deprecation.py -> build\lib.win-amd64-3.6\anonlink
  copying anonlink\__init__.py -> build\lib.win-amd64-3.6\anonlink
  creating build\lib.win-amd64-3.6\anonlink\similarities
  copying anonlink\similarities\_dice_python.py -> build\lib.win-amd64-3.6\anonlink\similarities
  copying anonlink\similarities\_dice_x86.py -> build\lib.win-amd64-3.6\anonlink\similarities
  copying anonlink\similarities\_smc.py -> build\lib.win-amd64-3.6\anonlink\similarities
  copying anonlink\similarities\_utils.py -> build\lib.win-amd64-3.6\anonlink\similarities
  copying anonlink\similarities\__init__.py -> build\lib.win-amd64-3.6\anonlink\similarities
  creating build\lib.win-amd64-3.6\anonlink\solving
  copying anonlink\solving\_multiparty_solving_python.py -> build\lib.win-amd64-3.6\anonlink\solving
  copying anonlink\solving\__init__.py -> build\lib.win-amd64-3.6\anonlink\solving
  running build_ext
  generating cffi module 'build\\temp.win-amd64-3.6\\Release\\_entitymatcher.cpp'
  creating build\temp.win-amd64-3.6
  creating build\temp.win-amd64-3.6\Release
  building 'solving._multiparty_solving' extension
  creating build\temp.win-amd64-3.6\Release\anonlink
  creating build\temp.win-amd64-3.6\Release\anonlink\solving
  C:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\bin\HostX86\x64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -DNDEBUG -IC:\hostedtoolcache\windows\Python\3.6.8\x64\include -IC:\hostedtoolcache\windows\Python\3.6.8\x64\include "-IC:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\include" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.6.1\include\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\cppwinrt" /EHsc /Tpanonlink/solving/_multiparty_solving.cpp /Fobuild\temp.win-amd64-3.6\Release\anonlink/solving/_multiparty_solving.obj -std=c++11
  cl : Command line warning D9002 : ignoring unknown option '-std=c++11'
  _multiparty_solving.cpp
  anonlink/solving/_multiparty_solving.cpp(649): fatal error C1083: Cannot open include file: '_multiparty_solving_inner.h': No such file or directory
  error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2017\\Enterprise\\VC\\Tools\\MSVC\\14.16.27023\\bin\\HostX86\\x64\\cl.exe' failed with exit status 2
  ----------------------------------------
  ERROR: Failed building wheel for anonlink
  Running setup.py clean for anonlink
  Building wheel for jellyfish (setup.py): started
  Building wheel for jellyfish (setup.py): finished with status 'done'
  Created wheel for jellyfish: filename=jellyfish-0.7.2-cp36-cp36m-win_amd64.whl size=26622 sha256=5a500830dc98b3c8f63ccc63ec3c27a232565e3cc72111c30e0379508a18d23d
  Stored in directory: C:\Users\VssAdministrator\AppData\Local\pip\Cache\wheels\e8\fe\99\d8fa8f2ef7b82a625b0b77a84d319b0b50693659823c4effb4
  Building wheel for snowballstemmer (setup.py): started
  Building wheel for snowballstemmer (setup.py): finished with status 'done'
  Created wheel for snowballstemmer: filename=snowballstemmer-1.9.0-cp36-none-any.whl size=93836 sha256=1f50a52dfc4cc84737ff7d4d403eb3358e241957887aaa9567c69f8e441c2503
  Stored in directory: C:\Users\VssAdministrator\AppData\Local\pip\Cache\wheels\93\db\97\496f1d6bbcad1fecbc58fe45363540414be519312eded82bab
  Building wheel for pandocfilters (setup.py): started
  Building wheel for pandocfilters (setup.py): finished with status 'done'
  Created wheel for pandocfilters: filename=pandocfilters-1.4.2-cp36-none-any.whl size=7862 sha256=75f7ee7ef492b34d6fda6d98e7ec33bbb48b394b7a01b4d2c088622e5565b03a
  Stored in directory: C:\Users\VssAdministrator\AppData\Local\pip\Cache\wheels\39\01\56\f1b08a6275acc59e846fa4c1e1b65dbc1919f20157d9e66c20
  Building wheel for prometheus-client (setup.py): started
  Building wheel for prometheus-client (setup.py): finished with status 'done'
  Created wheel for prometheus-client: filename=prometheus_client-0.7.1-cp36-none-any.whl size=41407 sha256=5b2ca426611809109a8d4065b9361e560b9c94891db6080ee7acb13030bcb2fe
  Stored in directory: C:\Users\VssAdministrator\AppData\Local\pip\Cache\wheels\1c\54\34\fd47cd9b308826cc4292b54449c1899a30251ef3b506bc91ea
Successfully built jellyfish snowballstemmer pandocfilters prometheus-client
Failed to build anonlink
Installing collected packages: numpy, anonlink, ipython, qtconsole, webencodings, bleach, pandocfilters, testpath, MarkupSafe, jinja2, entrypoints, defusedxml, mistune, nbconvert, pywinpty, terminado, prometheus-client, Send2Trash, notebook, widgetsnbextension, ipywidgets, jupyter-console, jupyter, docutils, sphinxcontrib-htmlhelp, snowballstemmer, sphinxcontrib-devhelp, alabaster, sphinxcontrib-applehelp, sphinxcontrib-qthelp, sphinxcontrib-serializinghtml, pytz, babel, sphinxcontrib-jsmath, imagesize, sphinx, nbsphinx, pandas, joblib, scipy, scikit-learn, jellyfish, recordlinkage, sphinxcontrib-programoutput, typing
  Running setup.py install for anonlink: started
    Running setup.py install for anonlink: finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: 'C:\hostedtoolcache\windows\Python\3.6.8\x64\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\VSSADM~1\\AppData\\Local\\Temp\\pip-install-cn5q_1ii\\anonlink\\setup.py'"'"'; __file__='"'"'C:\\Users\\VSSADM~1\\AppData\\Local\\Temp\\pip-install-cn5q_1ii\\anonlink\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\VSSADM~1\AppData\Local\Temp\pip-record-2t2xpk_6\install-record.txt' --single-version-externally-managed --compile
         cwd: C:\Users\VSSADM~1\AppData\Local\Temp\pip-install-cn5q_1ii\anonlink\
    Complete output (38 lines):
    C:\hostedtoolcache\windows\Python\3.6.8\x64\lib\distutils\extension.py:131: UserWarning: Unknown Extension options: 'include'
      warnings.warn(msg)
    running install
    running build
    running build_py
    creating build
    creating build\lib.win-amd64-3.6
    creating build\lib.win-amd64-3.6\anonlink
    copying anonlink\benchmark.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\blocking.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\candidate_generation.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\concurrency.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\serialization.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\stats.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\typechecking.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\_deprecation.py -> build\lib.win-amd64-3.6\anonlink
    copying anonlink\__init__.py -> build\lib.win-amd64-3.6\anonlink
    creating build\lib.win-amd64-3.6\anonlink\similarities
    copying anonlink\similarities\_dice_python.py -> build\lib.win-amd64-3.6\anonlink\similarities
    copying anonlink\similarities\_dice_x86.py -> build\lib.win-amd64-3.6\anonlink\similarities
    copying anonlink\similarities\_smc.py -> build\lib.win-amd64-3.6\anonlink\similarities
    copying anonlink\similarities\_utils.py -> build\lib.win-amd64-3.6\anonlink\similarities
    copying anonlink\similarities\__init__.py -> build\lib.win-amd64-3.6\anonlink\similarities
    creating build\lib.win-amd64-3.6\anonlink\solving
    copying anonlink\solving\_multiparty_solving_python.py -> build\lib.win-amd64-3.6\anonlink\solving
    copying anonlink\solving\__init__.py -> build\lib.win-amd64-3.6\anonlink\solving
    running build_ext
    generating cffi module 'build\\temp.win-amd64-3.6\\Release\\_entitymatcher.cpp'
    creating build\temp.win-amd64-3.6
    creating build\temp.win-amd64-3.6\Release
    building 'solving._multiparty_solving' extension
    creating build\temp.win-amd64-3.6\Release\anonlink
    creating build\temp.win-amd64-3.6\Release\anonlink\solving
    C:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\bin\HostX86\x64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -DNDEBUG -IC:\hostedtoolcache\windows\Python\3.6.8\x64\include -IC:\hostedtoolcache\windows\Python\3.6.8\x64\include "-IC:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\ATLMFC\include" "-IC:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\VC\Tools\MSVC\14.16.27023\include" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.6.1\include\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\winrt" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.17763.0\cppwinrt" /EHsc /Tpanonlink/solving/_multiparty_solving.cpp /Fobuild\temp.win-amd64-3.6\Release\anonlink/solving/_multiparty_solving.obj -std=c++11
    cl : Command line warning D9002 : ignoring unknown option '-std=c++11'
    _multiparty_solving.cpp
    anonlink/solving/_multiparty_solving.cpp(649): fatal error C1083: Cannot open include file: '_multiparty_solving_inner.h': No such file or directory
    error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2017\\Enterprise\\VC\\Tools\\MSVC\\14.16.27023\\bin\\HostX86\\x64\\cl.exe' failed with exit status 2
    ----------------------------------------
ERROR: Command errored out with exit status 1: 'C:\hostedtoolcache\windows\Python\3.6.8\x64\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\VSSADM~1\\AppData\\Local\\Temp\\pip-install-cn5q_1ii\\anonlink\\setup.py'"'"'; __file__='"'"'C:\\Users\\VSSADM~1\\AppData\\Local\\Temp\\pip-install-cn5q_1ii\\anonlink\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\VSSADM~1\AppData\Local\Temp\pip-record-2t2xpk_6\install-record.txt' --single-version-externally-managed --compile Check the logs for full command output.
============================= test session starts =============================
platform win32 -- Python 3.6.8, pytest-4.6.3, py-1.8.0, pluggy-0.12.0
rootdir: D:\a\1\s
plugins: nbval-0.9.1, cov-2.7.1, requests-mock-1.6.0
collected 54 items

docs\tutorial_api.ipynb F

Seems to be an issue with setup...

The anonlink library requires a compiler and is currently only guaranteed to work on 64bit linux.