Installing package from source fails

Question

Installing package from source fails

rradjabi opened this issue a month ago · comments

Instructions state to you can install from source
pip install "intel-npu-acceleration-library @ git+https://github.com/intel/intel-npu-acceleration-library.git" but this fails

To Reproduce

Create new conda env: conda create -n test-env
Activate env: conda activate test-env
Install pip: conda install pip
Install from source: pip install "intel-npu-acceleration-library @ git+https://github.com/intel/intel-npu-acceleration-library.git"

Expected behavior
Expecting it to build and install the package from source.

Screenshots

Desktop (please complete the following information):

OS: Windows 11

Build logs

(base) PS C:\workspace\intel-npu-acceleration-library\script> conda create -n mtl-script-install
Retrieving notices: ...working... done
Channels:
 - defaults
Platform: win-64
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: C:\ProgramData\miniconda3\envs\mtl-script-install



Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate mtl-script-install
#
# To deactivate an active environment, use
#
#     $ conda deactivate

(base) PS C:\workspace\intel-npu-acceleration-library\script> conda activate mtl-script-install
(mtl-script-install) PS C:\workspace\intel-npu-acceleration-library\script> pip install "intel-npu-acceleration-library @ git+https://github.com/intel/intel-npu-acceleration-library.git"
pip : The term 'pip' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the
spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ pip install "intel-npu-acceleration-library @ git+https://github.com/ ...
+ ~~~
    + CategoryInfo          : ObjectNotFound: (pip:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

(mtl-script-install) PS C:\workspace\intel-npu-acceleration-library\script> conda install pip
Channels:
 - defaults
Platform: win-64
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: C:\ProgramData\miniconda3\envs\mtl-script-install

  added / updated specs:
    - pip


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    python-3.12.3              |       h1d929f7_1        16.3 MB
    setuptools-69.5.1          |  py312haa95532_0         1.3 MB
    tk-8.6.14                  |       h0416ee5_0         3.5 MB
    ------------------------------------------------------------
                                           Total:        21.1 MB

The following NEW packages will be INSTALLED:

  bzip2              pkgs/main/win-64::bzip2-1.0.8-h2bbff1b_6
  ca-certificates    pkgs/main/win-64::ca-certificates-2024.3.11-haa95532_0
  expat              pkgs/main/win-64::expat-2.6.2-hd77b12b_0
  libffi             pkgs/main/win-64::libffi-3.4.4-hd77b12b_1
  openssl            pkgs/main/win-64::openssl-3.0.13-h2bbff1b_1
  pip                pkgs/main/win-64::pip-23.3.1-py312haa95532_0
  python             pkgs/main/win-64::python-3.12.3-h1d929f7_1
  setuptools         pkgs/main/win-64::setuptools-69.5.1-py312haa95532_0
  sqlite             pkgs/main/win-64::sqlite-3.45.3-h2bbff1b_0
  tk                 pkgs/main/win-64::tk-8.6.14-h0416ee5_0
  tzdata             pkgs/main/noarch::tzdata-2024a-h04d1e81_0
  vc                 pkgs/main/win-64::vc-14.2-h21ff451_1
  vs2015_runtime     pkgs/main/win-64::vs2015_runtime-14.27.29016-h5e58377_2
  wheel              pkgs/main/win-64::wheel-0.43.0-py312haa95532_0
  xz                 pkgs/main/win-64::xz-5.4.6-h8cc25b3_1
  zlib               pkgs/main/win-64::zlib-1.2.13-h8cc25b3_1


Proceed ([y]/n)? y


Downloading and Extracting Packages:

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
(mtl-script-install) PS C:\workspace\intel-npu-acceleration-library\script> pip install "intel-npu-acceleration-library @ git+https://github.com/intel/intel-npu-acceleration-library.git"
Collecting intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git
  Cloning https://github.com/intel/intel-npu-acceleration-library.git to c:\users\rradj\appdata\local\temp\pip-install-qu0q18vj\intel-npu-acceleration-library_0417a38f59fa40f4b9162d79eee276bb
  Running command git clone --filter=blob:none --quiet https://github.com/intel/intel-npu-acceleration-library.git 'C:\Users\rradj\AppData\Local\Temp\pip-install-qu0q18vj\intel-npu-acceleration-library_0417a38f59fa40f4b9162d79eee276bb'
  Resolved https://github.com/intel/intel-npu-acceleration-library.git to commit 6945762ccede53855847c0b3629d88fda283b437
  Preparing metadata (setup.py) ... done
Collecting numpy (from intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached numpy-1.26.4-cp312-cp312-win_amd64.whl.metadata (61 kB)
Collecting torch (from intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached torch-2.3.0-cp312-cp312-win_amd64.whl.metadata (26 kB)
Collecting transformers>=4.39.3 (from intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Downloading transformers-4.40.2-py3-none-any.whl.metadata (137 kB)
     ---------------------------------------- 138.0/138.0 kB 44.7 kB/s eta 0:00:00
Collecting filelock (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached filelock-3.14.0-py3-none-any.whl.metadata (2.8 kB)
Collecting huggingface-hub<1.0,>=0.19.3 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached huggingface_hub-0.23.0-py3-none-any.whl.metadata (12 kB)
Collecting packaging>=20.0 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached packaging-24.0-py3-none-any.whl.metadata (3.2 kB)
Collecting pyyaml>=5.1 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached PyYAML-6.0.1-cp312-cp312-win_amd64.whl.metadata (2.1 kB)
Collecting regex!=2019.12.17 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached regex-2024.4.28-cp312-cp312-win_amd64.whl.metadata (41 kB)
Collecting requests (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting tokenizers<0.20,>=0.19 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached tokenizers-0.19.1-cp312-none-win_amd64.whl.metadata (6.9 kB)
Collecting safetensors>=0.4.1 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached safetensors-0.4.3-cp312-none-win_amd64.whl.metadata (3.9 kB)
Collecting tqdm>=4.27 (from transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached tqdm-4.66.4-py3-none-any.whl.metadata (57 kB)
Collecting typing-extensions>=4.8.0 (from torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached typing_extensions-4.11.0-py3-none-any.whl.metadata (3.0 kB)
Collecting sympy (from torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached sympy-1.12-py3-none-any.whl.metadata (12 kB)
Collecting networkx (from torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached networkx-3.3-py3-none-any.whl.metadata (5.1 kB)
Collecting jinja2 (from torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Downloading jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting fsspec (from torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached fsspec-2024.3.1-py3-none-any.whl.metadata (6.8 kB)
Collecting mkl<=2021.4.0,>=2021.1.1 (from torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached mkl-2021.4.0-py2.py3-none-win_amd64.whl.metadata (1.4 kB)
Collecting intel-openmp==2021.* (from mkl<=2021.4.0,>=2021.1.1->torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached intel_openmp-2021.4.0-py2.py3-none-win_amd64.whl.metadata (1.2 kB)
Collecting tbb==2021.* (from mkl<=2021.4.0,>=2021.1.1->torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached tbb-2021.12.0-py3-none-win_amd64.whl.metadata (1.1 kB)
Collecting colorama (from tqdm>=4.27->transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached colorama-0.4.6-py2.py3-none-any.whl.metadata (17 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached MarkupSafe-2.1.5-cp312-cp312-win_amd64.whl.metadata (3.1 kB)
Collecting charset-normalizer<4,>=2 (from requests->transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached charset_normalizer-3.3.2-cp312-cp312-win_amd64.whl.metadata (34 kB)
Collecting idna<4,>=2.5 (from requests->transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached idna-3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting urllib3<3,>=1.21.1 (from requests->transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB)
Collecting certifi>=2017.4.17 (from requests->transformers>=4.39.3->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached certifi-2024.2.2-py3-none-any.whl.metadata (2.2 kB)
Collecting mpmath>=0.19 (from sympy->torch->intel-npu-acceleration-library@ git+https://github.com/intel/intel-npu-acceleration-library.git)
  Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Downloading transformers-4.40.2-py3-none-any.whl (9.0 MB)
   ---------------------------------------- 9.0/9.0 MB 251.3 kB/s eta 0:00:00
Using cached numpy-1.26.4-cp312-cp312-win_amd64.whl (15.5 MB)
Using cached torch-2.3.0-cp312-cp312-win_amd64.whl (159.7 MB)
Using cached huggingface_hub-0.23.0-py3-none-any.whl (401 kB)
Using cached fsspec-2024.3.1-py3-none-any.whl (171 kB)
Using cached mkl-2021.4.0-py2.py3-none-win_amd64.whl (228.5 MB)
Using cached intel_openmp-2021.4.0-py2.py3-none-win_amd64.whl (3.5 MB)
Using cached tbb-2021.12.0-py3-none-win_amd64.whl (286 kB)
Using cached packaging-24.0-py3-none-any.whl (53 kB)
Using cached PyYAML-6.0.1-cp312-cp312-win_amd64.whl (138 kB)
Using cached regex-2024.4.28-cp312-cp312-win_amd64.whl (268 kB)
Using cached safetensors-0.4.3-cp312-none-win_amd64.whl (289 kB)
Using cached tokenizers-0.19.1-cp312-none-win_amd64.whl (2.2 MB)
Using cached tqdm-4.66.4-py3-none-any.whl (78 kB)
Using cached typing_extensions-4.11.0-py3-none-any.whl (34 kB)
Using cached filelock-3.14.0-py3-none-any.whl (12 kB)
Downloading jinja2-3.1.4-py3-none-any.whl (133 kB)
   ---------------------------------------- 133.3/133.3 kB 314.7 kB/s eta 0:00:00
Using cached networkx-3.3-py3-none-any.whl (1.7 MB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached sympy-1.12-py3-none-any.whl (5.7 MB)
Using cached certifi-2024.2.2-py3-none-any.whl (163 kB)
Using cached charset_normalizer-3.3.2-cp312-cp312-win_amd64.whl (100 kB)
Using cached idna-3.7-py3-none-any.whl (66 kB)
Using cached MarkupSafe-2.1.5-cp312-cp312-win_amd64.whl (17 kB)
Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Using cached urllib3-2.2.1-py3-none-any.whl (121 kB)
Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Building wheels for collected packages: intel-npu-acceleration-library
  Building wheel for intel-npu-acceleration-library (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [33 lines of output]
      C:\ProgramData\miniconda3\envs\mtl-script-install\Lib\site-packages\setuptools\dist.py:318: InformationOnly: Normalizing 'v1.0.0' to '1.0.0'
        self.metadata.version = self._normalize_version(self.metadata.version)
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build\lib.win-amd64-cpython-312
      creating build\lib.win-amd64-cpython-312\intel_npu_acceleration_library
      copying intel_npu_acceleration_library\compiler.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library
      copying intel_npu_acceleration_library\optimizations.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library
      copying intel_npu_acceleration_library\quantization.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library
      copying intel_npu_acceleration_library\__init__.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library
      creating build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\base.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\bindings.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\factory.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\linear.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\matmul.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\mlp.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\ops.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\qlinear.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\qmatmul.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\runtime.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      copying intel_npu_acceleration_library\backend\__init__.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\backend
      creating build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\nn
      copying intel_npu_acceleration_library\nn\autograd.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\nn
      copying intel_npu_acceleration_library\nn\conv.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\nn
      copying intel_npu_acceleration_library\nn\linear.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\nn
      copying intel_npu_acceleration_library\nn\llm.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\nn
      copying intel_npu_acceleration_library\nn\__init__.py -> build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\nn
      running build_ext
      cmake C:\Users\rradj\AppData\Local\Temp\pip-install-qu0q18vj\intel-npu-acceleration-library_0417a38f59fa40f4b9162d79eee276bb -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=C:\Users\rradj\AppData\Local\Temp\pip-install-qu0q18vj\intel-npu-acceleration-library_0417a38f59fa40f4b9162d79eee276bb\build\lib.win-amd64-cpython-312\intel_npu_acceleration_library\lib -DCMAKE_BUILD_TYPE=Release
      error: command 'cmake' failed: None
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for intel-npu-acceleration-library
  Running setup.py clean for intel-npu-acceleration-library
Failed to build intel-npu-acceleration-library
ERROR: Could not build wheels for intel-npu-acceleration-library, which is required to install pyproject.toml-based projects
(mtl-script-install) PS C:\workspace\intel-npu-acceleration-library\script>

Alessandro Palla · Answer 1 · Wed May 08 2024 13:52:15 GMT+0800 (China Standard Time)

Hi,
to install the package from source, you need a compiler and cmake. In your case it seems that you miss the last one. Since you are using conda, you can install it from there