alibaba / pipcook

Machine learning platform for Web developers

Home Page:https://alibaba.github.io/pipcook/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

costa: use conda instead of venv to support some packages for ppc64le

yorkie opened this issue · comments

As #603 described:

The same problem is found here: https://stackoverflow.com/questions/60825109/tensorflow-installation-fails-on-powerpc-ppc64le, which is caused by no suitable tensorflow package for ppc64le, we might need to change to use conda instead venv to support Pipcook on this type of machine.

Currently, we are using the venv as the Python packages which are not suitable for some platforms like ppc64le, and the conda is able to address this issue.

The steps for init and install packages:

  1. .miniconda/bin/conda create -p {fullpath}
  2. .miniconda/bin/conda install -p {fullpath} {package@ver}

And some unresolved problems:

We can use conda API to avoid forking an unneeded process and friendly to the scheduler.