hpcaitech / OPT-Benchmark

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bug: pip fails to solve requirement colossalai==0.1.9+torch1.11cu11.3

MEllis-github opened this issue · comments

Summary

Following https://github.com/hpcaitech/OPT-Benchmark#run-benchmarking, leads to the following error due to the requirement pip install colossalai==0.1.9+torch1.11cu11.3 -f https://release.colossalai.org.

ERROR: Could not find a version that satisfies the requirement colossalai==0.1.9+torch1.11cu11.3 (from versions: 0.1.8, 0.1.8+torch1.10cu10.2, 0.1.8+torch1.10cu11.1, 0.1.8+torch1.10cu11.3, 0.1.8+torch1.11cu10.2, 0.1.9, 0.1.9+torch1.12cu10.2, 0.1.9+torch1.12cu11.3, 0.1.10, 0.1.10+torch1.10cu10.2, 0.1.10+torch1.10cu11.1, 0.1.10+torch1.10cu11.3, 0.1.10+torch1.11cu10.2, 0.1.10+torch1.11cu11.3, 0.1.10+torch1.12cu10.2, 0.1.10+torch1.12cu11.1, 0.1.10+torch1.12cu11.3)

Questions

  • Which existing colossalai package/release is recommended and tested with OPT-Benchmarks?

Files

Using image: https://github.com/orgs/hpcaitech/packages/container/pytorch-cuda/42358580?tag=1.12.0-11.3.0

Longer output:

Cloning into 'OPT-Benchmark'...
Collecting package metadata (current_repodata.json): ...working... done
Solving environment: ...working... failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... done

## Package Plan ##

  environment location: /opt/conda

  added / updated specs:
    - cudatoolkit=11.3
    - pytorch==1.11.0
    - torchaudio==0.11.0
    - torchvision==0.12.0


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ca-certificates-2022.07.19 |       h06a4308_0         124 KB
    certifi-2022.9.14          |   py39h06a4308_0         155 KB
    conda-22.9.0               |   py39h06a4308_0         884 KB
    libuv-1.40.0               |       h7b6447c_0         736 KB
    pytorch-1.11.0             |py3.9_cuda11.3_cudnn8.2.0_0        1.02 GB  pytorch
    toolz-0.11.2               |     pyhd3eb1b0_0          49 KB
    torchaudio-0.11.0          |       py39_cu113         5.3 MB  pytorch
    torchvision-0.12.0         |       py39_cu113         9.2 MB  pytorch
    ------------------------------------------------------------
                                           Total:        1.04 GB

The following NEW packages will be INSTALLED:

  libuv              pkgs/main/linux-64::libuv-1.40.0-h7b6447c_0
  toolz              pkgs/main/noarch::toolz-0.11.2-pyhd3eb1b0_0

The following packages will be UPDATED:

  ca-certificates                      2022.4.26-h06a4308_0 --> 2022.07.19-h06a4308_0
  certifi                          2022.6.15-py39h06a4308_0 --> 2022.9.14-py39h06a4308_0
  conda                               4.13.0-py39h06a4308_0 --> 22.9.0-py39h06a4308_0

The following packages will be DOWNGRADED:

  pytorch                1.12.0-py3.9_cuda11.3_cudnn8.3.2_0 --> 1.11.0-py3.9_cuda11.3_cudnn8.2.0_0
  torchaudio                              0.12.0-py39_cu113 --> 0.11.0-py39_cu113
  torchvision                             0.13.0-py39_cu113 --> 0.12.0-py39_cu113



Downloading and Extracting Packages
conda-22.9.0         | 884 KB    | ########## | 100% 
pytorch-1.11.0       | 1.02 GB   | ########## | 100% 
torchvision-0.12.0   | 9.2 MB    | ########## | 100% 
ca-certificates-2022 | 124 KB    | ########## | 100% 
toolz-0.11.2         | 49 KB     | ########## | 100% 
torchaudio-0.11.0    | 5.3 MB    | ########## | 100% 
libuv-1.40.0         | 736 KB    | ########## | 100% 
certifi-2022.9.14    | 155 KB    | ########## | 100% 
Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... done
Looking in links: https://release.colossalai.org
ERROR: Could not find a version that satisfies the requirement colossalai==0.1.9+torch1.11cu11.3 (from versions: 0.1.8, 0.1.8+torch1.10cu10.2, 0.1.8+torch1.10cu11.1, 0.1.8+torch1.10cu11.3, 0.1.8+torch1.11cu10.2, 0.1.9, 0.1.9+torch1.12cu10.2, 0.1.9+torch1.12cu11.3, 0.1.10, 0.1.10+torch1.10cu10.2, 0.1.10+torch1.10cu11.1, 0.1.10+torch1.10cu11.3, 0.1.10+torch1.11cu10.2, 0.1.10+torch1.11cu11.3, 0.1.10+torch1.12cu10.2, 0.1.10+torch1.12cu11.1, 0.1.10+torch1.12cu11.3)
ERROR: No matching distribution found for colossalai==0.1.9+torch1.11cu11.3
commented

I've solved this problem in the PR #10, thanks a lot for mentioning this problem, we had noticed that last week and currently working on it to provide you with modified version of test repo.