Broken docker-stacks-foundation image #2
sergree opened this issue · comments
What docker image(s) are you using?
docker-stacks-foundation
Host OS system
Ubuntu 22.04
Host architecture
x86_64
What Docker command are you running?
docker build -t my-container --build-arg PYTHON_VERSION="3.10" --build-arg ROOT_CONTAINER="nvidia/cuda:11.4.3-cudnn8-devel-ubuntu20.04" docker-stacks/images/docker-stacks-foundation
How to Reproduce the problem?
Run that Docker command
Command output
2.140 Connecting to binstar-cio-packages-prod.s3.amazonaws.com (binstar-cio-packages-prod.s3.amazonaws.com)|52.217.166.105|:443... connected.
2.649 HTTP request sent, awaiting response... 200 OK
2.858 Length: 5351732 (5.1M) [application/x-tar]
2.858 Saving to: ‘/tmp/micromamba.tar.bz2’
3.978
3.978 0K ..... 100% 2.55M=2.0s
4.859
4.859 2023-12-08 06:58:31 (2.55 MB/s) - ‘/tmp/micromamba.tar.bz2’ saved [5351732/5351732]
4.859
4.872 + tar -xvjf /tmp/micromamba.tar.bz2 --strip-components=1 bin/micromamba
4.900 bin/micromamba
5.571 + rm /tmp/micromamba.tar.bz2
5.573 + PYTHON_SPECIFIER=python=3.10
5.573 + [[ 3.10 == \d\e\f\a\u\l\t ]]
5.573 + ./micromamba install --root-prefix=/opt/conda --prefix=/opt/conda --yes python=3.10 mamba jupyter_core
22.05
22.05 Transaction
22.05
22.05 Prefix: /opt/conda
22.05
22.05 Updating specs:
22.05
22.05 - python=3.10
22.05 - mamba
22.05 - jupyter_core
22.05
22.05
22.06 Package Version Build Channel Size
22.06 ──────────────────────────────────────────────────────────────────────────────────────
22.06 Install:
22.06 ──────────────────────────────────────────────────────────────────────────────────────
22.06
22.06 + _libgcc_mutex 0.1 conda_forge conda-forge 3kB
22.06 + libstdcxx-ng 13.2.0 h7e041cc_3 conda-forge 4MB
22.06 + python_abi 3.10 4_cp310 conda-forge 6kB
22.06 + ld_impl_linux-64 2.40 h41732ed_0 conda-forge 705kB
22.06 + ca-certificates 2023.11.17 hbcca054_0 conda-forge 154kB
22.06 + libgomp 13.2.0 h807b86a_3 conda-forge 422kB
22.06 + _openmp_mutex 4.5 2_gnu conda-forge 24kB
22.06 + libgcc-ng 13.2.0 h807b86a_3 conda-forge 774kB
22.06 + lzo 2.10 h516909a_1000 conda-forge 321kB
22.06 + c-ares 1.23.0 hd590300_0 conda-forge 154kB
22.06 + libev 4.33 h516909a_1 conda-forge 106kB
22.06 + lz4-c 1.9.4 hcb278e6_0 conda-forge 143kB
22.06 + keyutils 1.6.1 h166bdaf_0 conda-forge 118kB
22.06 + icu 73.2 h59595ed_0 conda-forge 12MB
22.06 + libiconv 1.17 h166bdaf_0 conda-forge 1MB
22.06 + reproc 14.2.4.post0 hd590300_1 conda-forge 34kB
22.06 + fmt 10.1.1 h00ab1b0_1 conda-forge 192kB
22.06 + openssl 3.2.0 hd590300_1 conda-forge 3MB
22.06 + libffi 3.4.2 h7f98852_5 conda-forge 58kB
22.06 + bzip2 1.0.8 hd590300_5 conda-forge 254kB
22.06 + ncurses 6.4 h59595ed_2 conda-forge 884kB
22.06 + libzlib 1.2.13 hd590300_5 conda-forge 62kB
22.06 + yaml-cpp 0.8.0 h59595ed_0 conda-forge 205kB
22.06 + libuuid 2.38.1 h0b41bf4_0 conda-forge 34kB
22.06 + libnsl 2.0.1 hd590300_0 conda-forge 33kB
22.06 + xz 5.2.6 h166bdaf_0 conda-forge 418kB
22.06 + reproc-cpp 14.2.4.post0 h59595ed_1 conda-forge 25kB
22.06 + libedit 3.1.20191231 he28a2e2_2 conda-forge 124kB
22.06 + readline 8.2 h8228510_1 conda-forge 281kB
22.06 + libsolv 0.7.27 hfc55251_0 conda-forge 470kB
22.06 + libssh2 1.11.0 h0841786_0 conda-forge 271kB
22.06 + libnghttp2 1.58.0 h47da74e_0 conda-forge 631kB
22.06 + tk 8.6.13 noxft_h4845f30_101 conda-forge 3MB
22.06 + libsqlite 3.44.2 h2797004_0 conda-forge 846kB
22.06 + zstd 1.5.5 hfc55251_0 conda-forge 545kB
22.06 + libxml2 2.12.2 h232c23b_0 conda-forge 705kB
22.06 + krb5 1.21.2 h659d440_0 conda-forge 1MB
22.06 + libarchive 3.7.2 h2aa1ff5_1 conda-forge 866kB
22.06 + libcurl 8.5.0 hca28451_0 conda-forge 389kB
22.06 + libmamba 1.5.4 had39da4_0 conda-forge 2MB
22.06 + tzdata 2023c h71feb2d_0 conda-forge 118kB
22.06 + pybind11-abi 4 hd8ed1ab_3 conda-forge 10kB
22.06 + python 3.10.13 hd12c33a_0_cpython conda-forge 25MB
22.06 + wheel 0.42.0 pyhd8ed1ab_0 conda-forge 58kB
22.06 + setuptools 68.2.2 pyhd8ed1ab_0 conda-forge 464kB
22.06 + pip 23.3.1 pyhd8ed1ab_0 conda-forge 1MB
22.06 + pysocks 1.7.1 pyha2e5f31_6 conda-forge 19kB
22.06 + idna 3.6 pyhd8ed1ab_0 conda-forge 50kB
22.06 + certifi 2023.11.17 pyhd8ed1ab_0 conda-forge 159kB
22.06 + colorama 0.4.6 pyhd8ed1ab_0 conda-forge 25kB
22.06 + pycparser 2.21 pyhd8ed1ab_0 conda-forge 103kB
22.06 + packaging 23.2 pyhd8ed1ab_0 conda-forge 49kB
22.06 + distro 1.8.0 pyhd8ed1ab_0 conda-forge 41kB
22.06 + charset-normalizer 3.3.2 pyhd8ed1ab_0 conda-forge 47kB
22.06 + archspec 0.2.2 pyhd8ed1ab_0 conda-forge 42kB
22.06 + pluggy 1.3.0 pyhd8ed1ab_0 conda-forge 23kB
22.06 + traitlets 5.14.0 pyhd8ed1ab_0 conda-forge 110kB
22.06 + platformdirs 4.1.0 pyhd8ed1ab_0 conda-forge 20kB
22.06 + truststore 0.8.0 pyhd8ed1ab_0 conda-forge 21kB
22.06 + boltons 23.0.0 pyhd8ed1ab_0 conda-forge 303kB
22.06 + tqdm 4.66.1 pyhd8ed1ab_0 conda-forge 89kB
22.06 + brotli-python 1.1.0 py310hc6cd4ac_1 conda-forge 349kB
22.06 + ruamel.yaml.clib 0.2.7 py310h2372a71_2 conda-forge 135kB
22.06 + jsonpointer 2.4 py310hff52083_3 conda-forge 16kB
22.06 + menuinst 2.0.0 py310hff52083_1 conda-forge 134kB
22.06 + pycosat 0.6.6 py310h2372a71_0 conda-forge 87kB
22.06 + libmambapy 1.5.4 py310h39ff949_0 conda-forge 302kB
22.06 + cffi 1.16.0 py310h2fee648_0 conda-forge 241kB
22.06 + jupyter_core 5.5.0 py310hff52083_0 conda-forge 79kB
22.06 + ruamel.yaml 0.18.5 py310h2372a71_0 conda-forge 202kB
22.06 + zstandard 0.22.0 py310h1275a96_0 conda-forge 404kB
22.06 + urllib3 2.1.0 pyhd8ed1ab_0 conda-forge 85kB
22.06 + jsonpatch 1.33 pyhd8ed1ab_0 conda-forge 17kB
22.06 + conda-package-streaming 0.9.0 pyhd8ed1ab_0 conda-forge 19kB
22.06 + requests 2.31.0 pyhd8ed1ab_0 conda-forge 57kB
22.06 + conda-package-handling 2.2.0 pyh38be061_0 conda-forge 255kB
22.06 + conda 23.11.0 py310hff52083_1 conda-forge 979kB
22.06 + conda-libmamba-solver 23.11.1 pyhd8ed1ab_0 conda-forge 47kB
22.06 + mamba 1.5.4 py310h51d5547_0 conda-forge 52kB
22.06
22.06 Summary:
22.06
22.06 Install: 79 packages
22.06
22.06 Total download: 69MB
22.06
22.06 ──────────────────────────────────────────────────────────────────────────────────────
22.06
22.06
22.06
22.06 Transaction starting
29.24 Linking _libgcc_mutex-0.1-conda_forge
29.24 Linking libstdcxx-ng-13.2.0-h7e041cc_3
29.24 Linking python_abi-3.10-4_cp310
29.24 Linking ld_impl_linux-64-2.40-h41732ed_0
29.25 Linking ca-certificates-2023.11.17-hbcca054_0
29.25 Linking libgomp-13.2.0-h807b86a_3
29.25 Linking _openmp_mutex-4.5-2_gnu
29.25 Linking libgcc-ng-13.2.0-h807b86a_3
29.25 Linking lzo-2.10-h516909a_1000
29.26 Linking c-ares-1.23.0-hd590300_0
29.27 Linking libev-4.33-h516909a_1
29.27 Linking lz4-c-1.9.4-hcb278e6_0
29.27 Linking keyutils-1.6.1-h166bdaf_0
29.27 Linking icu-73.2-h59595ed_0
29.30 Linking libiconv-1.17-h166bdaf_0
29.31 Linking reproc-14.2.4.post0-hd590300_1
29.31 Linking fmt-10.1.1-h00ab1b0_1
29.31 Linking openssl-3.2.0-hd590300_1
29.34 Linking libffi-3.4.2-h7f98852_5
29.34 Linking bzip2-1.0.8-hd590300_5
29.34 Linking ncurses-6.4-h59595ed_2
30.94 Linking libzlib-1.2.13-hd590300_5
30.94 Linking yaml-cpp-0.8.0-h59595ed_0
30.94 Linking libuuid-2.38.1-h0b41bf4_0
30.95 Linking libnsl-2.0.1-hd590300_0
30.95 Linking xz-5.2.6-h166bdaf_0
30.96 Linking reproc-cpp-14.2.4.post0-h59595ed_1
30.97 Linking libedit-3.1.20191231-he28a2e2_2
30.97 Linking readline-8.2-h8228510_1
30.97 Linking libsolv-0.7.27-hfc55251_0
30.98 Linking libssh2-1.11.0-h0841786_0
30.99 Linking libnghttp2-1.58.0-h47da74e_0
31.00 Linking tk-8.6.13-noxft_h4845f30_101
31.04 Linking libsqlite-3.44.2-h2797004_0
31.04 Linking zstd-1.5.5-hfc55251_0
31.04 Linking libxml2-2.12.2-h232c23b_0
31.05 Linking krb5-1.21.2-h659d440_0
31.07 Linking libarchive-3.7.2-h2aa1ff5_1
31.07 Linking libcurl-8.5.0-hca28451_0
31.08 Linking libmamba-1.5.4-had39da4_0
31.09 Linking tzdata-2023c-h71feb2d_0
31.12 Linking pybind11-abi-4-hd8ed1ab_3
31.12 Linking python-3.10.13-hd12c33a_0_cpython
31.34 Linking wheel-0.42.0-pyhd8ed1ab_0
31.47 Linking setuptools-68.2.2-pyhd8ed1ab_0
31.49 Linking pip-23.3.1-pyhd8ed1ab_0
31.54 Linking pysocks-1.7.1-pyha2e5f31_6
31.54 Linking idna-3.6-pyhd8ed1ab_0
31.54 Linking certifi-2023.11.17-pyhd8ed1ab_0
31.55 Linking colorama-0.4.6-pyhd8ed1ab_0
31.55 Linking pycparser-2.21-pyhd8ed1ab_0
31.56 Linking packaging-23.2-pyhd8ed1ab_0
31.57 Linking distro-1.8.0-pyhd8ed1ab_0
31.57 Linking charset-normalizer-3.3.2-pyhd8ed1ab_0
31.58 Linking archspec-0.2.2-pyhd8ed1ab_0
31.59 Linking pluggy-1.3.0-pyhd8ed1ab_0
31.59 Linking traitlets-5.14.0-pyhd8ed1ab_0
31.59 Linking platformdirs-4.1.0-pyhd8ed1ab_0
31.59 Linking truststore-0.8.0-pyhd8ed1ab_0
31.60 Linking boltons-23.0.0-pyhd8ed1ab_0
31.60 Linking tqdm-4.66.1-pyhd8ed1ab_0
31.61 Linking brotli-python-1.1.0-py310hc6cd4ac_1
31.61 Linking ruamel.yaml.clib-0.2.7-py310h2372a71_2
31.61 Linking jsonpointer-2.4-py310hff52083_3
31.61 Linking menuinst-2.0.0-py310hff52083_1
31.62 Linking pycosat-0.6.6-py310h2372a71_0
31.62 Linking libmambapy-1.5.4-py310h39ff949_0
31.63 Linking cffi-1.16.0-py310h2fee648_0
31.63 Linking jupyter_core-5.5.0-py310hff52083_0
31.64 Linking ruamel.yaml-0.18.5-py310h2372a71_0
31.65 Linking zstandard-0.22.0-py310h1275a96_0
31.65 Linking urllib3-2.1.0-pyhd8ed1ab_0
31.66 Linking jsonpatch-1.33-pyhd8ed1ab_0
31.66 Linking conda-package-streaming-0.9.0-pyhd8ed1ab_0
31.67 Linking requests-2.31.0-pyhd8ed1ab_0
31.68 Linking conda-package-handling-2.2.0-pyh38be061_0
31.69 Linking conda-23.11.0-py310hff52083_1
31.76 Linking conda-libmamba-solver-23.11.1-pyhd8ed1ab_0
31.77 Linking mamba-1.5.4-py310h51d5547_0
32.34
32.34 Transaction finished
32.34
32.34 To activate this environment, use:
32.34
32.34 micromamba activate base
32.34
32.34 Or to execute a single command in this environment, use:
32.34
32.34 micromamba run -n base mycommand
32.34
32.37 + rm micromamba
32.38 + wget --progress=dot:giga https://raw.githubusercontent.com/mamba-org/mamba/cf9c063479c7bd32f1e6e8adfd04a1e15ba12981/mamba/mamba/mamba.py -O /opt/conda/lib/python3.11/site-packages/mamba/mamba.py
32.38 /opt/conda/lib/python3.11/site-packages/mamba/mamba.py: No such file or directory
------
Dockerfile:99
--------------------
98 | WORKDIR /tmp
99 | >>> RUN set -x && \
100 | >>> arch=$(uname -m) && \
101 | >>> if [ "${arch}" = "x86_64" ]; then \
102 | >>> # Should be simpler, see <https://github.com/mamba-org/mamba/issues/1437>
103 | >>> arch="64"; \
104 | >>> fi && \
105 | >>> wget --progress=dot:giga -O /tmp/micromamba.tar.bz2 \
106 | >>> "https://micromamba.snakepit.net/api/micromamba/linux-${arch}/latest" && \
107 | >>> tar -xvjf /tmp/micromamba.tar.bz2 --strip-components=1 bin/micromamba && \
108 | >>> rm /tmp/micromamba.tar.bz2 && \
109 | >>> PYTHON_SPECIFIER="python=${PYTHON_VERSION}" && \
110 | >>> if [[ "${PYTHON_VERSION}" == "default" ]]; then PYTHON_SPECIFIER="python"; fi && \
111 | >>> # Install the packages
112 | >>> ./micromamba install \
113 | >>> --root-prefix="${CONDA_DIR}" \
114 | >>> --prefix="${CONDA_DIR}" \
115 | >>> --yes \
116 | >>> "${PYTHON_SPECIFIER}" \
117 | >>> 'mamba' \
118 | >>> 'jupyter_core' && \
119 | >>> rm micromamba && \
120 | >>> # Temporary fix till mamba 1.5.5 is released
121 | >>> # Download mamba.py after merged fix for `mamba clean`: https://github.com/mamba-org/mamba/pull/3040
122 | >>> wget --progress=dot:giga https://raw.githubusercontent.com/mamba-org/mamba/cf9c063479c7bd32f1e6e8adfd04a1e15ba12981/mamba/mamba/mamba.py \
123 | >>> -O /opt/conda/lib/python3.11/site-packages/mamba/mamba.py && \
124 | >>> # Pin major.minor version of python
125 | >>> mamba list python | grep '^python ' | tr -s ' ' | cut -d ' ' -f 1,2 >> "${CONDA_DIR}/conda-meta/pinned" && \
126 | >>> mamba clean --all -f -y && \
127 | >>> fix-permissions "${CONDA_DIR}" && \
128 | >>> fix-permissions "/home/${NB_USER}"
129 |
--------------------
ERROR: failed to solve: process "/bin/bash -o pipefail -c set -x && arch=$(uname -m) && if [ \"${arch}\" = \"x86_64\" ]; then arch=\"64\"; fi && wget --progress=dot:giga -O /tmp/micromamba.tar.bz2 \"https://micromamba.snakepit.net/api/micromamba/linux-${arch}/latest\" && tar -xvjf /tmp/micromamba.tar.bz2 --strip-components=1 bin/micromamba && rm /tmp/micromamba.tar.bz2 && PYTHON_SPECIFIER=\"python=${PYTHON_VERSION}\" && if [[ \"${PYTHON_VERSION}\" == \"default\" ]]; then PYTHON_SPECIFIER=\"python\"; fi && ./micromamba install --root-prefix=\"${CONDA_DIR}\" --prefix=\"${CONDA_DIR}\" --yes \"${PYTHON_SPECIFIER}\" 'mamba' 'jupyter_core' && rm micromamba && wget --progress=dot:giga https://raw.githubusercontent.com/mamba-org/mamba/cf9c063479c7bd32f1e6e8adfd04a1e15ba12981/mamba/mamba/mamba.py -O /opt/conda/lib/python3.11/site-packages/mamba/mamba.py && mamba list python | grep '^python ' | tr -s ' ' | cut -d ' ' -f 1,2 >> \"${CONDA_DIR}/conda-meta/pinned\" && mamba clean --all -f -y && fix-permissions \"${CONDA_DIR}\" && fix-permissions \"/home/${NB_USER}\"" did not complete successfully: exit code: 1Expected behavior
No response
Actual behavior
docker-stacks-foundation building with Python 3.10 is broken, it gives me this error
Anything else?
I specified python v 3.10, but it seems it tries to find mamba in 3.11...
32.38 + wget --progress=dot:giga https://raw.githubusercontent.com/mamba-org/mamba/cf9c063479c7bd32f1e6e8adfd04a1e15ba12981/mamba/mamba/mamba.py -O /opt/conda/lib/python3.11/site-packages/mamba/mamba.py
32.38 /opt/conda/lib/python3.11/site-packages/mamba/mamba.py: No such file or directory
Latest Docker version
- I've updated my Docker version to the latest available, and the issue persists
Pushed a commit that gets rid of 3.11 hardcode, should work for you now.
@mathbunnyru, thank you for your help!