Building Docker Image Taking Forever - Hung on pip Dependency Resolution?
practical-dreamer opened this issue · comments
Describe the bug
Objective:
Having trouble building docker image from 'Alternative: Docker' section of README.md. - hoping some chad out there will help me figure why it's hanging.
Issue:
After half an hour docker compose is still running (see my logs) - doesn't seem normal when pip install -r requirements takes under 2 minutes in a fresh conda env.
Observation:
According to stdout from docker compose up --build it seems I'm downloading MULTIPLE versions of packages which does not occur when running pip install -r requirements from a conda env.
Here's a small sample (see the logs section for the complete output)
#11 1173.8 Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1173.8 Downloading tokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 1192.1 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1192.1 Downloading transformers-4.33.2-py3-none-any.whl.metadata (119 kB)
#11 1210.4 Downloading transformers-4.33.1-py3-none-any.whl.metadata (119 kB)
#11 1228.8 Downloading transformers-4.33.0-py3-none-any.whl.metadata (119 kB)
#11 1247.4 Collecting spacy[ja]>=3 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1247.4 Using cached spacy-3.8.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1977.8 Downloading spacy-3.7.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1977.8 INFO: pip is looking at multiple versions of spacy[ja] to determine which version is compatible with other requirements. This could take a while.
#11 1977.9 Downloading spacy-3.7.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1977.9 Downloading spacy-3.7.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
Is there an existing issue for this?
- I have searched the existing issues
Reproduction
curl -fsSL https://get.docker.com -o get-docker.sh
sudo sh get-docker.sh
sudo usermod -aG docker $USER
ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
mkdir -p logs cache
docker compose up --build | tee docker_output.log
Screenshot
Logs
user@hostname:~/REPOS/text-generation-webui$ cat docker_output.log
#0 building with "default" instance using docker driver
#1 [text-generation-webui internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.20kB done
#1 DONE 0.0s
#2 [text-generation-webui internal] load metadata for docker.io/library/ubuntu:22.04
#2 DONE 0.8s
#3 [text-generation-webui internal] load .dockerignore
#3 transferring context: 204B done
#3 DONE 0.0s
#4 [text-generation-webui stage-0 1/9] FROM docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe
#4 DONE 0.0s
#5 [text-generation-webui stage-0 2/9] WORKDIR /builder
#5 CACHED
#6 [text-generation-webui stage-0 3/9] RUN --mount=type=cache,target=/var/cache/apt,sharing=locked,rw apt update && apt install --no-install-recommends -y git vim build-essential python3-dev pip bash curl && rm -rf /var/lib/apt/lists/*
#6 CACHED
#7 [text-generation-webui stage-0 4/9] WORKDIR /home/app/
#7 CACHED
#8 [text-generation-webui stage-0 5/9] RUN git clone https://github.com/oobabooga/text-generation-webui.git
#8 CACHED
#9 [text-generation-webui stage-0 6/9] WORKDIR /home/app/text-generation-webui
#9 CACHED
#10 [text-generation-webui internal] load build context
#10 transferring context: 34B done
#10 DONE 0.0s
#11 [text-generation-webui stage-0 7/9] RUN GPU_CHOICE=A USE_CUDA118=FALSE LAUNCH_AFTER_INSTALL=FALSE INSTALL_EXTENSIONS=TRUE ./start_linux.sh --verbose
#11 0.191 Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.3.1-0-Linux-x86_64.sh to /home/app/text-generation-webui/installer_files/miniconda_installer.sh
#11 0.195 % Total % Received % Xferd Average Speed Time Time Time Current
#11 0.195 Dload Upload Total Spent Left Speed
100 69.7M 100 69.7M 0 0 50.8M 0 0:00:01 0:00:01 --:--:-- 50.8M
#11 1.571 PREFIX=/home/app/text-generation-webui/installer_files/conda
#11 1.707 Unpacking payload ...
#11 3.320 Installing base environment...
#11 3.320
#11 3.693
#11 3.693 Downloading and Extracting Packages
#11 3.693
#11 3.693
#11 3.693 Downloading and Extracting Packages
#11 3.693
#11 3.693 Preparing transaction: ...working... done
#11 4.012 Executing transaction: ...working... done
#11 5.430 installation finished.
#11 5.430 Miniconda version:
#11 5.695 conda 23.3.1
#11 6.008 Collecting package metadata (current_repodata.json): ...working... done
#11 9.310 Solving environment: ...working... done
#11 9.378
#11 9.378
#11 9.378 ==> WARNING: A newer version of conda exists. <==
#11 9.378 current version: 23.3.1
#11 9.378 latest version: 24.9.2
#11 9.378
#11 9.378 Please update conda by running
#11 9.378
#11 9.378 $ conda update -n base -c defaults conda
#11 9.378
#11 9.378 Or to minimize the number of packages updated during conda update use
#11 9.378
#11 9.378 conda install conda=24.9.2
#11 9.378
#11 9.378
#11 9.393
#11 9.393 ## Package Plan ##
#11 9.393
#11 9.393 environment location: /home/app/text-generation-webui/installer_files/env
#11 9.393
#11 9.393 added / updated specs:
#11 9.393 - python=3.11
#11 9.393
#11 9.393
#11 9.393 The following packages will be downloaded:
#11 9.393
#11 9.393 package | build
#11 9.393 ---------------------------|-----------------
#11 9.393 bzip2-1.0.8 | h5eee18b_6 262 KB
#11 9.393 ca-certificates-2024.9.24 | h06a4308_0 130 KB
#11 9.393 ld_impl_linux-64-2.40 | h12ee557_0 710 KB
#11 9.393 libffi-3.4.4 | h6a678d5_1 141 KB
#11 9.393 openssl-3.0.15 | h5eee18b_0 5.2 MB
#11 9.393 pip-24.2 | py311h06a4308_0 2.8 MB
#11 9.393 python-3.11.10 | he870216_0 32.9 MB
#11 9.393 setuptools-75.1.0 | py311h06a4308_0 2.2 MB
#11 9.393 sqlite-3.45.3 | h5eee18b_0 1.2 MB
#11 9.393 tk-8.6.14 | h39e8969_0 3.4 MB
#11 9.393 tzdata-2024b | h04d1e81_0 115 KB
#11 9.393 wheel-0.44.0 | py311h06a4308_0 145 KB
#11 9.393 xz-5.4.6 | h5eee18b_1 643 KB
#11 9.393 zlib-1.2.13 | h5eee18b_1 111 KB
#11 9.393 ------------------------------------------------------------
#11 9.393 Total: 50.0 MB
#11 9.393
#11 9.393 The following NEW packages will be INSTALLED:
#11 9.393
#11 9.393 _libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
#11 9.393 _openmp_mutex pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu
#11 9.393 bzip2 pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_6
#11 9.393 ca-certificates pkgs/main/linux-64::ca-certificates-2024.9.24-h06a4308_0
#11 9.393 ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.40-h12ee557_0
#11 9.393 libffi pkgs/main/linux-64::libffi-3.4.4-h6a678d5_1
#11 9.393 libgcc-ng pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1
#11 9.393 libgomp pkgs/main/linux-64::libgomp-11.2.0-h1234567_1
#11 9.393 libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1
#11 9.393 libuuid pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0
#11 9.393 ncurses pkgs/main/linux-64::ncurses-6.4-h6a678d5_0
#11 9.393 openssl pkgs/main/linux-64::openssl-3.0.15-h5eee18b_0
#11 9.393 pip pkgs/main/linux-64::pip-24.2-py311h06a4308_0
#11 9.393 python pkgs/main/linux-64::python-3.11.10-he870216_0
#11 9.393 readline pkgs/main/linux-64::readline-8.2-h5eee18b_0
#11 9.393 setuptools pkgs/main/linux-64::setuptools-75.1.0-py311h06a4308_0
#11 9.393 sqlite pkgs/main/linux-64::sqlite-3.45.3-h5eee18b_0
#11 9.393 tk pkgs/main/linux-64::tk-8.6.14-h39e8969_0
#11 9.393 tzdata pkgs/main/noarch::tzdata-2024b-h04d1e81_0
#11 9.393 wheel pkgs/main/linux-64::wheel-0.44.0-py311h06a4308_0
#11 9.393 xz pkgs/main/linux-64::xz-5.4.6-h5eee18b_1
#11 9.393 zlib pkgs/main/linux-64::zlib-1.2.13-h5eee18b_1
#11 9.393
#11 9.393
#11 9.393
#11 9.393 Downloading and Extracting Packages
#11 11.30 Preparing transaction: ...working... done
#11 11.55 Verifying transaction: ...working... done
#11 12.69 Executing transaction: ...working... done
#11 13.58 #
#11 13.58 # To activate this environment, use
#11 13.58 #
#11 13.58 # $ conda activate /home/app/text-generation-webui/installer_files/env
#11 13.58 #
#11 13.58 # To deactivate an active environment, use
#11 13.58 #
#11 13.58 # $ conda deactivate
#11 13.58
#11 15.05 Collecting package metadata (current_repodata.json): ...working... done
#11 17.39 Solving environment: ...working... done
#11 17.65
#11 17.65
#11 17.65 ==> WARNING: A newer version of conda exists. <==
#11 17.65 current version: 23.3.1
#11 17.65 latest version: 24.9.2
#11 17.65
#11 17.65 Please update conda by running
#11 17.65
#11 17.65 $ conda update -n base -c defaults conda
#11 17.65
#11 17.65 Or to minimize the number of packages updated during conda update use
#11 17.65
#11 17.65 conda install conda=24.9.2
#11 17.65
#11 17.65
#11 17.67
#11 17.67 ## Package Plan ##
#11 17.67
#11 17.67 environment location: /home/app/text-generation-webui/installer_files/env
#11 17.67
#11 17.67 added / updated specs:
#11 17.67 - git
#11 17.67 - ninja
#11 17.67
#11 17.67
#11 17.67 The following packages will be downloaded:
#11 17.67
#11 17.67 package | build
#11 17.67 ---------------------------|-----------------
#11 17.67 c-ares-1.19.1 | h5eee18b_0 118 KB
#11 17.67 curl-8.9.1 | hdbd6064_0 87 KB
#11 17.67 expat-2.6.3 | h6a678d5_0 176 KB
#11 17.67 gdbm-1.18 | hd4cb3f1_4 194 KB
#11 17.67 gettext-0.21.0 | hedfda30_2 3.0 MB
#11 17.67 git-2.45.2 | pl5340h9abc3c3_1 10.1 MB
#11 17.67 icu-73.1 | h6a678d5_0 25.9 MB
#11 17.67 krb5-1.20.1 | h143b758_1 1.3 MB
#11 17.67 libcurl-8.9.1 | h251f7ec_0 439 KB
#11 17.67 libedit-3.1.20230828 | h5eee18b_0 179 KB
#11 17.67 libev-4.33 | h7f8727e_1 111 KB
#11 17.67 libnghttp2-1.57.0 | h2d74bed_0 674 KB
#11 17.67 libssh2-1.11.0 | h251f7ec_0 282 KB
#11 17.67 libxml2-2.13.1 | hfdd30dd_2 739 KB
#11 17.67 ninja-1.10.2 | h06a4308_5 8 KB
#11 17.67 ninja-base-1.10.2 | hd09550d_5 109 KB
#11 17.67 pcre2-10.42 | hebb0a14_1 1.3 MB
#11 17.67 perl-5.34.0 | h5eee18b_2 12.4 MB
#11 17.67 ------------------------------------------------------------
#11 17.67 Total: 57.1 MB
#11 17.67
#11 17.67 The following NEW packages will be INSTALLED:
#11 17.67
#11 17.67 c-ares pkgs/main/linux-64::c-ares-1.19.1-h5eee18b_0
#11 17.67 curl pkgs/main/linux-64::curl-8.9.1-hdbd6064_0
#11 17.67 expat pkgs/main/linux-64::expat-2.6.3-h6a678d5_0
#11 17.67 gdbm pkgs/main/linux-64::gdbm-1.18-hd4cb3f1_4
#11 17.67 gettext pkgs/main/linux-64::gettext-0.21.0-hedfda30_2
#11 17.67 git pkgs/main/linux-64::git-2.45.2-pl5340h9abc3c3_1
#11 17.67 icu pkgs/main/linux-64::icu-73.1-h6a678d5_0
#11 17.67 krb5 pkgs/main/linux-64::krb5-1.20.1-h143b758_1
#11 17.67 libcurl pkgs/main/linux-64::libcurl-8.9.1-h251f7ec_0
#11 17.67 libedit pkgs/main/linux-64::libedit-3.1.20230828-h5eee18b_0
#11 17.67 libev pkgs/main/linux-64::libev-4.33-h7f8727e_1
#11 17.67 libnghttp2 pkgs/main/linux-64::libnghttp2-1.57.0-h2d74bed_0
#11 17.67 libssh2 pkgs/main/linux-64::libssh2-1.11.0-h251f7ec_0
#11 17.67 libxml2 pkgs/main/linux-64::libxml2-2.13.1-hfdd30dd_2
#11 17.67 ninja pkgs/main/linux-64::ninja-1.10.2-h06a4308_5
#11 17.67 ninja-base pkgs/main/linux-64::ninja-base-1.10.2-hd09550d_5
#11 17.67 pcre2 pkgs/main/linux-64::pcre2-10.42-hebb0a14_1
#11 17.67 perl pkgs/main/linux-64::perl-5.34.0-h5eee18b_2
#11 17.67
#11 17.67
#11 17.67
#11 17.67 Downloading and Extracting Packages
#11 19.60 Preparing transaction: ...working... done
#11 19.75 Verifying transaction: ...working... done
#11 20.35 Executing transaction: ...working... done
#11 21.29 Looking in indexes: https://download.pytorch.org/whl/cu121
#11 21.76 Collecting torch==2.4.1
#11 21.78 Downloading https://download.pytorch.org/whl/cu121/torch-2.4.1%2Bcu121-cp311-cp311-linux_x86_64.whl (799.0 MB)
... <truncated> ...
#11 388.7 Preparing metadata (setup.py): started
#11 388.8 Preparing metadata (setup.py): finished with status 'done'
#11 392.1 Downloading umap-learn-0.5.1.tar.gz (80 kB)
#11 392.1 Preparing metadata (setup.py): started
#11 392.3 Preparing metadata (setup.py): finished with status 'done'
#11 396.8 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 396.8 Using cached transformers-4.45.2-py3-none-any.whl.metadata (44 kB)
#11 415.1 Downloading transformers-4.45.1-py3-none-any.whl.metadata (44 kB)
#11 433.3 Downloading transformers-4.45.0-py3-none-any.whl.metadata (44 kB)
#11 452.0 Downloading transformers-4.44.2-py3-none-any.whl.metadata (43 kB)
#11 452.3 Collecting tokenizers<0.20,>=0.19 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 452.3 Downloading tokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 470.5 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 470.5 Downloading transformers-4.44.1-py3-none-any.whl.metadata (43 kB)
#11 488.8 Downloading transformers-4.44.0-py3-none-any.whl.metadata (43 kB)
#11 507.1 Downloading transformers-4.43.4-py3-none-any.whl.metadata (43 kB)
#11 525.3 Downloading transformers-4.43.3-py3-none-any.whl.metadata (43 kB)
#11 543.5 Downloading transformers-4.43.2-py3-none-any.whl.metadata (43 kB)
#11 561.8 Downloading transformers-4.43.1-py3-none-any.whl.metadata (43 kB)
#11 580.1 Downloading transformers-4.43.0-py3-none-any.whl.metadata (43 kB)
#11 598.4 Downloading transformers-4.42.4-py3-none-any.whl.metadata (43 kB)
#11 616.8 Downloading transformers-4.42.3-py3-none-any.whl.metadata (43 kB)
#11 635.3 Downloading transformers-4.42.2-py3-none-any.whl.metadata (43 kB)
#11 654.1 Downloading transformers-4.42.1-py3-none-any.whl.metadata (43 kB)
#11 672.9 Downloading transformers-4.42.0-py3-none-any.whl.metadata (43 kB)
#11 691.5 Downloading transformers-4.41.2-py3-none-any.whl.metadata (43 kB)
#11 709.9 Downloading transformers-4.41.1-py3-none-any.whl.metadata (43 kB)
#11 728.4 Downloading transformers-4.41.0-py3-none-any.whl.metadata (43 kB)
#11 747.2 Downloading transformers-4.40.2-py3-none-any.whl.metadata (137 kB)
#11 765.6 Downloading transformers-4.40.1-py3-none-any.whl.metadata (137 kB)
#11 784.0 Downloading transformers-4.40.0-py3-none-any.whl.metadata (137 kB)
#11 802.4 Downloading transformers-4.39.3-py3-none-any.whl.metadata (134 kB)
#11 802.5 Collecting tokenizers<0.19,>=0.14 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 802.5 Downloading tokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 820.8 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 820.9 Downloading transformers-4.39.2-py3-none-any.whl.metadata (134 kB)
#11 839.4 Downloading transformers-4.39.1-py3-none-any.whl.metadata (134 kB)
#11 858.4 Downloading transformers-4.39.0-py3-none-any.whl.metadata (134 kB)
#11 876.9 Downloading transformers-4.38.2-py3-none-any.whl.metadata (130 kB)
#11 895.3 Downloading transformers-4.38.1-py3-none-any.whl.metadata (131 kB)
#11 914.0 Downloading transformers-4.38.0-py3-none-any.whl.metadata (131 kB)
#11 932.6 Downloading transformers-4.37.2-py3-none-any.whl.metadata (129 kB)
#11 951.7 Downloading transformers-4.37.1-py3-none-any.whl.metadata (129 kB)
#11 970.7 Downloading transformers-4.37.0-py3-none-any.whl.metadata (129 kB)
#11 989.2 Downloading transformers-4.36.2-py3-none-any.whl.metadata (126 kB)
#11 1007.9 Downloading transformers-4.36.1-py3-none-any.whl.metadata (126 kB)
#11 1026.5 Downloading transformers-4.36.0-py3-none-any.whl.metadata (126 kB)
#11 1045.2 Downloading transformers-4.35.2-py3-none-any.whl.metadata (123 kB)
#11 1063.8 Downloading transformers-4.35.1-py3-none-any.whl.metadata (123 kB)
#11 1063.9 Collecting tokenizers<0.15,>=0.14 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1063.9 Downloading tokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 1082.5 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1082.5 Downloading transformers-4.35.0-py3-none-any.whl.metadata (123 kB)
#11 1101.1 Downloading transformers-4.34.1-py3-none-any.whl.metadata (121 kB)
#11 1120.1 Downloading transformers-4.34.0-py3-none-any.whl.metadata (121 kB)
#11 1138.7 Downloading transformers-4.33.3-py3-none-any.whl.metadata (119 kB)
#11 1138.8 Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1138.8 Downloading tokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 1157.5 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1157.6 Downloading transformers-4.33.2-py3-none-any.whl.metadata (119 kB)
#11 1176.3 Downloading transformers-4.33.1-py3-none-any.whl.metadata (119 kB)
#11 1195.0 Downloading transformers-4.33.0-py3-none-any.whl.metadata (119 kB)
#11 1213.9 Collecting spacy[ja]>=3 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1213.9 Using cached spacy-3.8.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1959.3 Downloading spacy-3.7.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1959.4 INFO: pip is looking at multiple versions of spacy[ja] to determine which version is compatible with other requirements. This could take a while.
#11 1959.4 Downloading spacy-3.7.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1959.5 Downloading spacy-3.7.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.5 Downloading spacy-3.7.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.6 Downloading spacy-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.7 Downloading spacy-3.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.7 Downloading spacy-3.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB)
#11 1959.8 Downloading spacy-3.5.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.8 INFO: pip is still looking at multiple versions of spacy[ja] to determine which version is compatible with other requirements. This could take a while.
#11 1959.9 Downloading spacy-3.5.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.9 Downloading spacy-3.5.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1960.0 Downloading spacy-3.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1960.0 Downloading spacy-3.5.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1960.1 Downloading spacy-3.4.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (24 kB)
#11 1960.1 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
#11 1960.2 Downloading spacy-3.4.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (24 kB)
#11 1960.2 Downloading spacy-3.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (24 kB)
#11 1960.3 Downloading spacy-3.4.1.tar.gz (1.2 MB)
#11 1960.4 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 16.8 MB/s eta 0:00:00
#11 1960.6 Installing build dependencies: started
#11 1969.1 Installing build dependencies: finished with status 'done'
#11 1969.1 Getting requirements to build wheel: started
#11 2004.2 Getting requirements to build wheel: finished with status 'done'
#11 2004.2 Preparing metadata (pyproject.toml): started
#11 2004.7 Preparing metadata (pyproject.toml): finished with status 'done'
#11 2004.8 Downloading spacy-3.4.0.tar.gz (1.2 MB)
#11 2004.8 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 22.5 MB/s eta 0:00:00
#11 2005.0 Installing build dependencies: started
#11 2012.1 Installing build dependencies: finished with status 'done'
#11 2012.1 Getting requirements to build wheel: started
#11 2046.9 Getting requirements to build wheel: finished with status 'done'
#11 2046.9 Preparing metadata (pyproject.toml): started
#11 2047.4 Preparing metadata (pyproject.toml): finished with status 'done'
#11 2047.5 Downloading spacy-3.3.3.tar.gz (1.1 MB)
#11 2047.5 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 22.7 MB/s eta 0:00:00
#11 2047.7 Installing build dependencies: started
#11 2075.7 Installing build dependencies: finished with status 'done'
#11 2075.7 Getting requirements to build wheel: started
#11 2109.4 Getting requirements to build wheel: finished with status 'done'
#11 2109.4 Preparing metadata (pyproject.toml): started
#11 2109.9 Preparing metadata (pyproject.toml): finished with status 'done'
#11 2110.0 Downloading spacy-3.3.2.tar.gz (1.1 MB)
#11 2110.0 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 23.2 MB/s eta 0:00:00
#11 2110.3 Installing build dependencies: started
#11 2116.2 Installing build dependencies: finished with status 'done'
#11 2116.2 Getting requirements to build wheel: started
#11 2150.1 Getting requirements to build wheel: finished with status 'done'
#11 2150.1 Preparing metadata (pyproject.toml): started
#11 2150.6 Preparing metadata (pyproject.toml): finished with status 'done'
#11 2150.6 Downloading spacy-3.3.1.tar.gz (1.1 MB)
#11 2150.8 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 7.1 MB/s eta 0:00:00
#11 2151.0 Installing build dependencies: started
#11 2157.2 Installing build dependencies: finished with status 'done'
#11 2157.2 Getting requirements to build wheel: started
#11 2191.7 Getting requirements to build wheel: finished with status 'done'
#11 2191.7 Preparing metadata (pyproject.toml): started
#11 2192.3 Preparing metadata (pyproject.toml): finished with status 'done'
#11 2192.3 Downloading spacy-3.3.0.tar.gz (1.1 MB)
#11 2192.4 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 24.0 MB/s eta 0:00:00
#11 2192.6 Installing build dependencies: started
#11 2198.8 Installing build dependencies: finished with status 'done'
#11 2198.8 Getting requirements to build wheel: startedSystem Info
user@hostname:~/REPOS/text-generation-webui$ neofetch
...-:::::-... user@hostname
.-MMMMMMMMMMMMMMM-. -------------
.-MMMM`..-:::::::-..`MMMM-. OS: Linux Mint 21.1 x86_64
.:MMMM.:MMMMMMMMMMMMMMM:.MMMM:. Kernel: 5.15.0-56-generic
-MMM-M---MMMMMMMMMMMMMMMMMMM.MMM- Uptime: 1 hour, 57 mins
`:MMM:MM` :MMMM:....::-...-MMMM:MMM:` Packages: 2150 (dpkg)
:MMM:MMM` :MM:` `` `` `:MMM:MMM: Shell: bash 5.1.16
.MMM.MMMM` :MM. -MM. .MM- `MMMM.MMM. Resolution: 2560x1440
:MMM:MMMM` :MM. -MM- .MM: `MMMM-MMM: DE: Cinnamon 5.6.5
:MMM:MMMM` :MM. -MM- .MM: `MMMM:MMM: WM: Mutter (Muffin)
:MMM:MMMM` :MM. -MM- .MM: `MMMM-MMM: WM Theme: Mint-Y-Dark-Aqua (Mint-Y)
.MMM.MMMM` :MM:--:MM:--:MM: `MMMM.MMM. Theme: Mint-Y-Aqua [GTK2/3]
:MMM:MMM- `-MMMMMMMMMMMM-` -MMM-MMM: Icons: Mint-Y-Aqua [GTK2/3]
:MMM:MMM:` `:MMM:MMM: Terminal: gnome-terminal
.MMM.MMMM:--------------:MMMM.MMM. CPU: AMD Ryzen 5 5600X (12) @ 4.200GHz
'-MMMM.-MMMMMMMMMMMMMMM-.MMMM-' GPU: NVIDIA GeForce RTX 3090
'.-MMMM``--:::::--``MMMM-.' GPU: NVIDIA GeForce RTX 3090
'-MMMMMMMMMMMMM-' Memory: 3348MiB / 80343MiB
``-:::::-``
user@hostname:~/REPOS/text-generation-webui$ speedtest-cli --simple
Ping: 32.698 ms
Download: 324.88 Mbit/s
Upload: 20.03 Mbit/s
user@hostname:~/REPOS/text-generation-webui$Update: I'm pretty sure this issue is not specific to docker - I adjusted INSTALL_EXTENSIONS=FALSE in the dockerfile and it finally worked. I'm now getting Error response from daemon: could not select device driver "nvidia" with capabilities: [[gpu]] probably because I need the NVIDIA container toolkit but at least the build completed... My theory is the package dependency issue is a problem with one of the extensions and would be observed if I called INSTALL_EXTENSIONS=FALSE ./start_linux.sh directly...
Unsure what extension is the issue
I am closing this issue as my original objective of building a docker image can be accomplished by modifying INSTALL_EXTENSIONS=TRUE to INSTALL_EXTENSIONS=FALSE in the dockerfile.
However, I may end up reopening or reinvestigating why pip is getting stuck when trying to download dependencies for the extensions... Not sure which extension is causing problems but this probably is causing problems for others and should be looked into...
Also just FYI if anyone gets to this page and is trying to figure how to get docker with cuda support to work I made a short gist hoping to help anyone along the path - accessible here: https://gist.github.com/practical-dreamer/79c26931d99bc6a7f28271b3612907a9