conda failures on 64 bit linux
ellisonbg opened this issue · comments
Trying a deployment on master today found this:
TASK [python : conda install ipython and jupyter deps] *************************
failed: [test.calpolydatascience.org] (item=notebook=4.3) => {"changed": true, "cmd": ["conda", "install", "name=notebook=4.3", "state=present"], "delta": "0:00:05.928944", "end": "2017-01-03 23:46:52.658099", "failed": true, "item": "notebook=4.3", "rc": 1, "start": "2017-01-03 23:46:46.729155", "stderr": "Error: Packages missing in current linux-64 channels: \n - name notebook 4.3\n - state present*\n\nClose matches found; did you mean one of these?\n\n state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=ipyparallel) => {"changed": true, "cmd": ["conda", "install", "name=ipyparallel", "state=present"], "delta": "0:00:04.542296", "end": "2017-01-03 23:46:58.200532", "failed": true, "item": "ipyparallel", "rc": 1, "start": "2017-01-03 23:46:53.658236", "stderr": "Error: Packages missing in current linux-64 channels: \n - name ipyparallel*\n - state present*\n\nClose matches found; did you mean one of these?\n\n state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=ipykernel) => {"changed": true, "cmd": ["conda", "install", "name=ipykernel", "state=present"], "delta": "0:00:04.572776", "end": "2017-01-03 23:47:03.764801", "failed": true, "item": "ipykernel", "rc": 1, "start": "2017-01-03 23:46:59.192025", "stderr": "Error: Packages missing in current linux-64 channels: \n - name ipykernel*\n - state present*\n\nClose matches found; did you mean one of these?\n\n state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=nbconvert) => {"changed": true, "cmd": ["conda", "install", "name=nbconvert", "state=present"], "delta": "0:00:04.491097", "end": "2017-01-03 23:47:09.371406", "failed": true, "item": "nbconvert", "rc": 1, "start": "2017-01-03 23:47:04.880309", "stderr": "Error: Packages missing in current linux-64 channels: \n - name nbconvert*\n - state present*\n\nClose matches found; did you mean one of these?\n\n state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=pandoc) => {"changed": true, "cmd": ["conda", "install", "name=pandoc", "state=present"], "delta": "0:00:04.543237", "end": "2017-01-03 23:47:15.415850", "failed": true, "item": "pandoc", "rc": 1, "start": "2017-01-03 23:47:10.872613", "stderr": "Error: Packages missing in current linux-64 channels: \n - name pandoc*\n - state present*\n\nClose matches found; did you mean one of these?\n\n state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=ipywidgets=5) => {"changed": true, "cmd": ["conda", "install", "name=ipywidgets=5", "state=present"], "delta": "0:00:04.732561", "end": "2017-01-03 23:47:21.729590", "failed": true, "item": "ipywidgets=5", "rc": 1, "start": "2017-01-03 23:47:16.997029", "stderr": "Error: Packages missing in current linux-64 channels: \n - name ipywidgets 5\n - state present*\n\nClose matches found; did you mean one of these?\n\n state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
@minrk @willingc I am going to try to debug, but not sure exactly where to start. The thing that is weird is that conda works fine for these packages if I log in an run it. I have also tried updating the versions.
Hmm...thanks @ellisonbg. How far does it get before croaking?
I think that the error may be here with notebook 4.2 https://github.com/jupyterhub/jupyterhub-deploy-teaching/blob/master/roles/python/tasks/jupyter.yml
It gets through installing conda and then fails the first time it tries to use it. It may be that the upstream ansible-conda module has changed. I will look at that.
Hmm, weird, even though we are using the conda ansible module in some places in the code base, in this and a few others, we are using the regular "command" module from ansible. Will try to convert it over to use the conda module.
@ellisonbg Can you post the full output of the original error? I want to check if there is an error with conda in roles/jupyterhub/tasks/packages.yml
:
The error appears to have been in '/Users/carol/code/jhub/jupyterhub-deploy-teaching/roles/jupyterhub/tasks/packages.yml': line 3, column 3, but may
be elsewhere in the file depending on the exact syntax problem.
The offending line appears to be:
- name: install jupyterhub dependencies via conda
^ here
Ugh...thanks @ellisonbg. You are correct that I didn't do it after grabbing the latest files.
Thanks, that fixed it. Now back to the other problem...
I think the conda.py script in ansible-conda is broken. It is parsing output of conda and that has changed...more debugging...
Thanks @ellisonbg. Keep us posted. I'm going to switch gears to other stuff for a bit. I am trying to set up a vagrant test environment to make testing the playbooks easier.
@ellisonbg It looks like there isn't much activity on conda and ansible ansible/ansible-modules-core#3780 ansible-conda may not be actively maintained.
There's also an open PR for about a year which we may wish to kick a bit: ansible/ansible#13999
Fixed in master, was a broken ansible-conda. I have pointed our submodule to a fork at ellisonbg/ansible-conda and will update that as they fix it upstream.