conda failures on 64 bit linux

Question

conda failures on 64 bit linux

ellisonbg opened this issue 8 years ago · comments

Trying a deployment on master today found this:

TASK [python : conda install ipython and jupyter deps] *************************
failed: [test.calpolydatascience.org] (item=notebook=4.3) => {"changed": true, "cmd": ["conda", "install", "name=notebook=4.3", "state=present"], "delta": "0:00:05.928944", "end": "2017-01-03 23:46:52.658099", "failed": true, "item": "notebook=4.3", "rc": 1, "start": "2017-01-03 23:46:46.729155", "stderr": "Error: Packages missing in current linux-64 channels: \n  - name notebook 4.3\n  - state present*\n\nClose matches found; did you mean one of these?\n\n    state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n    anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n    conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=ipyparallel) => {"changed": true, "cmd": ["conda", "install", "name=ipyparallel", "state=present"], "delta": "0:00:04.542296", "end": "2017-01-03 23:46:58.200532", "failed": true, "item": "ipyparallel", "rc": 1, "start": "2017-01-03 23:46:53.658236", "stderr": "Error: Packages missing in current linux-64 channels: \n  - name ipyparallel*\n  - state present*\n\nClose matches found; did you mean one of these?\n\n    state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n    anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n    conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=ipykernel) => {"changed": true, "cmd": ["conda", "install", "name=ipykernel", "state=present"], "delta": "0:00:04.572776", "end": "2017-01-03 23:47:03.764801", "failed": true, "item": "ipykernel", "rc": 1, "start": "2017-01-03 23:46:59.192025", "stderr": "Error: Packages missing in current linux-64 channels: \n  - name ipykernel*\n  - state present*\n\nClose matches found; did you mean one of these?\n\n    state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n    anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n    conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=nbconvert) => {"changed": true, "cmd": ["conda", "install", "name=nbconvert", "state=present"], "delta": "0:00:04.491097", "end": "2017-01-03 23:47:09.371406", "failed": true, "item": "nbconvert", "rc": 1, "start": "2017-01-03 23:47:04.880309", "stderr": "Error: Packages missing in current linux-64 channels: \n  - name nbconvert*\n  - state present*\n\nClose matches found; did you mean one of these?\n\n    state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n    anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n    conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=pandoc) => {"changed": true, "cmd": ["conda", "install", "name=pandoc", "state=present"], "delta": "0:00:04.543237", "end": "2017-01-03 23:47:15.415850", "failed": true, "item": "pandoc", "rc": 1, "start": "2017-01-03 23:47:10.872613", "stderr": "Error: Packages missing in current linux-64 channels: \n  - name pandoc*\n  - state present*\n\nClose matches found; did you mean one of these?\n\n    state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n    anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n    conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}
failed: [test.calpolydatascience.org] (item=ipywidgets=5) => {"changed": true, "cmd": ["conda", "install", "name=ipywidgets=5", "state=present"], "delta": "0:00:04.732561", "end": "2017-01-03 23:47:21.729590", "failed": true, "item": "ipywidgets=5", "rc": 1, "start": "2017-01-03 23:47:16.997029", "stderr": "Error: Packages missing in current linux-64 channels: \n  - name ipywidgets 5\n  - state present*\n\nClose matches found; did you mean one of these?\n\n    state: statsd, static\n\nYou can search for packages on anaconda.org with\n\n    anaconda search -t conda state\n\n(and similarly for the other packages)\n\nYou may need to install the anaconda-client command line client with\n\n    conda install anaconda-client", "stdout": "Fetching package metadata .........\nSolving package specifications: .", "stdout_lines": ["Fetching package metadata .........", "Solving package specifications: ."], "warnings": []}

@minrk @willingc I am going to try to debug, but not sure exactly where to start. The thing that is weird is that conda works fine for these packages if I log in an run it. I have also tried updating the versions.

Carol Willing · Answer 1 · Wed Jan 04 2017 07:58:57 GMT+0800 (China Standard Time)

Hmm...thanks @ellisonbg. How far does it get before croaking?

Carol Willing · Answer 2 · Wed Jan 04 2017 08:02:07 GMT+0800 (China Standard Time)

I think that the error may be here with notebook 4.2 https://github.com/jupyterhub/jupyterhub-deploy-teaching/blob/master/roles/python/tasks/jupyter.yml

Brian E. Granger · Answer 3 · Wed Jan 04 2017 08:16:21 GMT+0800 (China Standard Time)

It gets through installing conda and then fails the first time it tries to use it. It may be that the upstream ansible-conda module has changed. I will look at that.

Brian E. Granger · Answer 4 · Wed Jan 04 2017 08:18:47 GMT+0800 (China Standard Time)

Hmm, weird, even though we are using the conda ansible module in some places in the code base, in this and a few others, we are using the regular "command" module from ansible. Will try to convert it over to use the conda module.

Carol Willing · Answer 5 · Wed Jan 04 2017 08:26:26 GMT+0800 (China Standard Time)

@ellisonbg Can you post the full output of the original error? I want to check if there is an error with conda in roles/jupyterhub/tasks/packages.yml:

The error appears to have been in '/Users/carol/code/jhub/jupyterhub-deploy-teaching/roles/jupyterhub/tasks/packages.yml': line 3, column 3, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:


- name: install jupyterhub dependencies via conda
  ^ here

Brian E. Granger · Answer 6 · Wed Jan 04 2017 08:31:56 GMT+0800 (China Standard Time)

If you are seeing that issues (I was) you haven't done git submodule init/update to grab the ansible-conda submodule.

…

On Tue, Jan 3, 2017 at 5:26 PM, Carol Willing ***@***.***> wrote: @ellisonbg <https://github.com/ellisonbg> Can you post the full output of the original error? I want to check if there is an error with conda in roles/jupyterhub/tasks/packages.yml: The error appears to have been in '/Users/carol/code/jhub/jupyterhub-deploy-teaching/roles/jupyterhub/tasks/packages.yml': line 3, column 3, but may be elsewhere in the file depending on the exact syntax problem. The offending line appears to be: - name: install jupyterhub dependencies via conda ^ here — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#53 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABr0F7COMQHQAZQoOuftn3HaDEo5kV2ks5rOuczgaJpZM4LaKEK> .

-- Brian E. Granger Associate Professor of Physics and Data Science Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger@calpoly.edu and ellisonbg@gmail.com

Carol Willing · Answer 7 · Wed Jan 04 2017 08:32:48 GMT+0800 (China Standard Time)

Ugh...thanks @ellisonbg. You are correct that I didn't do it after grabbing the latest files.

Brian E. Granger · Answer 8 · Wed Jan 04 2017 08:36:41 GMT+0800 (China Standard Time)

I forget every time ;-)

…

On Tue, Jan 3, 2017 at 5:32 PM, Carol Willing ***@***.***> wrote: Ugh...thanks @ellisonbg <https://github.com/ellisonbg>. You are correct that I didn't do it after grabbing the latest files. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#53 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABr0P8NuP1AdProRrLy4NOOt7OUIkV4ks5rOuiwgaJpZM4LaKEK> .

-- Brian E. Granger Associate Professor of Physics and Data Science Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger@calpoly.edu and ellisonbg@gmail.com

Carol Willing · Answer 9 · Wed Jan 04 2017 08:40:46 GMT+0800 (China Standard Time)

Thanks, that fixed it. Now back to the other problem...

Brian E. Granger · Answer 10 · Wed Jan 04 2017 09:05:08 GMT+0800 (China Standard Time)

I think the conda.py script in ansible-conda is broken. It is parsing output of conda and that has changed...more debugging...

Carol Willing · Answer 11 · Wed Jan 04 2017 09:07:08 GMT+0800 (China Standard Time)

Thanks @ellisonbg. Keep us posted. I'm going to switch gears to other stuff for a bit. I am trying to set up a vagrant test environment to make testing the playbooks easier.

Brian E. Granger · Answer 12 · Wed Jan 04 2017 09:09:45 GMT+0800 (China Standard Time)

I think I found the issue... 2e07d64 This commit started to use the invalid syntax "conda install name=<> state=present" which is mixing conda/ansible syntax. I think I see all the pieces and will submit a PR...I think the underlying issue is that the ansible-conda module is broken, Cheers, Brian

…

On Tue, Jan 3, 2017 at 6:07 PM, Carol Willing ***@***.***> wrote: Thanks @ellisonbg <https://github.com/ellisonbg>. Keep us posted. I'm going to switch gears to other stuff for a bit. I am trying to set up a vagrant test environment to make testing the playbooks easier. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#53 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABr0CXQoh5TMSilX_xBDBjTcnvbOfe5ks5rOvC-gaJpZM4LaKEK> .

-- Brian E. Granger Associate Professor of Physics and Data Science Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger@calpoly.edu and ellisonbg@gmail.com

Carol Willing · Answer 13 · Wed Jan 04 2017 10:28:04 GMT+0800 (China Standard Time)

@ellisonbg It looks like there isn't much activity on conda and ansible ansible/ansible-modules-core#3780 ansible-conda may not be actively maintained.

There's also an open PR for about a year which we may wish to kick a bit: ansible/ansible#13999

Brian E. Granger · Answer 14 · Thu Jan 05 2017 06:46:36 GMT+0800 (China Standard Time)

Fixed in master, was a broken ansible-conda. I have pointed our submodule to a fork at ellisonbg/ansible-conda and will update that as they fix it upstream.