jupyter-incubator / sparkmagic

Jupyter magics and kernels for working with remote Spark clusters

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The kernel startup slowly when the .sparkmagic/config.json file exists

JanzeWu opened this issue · comments

commented

Describe the bug
It takes ten seconds to start up a kernel when the .sparkmagic/config.json file exists. If I delete the .sparkmagic/config.json file the kernel starts up quickly.

To Reproduce
Steps to reproduce the behavior.
Add configuration files below and create a new notebook in jupyter.

  • ./sparkmagic/config.json
{
    "kernel_python_credentials": {
        "username": "USERNAME",
        "password": "PASSWORD",
        "url": "http://livy-rest.xxx",
        "auth": "Basic_Access"
    },
    "authenticators": {
        "Basic_Access": "sparkmagic.auth.basic.Basic"
    },
    "livy_session_startup_timeout_seconds": 300,
    "session_configs": {
        "queue": "QUEUE"
    }
}
  • ~/.jupyter/jupyter_notebook_config.json
{
  "NotebookApp": {
    "nbserver_extensions": {
      "sparkmagic": true
    },
    "shutdown_no_activity_timeout": 600
  }
}
  • ~/.ipython/profile_default/ipython_config.py
c.InteractiveShellApp.extensions = [
    'sparkmagic.magics'
]

Expected behavior
A clear and concise description of what you expected to happen.
A kernel should start up quickly when using a none empty .sparkmagic/config.json.

Screenshots

[I 14:59:55.224 NotebookApp] Creating new notebook in
[D 14:59:55.225 NotebookApp] Saving /Users/USER/PycharmProjects/jupyter-livy/jupyter-launcher-1.1/examples/Untitled.ipynb
[D 14:59:55.229 NotebookApp] 201 POST /api/contents (::1) 5.380000ms
[D 14:59:55.236 NotebookApp] Using contents: services/contents
[D 14:59:55.612 NotebookApp] 200 GET /notebooks/Untitled.ipynb?kernel_name=python3 (::1) 376.810000ms
[D 14:59:55.627 NotebookApp] 304 GET /static/components/MathJax/MathJax.js?config=TeX-AMS-MML_HTMLorMML-full,Safe&delayStartupUntil=configured (::1) 0.720000ms
[D 14:59:55.628 NotebookApp] 304 GET /custom/custom.css (::1) 0.570000ms
[D 14:59:55.640 NotebookApp] 304 GET /static/components/MathJax/config/TeX-AMS-MML_HTMLorMML-full.js?V=2.7.9 (::1) 0.740000ms
[D 14:59:55.761 NotebookApp] 304 GET /static/services/contents.js (::1) 0.770000ms
[D 14:59:55.842 NotebookApp] 304 GET /static/components/MathJax/config/Safe.js?V=2.7.9 (::1) 0.690000ms
[D 14:59:55.846 NotebookApp] Paths used for configuration of notebook:
    	/etc/jupyter/nbconfig/notebook.json
[D 14:59:55.846 NotebookApp] Paths used for configuration of notebook:
    	/usr/local/etc/jupyter/nbconfig/notebook.json
[D 14:59:55.846 NotebookApp] Paths used for configuration of notebook:
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/notebook.d/jupyterlab-plotly.json
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/notebook.d/widgetsnbextension.json
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/notebook.json
[D 14:59:55.848 NotebookApp] Paths used for configuration of notebook:
    	/Users/USER/.local/etc/jupyter/nbconfig/notebook.json
[D 14:59:55.848 NotebookApp] Paths used for configuration of notebook:
    	/Users/USER/.jupyter/nbconfig/notebook.json
[D 14:59:55.849 NotebookApp] 200 GET /api/config/notebook?_=1660892395722 (::1) 3.820000ms
[D 14:59:55.850 NotebookApp] Paths used for configuration of common:
    	/etc/jupyter/nbconfig/common.json
[D 14:59:55.850 NotebookApp] Paths used for configuration of common:
    	/usr/local/etc/jupyter/nbconfig/common.json
[D 14:59:55.851 NotebookApp] Paths used for configuration of common:
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/common.json
[D 14:59:55.851 NotebookApp] Paths used for configuration of common:
    	/Users/USER/.local/etc/jupyter/nbconfig/common.json
[D 14:59:55.851 NotebookApp] Paths used for configuration of common:
    	/Users/USER/.jupyter/nbconfig/common.json
[D 14:59:55.852 NotebookApp] 200 GET /api/config/common?_=1660892395723 (::1) 2.630000ms
[D 14:59:55.870 NotebookApp] Found kernel python3 in /Users/USER/Library/Jupyter/kernels
[D 14:59:55.871 NotebookApp] Found kernel sparksdikernel in /usr/local/share/jupyter/kernels
[D 14:59:55.872 NotebookApp] 304 GET /api/kernelspecs (::1) 2.680000ms
[D 14:59:55.879 NotebookApp] 200 GET /api/contents/Untitled.ipynb?type=notebook&_=1660892395724 (::1) 2.540000ms
[D 14:59:55.889 NotebookApp] 304 GET /custom/custom.js (::1) 2.540000ms
[D 14:59:55.920 NotebookApp] 200 GET /api/contents/Untitled.ipynb/checkpoints?_=1660892395725 (::1) 0.840000ms
[D 14:59:55.923 NotebookApp] Instantiating kernel 'Python 3' with kernel provisioner: local-provisioner
[D 14:59:55.925 NotebookApp] Starting kernel: ['/Users/USER/software/miniconda3/envs/jupyter_2/bin/python3', '-m', 'ipykernel_launcher', '-f', '/Users/USER/Library/Jupyter/runtime/kernel-91501dc8-311c-4839-888b-4a95fdf93e41.json']
[D 14:59:55.935 NotebookApp] Connecting to: tcp://127.0.0.1:58713
[D 14:59:55.940 NotebookApp] 304 GET /static/components/MathJax/extensions/TeX/newcommand.js?V=2.7.9 (::1) 3.110000ms
[D 14:59:55.941 NotebookApp] 304 GET /static/components/MathJax/extensions/TeX/begingroup.js?V=2.7.9 (::1) 2.700000ms
[D 14:59:55.942 NotebookApp] 304 GET /static/components/MathJax/extensions/MathML/content-mathml.js?V=2.7.9 (::1) 2.780000ms
[D 14:59:55.947 NotebookApp] Connecting to: tcp://127.0.0.1:58710
[I 14:59:55.948 NotebookApp] Kernel started: 91501dc8-311c-4839-888b-4a95fdf93e41, name: python3
[D 14:59:55.948 NotebookApp] Kernel args: {'kernel_name': 'python3', 'env': {'KERNEL_IPYNB_PATH': 'Untitled.ipynb'}, 'cwd': '/Users/USER/PycharmProjects/jupyter-livy/jupyter-launcher-1.1/examples'}
[D 14:59:55.949 NotebookApp] 201 POST /api/sessions (::1) 28.870000ms
[D 14:59:55.979 NotebookApp] 304 GET /nbextensions/jupyterlab-plotly/extension.js (::1) 1.310000ms
[D 14:59:55.981 NotebookApp] 304 GET /nbextensions/jupyter-js-widgets/extension.js (::1) 1.250000ms
[D 14:59:55.982 NotebookApp] 304 GET /static/components/MathJax/jax/output/HTML-CSS/fonts/STIX-Web/fontdata.js?V=2.7.9 (::1) 1.220000ms
[D 14:59:55.983 NotebookApp] 304 GET /static/components/MathJax/extensions/Safe.js?V=2.7.9 (::1) 1.190000ms
[D 14:59:55.985 NotebookApp] Initializing websocket connection /api/kernels/91501dc8-311c-4839-888b-4a95fdf93e41/channels
[D 14:59:55.986 NotebookApp] Requesting kernel info from 91501dc8-311c-4839-888b-4a95fdf93e41
[D 14:59:55.986 NotebookApp] Connecting to: tcp://127.0.0.1:58709
[D 14:59:57.600 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.601 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.617 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.631 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.642 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.645 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.646 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.647 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.648 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.652 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.653 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.657 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.660 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.661 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.665 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.665 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.668 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.669 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.672 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.674 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.675 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.675 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.677 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.679 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.681 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.682 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.683 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.687 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.688 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.689 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.691 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.693 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.696 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.697 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.697 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.698 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.703 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.703 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.704 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.704 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.704 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.706 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.706 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.708 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.712 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.712 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.714 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.715 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.717 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.719 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.719 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.722 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.722 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.723 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.723 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.723 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.724 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.724 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.725 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.725 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.726 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.726 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.726 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.727 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.728 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.728 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.729 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.729 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.730 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.730 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.730 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.731 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.731 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.732 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.732 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.732 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.733 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 14:59:57.733 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.734 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.735 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.735 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.736 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.736 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.736 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.737 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.737 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.738 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.738 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.738 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.739 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.739 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 14:59:57.740 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.425 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.426 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.426 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.430 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.432 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.435 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.439 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.440 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.441 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.446 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.446 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.449 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.451 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.451 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.452 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.452 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.453 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.453 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.454 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.454 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.454 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.455 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.455 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.456 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.456 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.456 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.457 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_open
[D 15:00:13.457 NotebookApp] Received kernel info: {'status': 'ok', 'protocol_version': '5.3', 'implementation': 'ipython', 'implementation_version': '7.30.1', 'language_info': {'name': 'python', 'version': '3.9.12', 'mimetype': 'text/x-python', 'codemirror_mode': {'name': 'ipython', 'version': 3}, 'pygments_lexer': 'ipython3', 'nbconvert_exporter': 'python', 'file_extension': '.py'}, 'banner': "Python 3.9.12 (main, Jun  1 2022, 06:36:29) \nType 'copyright', 'credits' or 'license' for more information\nIPython 7.30.1 -- An enhanced Interactive Python. Type '?' for help.\n", 'help_links': [{'text': 'Python Reference', 'url': 'https://docs.python.org/3.9'}, {'text': 'IPython Reference', 'url': 'https://ipython.org/documentation.html'}, {'text': 'NumPy Reference', 'url': 'https://docs.scipy.org/doc/numpy/reference/'}, {'text': 'SciPy Reference', 'url': 'https://docs.scipy.org/doc/scipy/reference/'}, {'text': 'Matplotlib Reference', 'url': 'https://matplotlib.org/contents.html'}, {'text': 'SymPy Reference', 'url': 'http://docs.sympy.org/latest/index.html'}, {'text': 'pandas Reference', 'url': 'https://pandas.pydata.org/pandas-docs/stable/'}]}
[D 15:00:13.458 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.458 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.459 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.459 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.460 NotebookApp] 101 GET /api/kernels/91501dc8-311c-4839-888b-4a95fdf93e41/channels?session_id=6f77c61941ab48c8babe9db58897b7a6 (::1) 17475.110000ms
[D 15:00:13.460 NotebookApp] Opening websocket /api/kernels/91501dc8-311c-4839-888b-4a95fdf93e41/channels
[D 15:00:13.460 NotebookApp] Getting buffer for 91501dc8-311c-4839-888b-4a95fdf93e41
[D 15:00:13.460 NotebookApp] Connecting to: tcp://127.0.0.1:58710
[D 15:00:13.460 NotebookApp] Connecting to: tcp://127.0.0.1:58709
[D 15:00:13.460 NotebookApp] Connecting to: tcp://127.0.0.1:58713
[D 15:00:13.461 NotebookApp] Connecting to: tcp://127.0.0.1:58711
[D 15:00:13.461 NotebookApp] Connecting to: tcp://127.0.0.1:58709
[D 15:00:13.462 NotebookApp] Connecting to: tcp://127.0.0.1:58713
[D 15:00:13.462 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.463 NotebookApp] Nudge: attempt 1 on kernel 91501dc8-311c-4839-888b-4a95fdf93e41
[D 15:00:13.463 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (starting)
[D 15:00:13.464 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.464 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[D 15:00:13.465 NotebookApp] Nudge: IOPub received: 91501dc8-311c-4839-888b-4a95fdf93e41
[D 15:00:13.465 NotebookApp] Nudge: resolving iopub future: 91501dc8-311c-4839-888b-4a95fdf93e41
[D 15:00:13.465 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.466 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[D 15:00:13.466 NotebookApp] Nudge: shell info reply received: 91501dc8-311c-4839-888b-4a95fdf93e41
[D 15:00:13.466 NotebookApp] Nudge: resolving shell future: 91501dc8-311c-4839-888b-4a95fdf93e41
[D 15:00:13.468 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.469 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[D 15:00:13.473 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.473 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[D 15:00:13.478 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.478 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[D 15:00:13.513 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.529 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: comm_msg
[D 15:00:13.530 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[D 15:00:13.534 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (busy)
[D 15:00:13.535 NotebookApp] activity on 91501dc8-311c-4839-888b-4a95fdf93e41: status (idle)
[W 15:00:57.616 NotebookApp] 404 GET /api/contents/Untitled18.ipynb?content=0&_=1660892336723 (::1): No such file or directory: Untitled18.ipynb
[W 15:00:57.617 NotebookApp] No such file or directory: Untitled18.ipynb
[W 15:00:57.617 NotebookApp] 404 GET /api/contents/Untitled18.ipynb?content=0&_=1660892336723 (::1) 1.130000ms referer=http://localhost:8888/notebooks/Untitled18.ipynb?kernel_name=python3
[I 15:00:57.621 NotebookApp] Uploading file to /Untitled18.ipynb
[D 15:00:57.621 NotebookApp] Saving /Users/USER/PycharmProjects/jupyter-livy/jupyter-launcher-1.1/examples/Untitled18.ipynb
[D 15:00:57.626 NotebookApp] 201 PUT /api/contents/Untitled18.ipynb (::1) 5.870000ms
[D 15:01:56.650 NotebookApp] 200 GET /api/contents/Untitled.ipynb?content=0&_=1660892395726 (::1) 1.310000ms
[I 15:01:56.654 NotebookApp] Saving file at /Untitled.ipynb
[D 15:01:56.654 NotebookApp] Saving /Users/USER/PycharmProjects/jupyter-livy/jupyter-launcher-1.1/examples/Untitled.ipynb
[D 15:01:56.660 NotebookApp] 200 PUT /api/contents/Untitled.ipynb (::1) 7.040000ms
[D 15:01:58.864 NotebookApp] 200 GET /api/sessions?_=1660889922865 (::1) 0.830000ms
[D 15:01:58.865 NotebookApp] 200 GET /api/terminals?_=1660889922866 (::1) 0.720000ms
[D 15:01:58.874 NotebookApp] 200 GET /api/contents?type=directory&_=1660889922867 (::1) 3.480000ms
[D 15:12:01.676 NotebookApp] 200 GET /api/sessions?_=1660889922868 (::1) 1.850000ms
[D 15:12:01.680 NotebookApp] 200 GET /api/terminals?_=1660889922869 (::1) 1.050000ms
[D 15:12:01.695 NotebookApp] 200 GET /api/contents?type=directory&_=1660889922870 (::1) 5.310000ms
[I 15:12:02.892 NotebookApp] Creating new notebook in
[D 15:12:02.893 NotebookApp] Saving /Users/USER/PycharmProjects/jupyter-livy/jupyter-launcher-1.1/examples/Untitled1.ipynb
[D 15:12:02.897 NotebookApp] 201 POST /api/contents (::1) 5.700000ms
[D 15:12:02.903 NotebookApp] Using contents: services/contents
[D 15:12:03.575 NotebookApp] 200 GET /notebooks/Untitled1.ipynb?kernel_name=python3 (::1) 672.250000ms
[D 15:12:03.591 NotebookApp] 304 GET /static/components/MathJax/MathJax.js?config=TeX-AMS-MML_HTMLorMML-full,Safe&delayStartupUntil=configured (::1) 0.730000ms
[D 15:12:03.593 NotebookApp] 304 GET /custom/custom.css (::1) 0.640000ms
[D 15:12:03.606 NotebookApp] 304 GET /static/components/MathJax/config/TeX-AMS-MML_HTMLorMML-full.js?V=2.7.9 (::1) 0.790000ms
[D 15:12:03.698 NotebookApp] 304 GET /static/components/MathJax/config/Safe.js?V=2.7.9 (::1) 0.880000ms
[D 15:12:03.719 NotebookApp] 304 GET /static/services/contents.js (::1) 0.870000ms
[D 15:12:03.798 NotebookApp] Paths used for configuration of notebook:
    	/etc/jupyter/nbconfig/notebook.json
[D 15:12:03.798 NotebookApp] Paths used for configuration of notebook:
    	/usr/local/etc/jupyter/nbconfig/notebook.json
[D 15:12:03.800 NotebookApp] Paths used for configuration of notebook:
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/notebook.d/jupyterlab-plotly.json
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/notebook.d/widgetsnbextension.json
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/notebook.json
[D 15:12:03.802 NotebookApp] Paths used for configuration of notebook:
    	/Users/USER/.local/etc/jupyter/nbconfig/notebook.json
[D 15:12:03.802 NotebookApp] Paths used for configuration of notebook:
    	/Users/USER/.jupyter/nbconfig/notebook.json
[D 15:12:03.803 NotebookApp] 200 GET /api/config/notebook?_=1660893123677 (::1) 5.980000ms
[D 15:12:03.804 NotebookApp] Paths used for configuration of common:
    	/etc/jupyter/nbconfig/common.json
[D 15:12:03.805 NotebookApp] Paths used for configuration of common:
    	/usr/local/etc/jupyter/nbconfig/common.json
[D 15:12:03.805 NotebookApp] Paths used for configuration of common:
    	/Users/USER/software/miniconda3/envs/jupyter_2/etc/jupyter/nbconfig/common.json
[D 15:12:03.805 NotebookApp] Paths used for configuration of common:
    	/Users/USER/.local/etc/jupyter/nbconfig/common.json
[D 15:12:03.806 NotebookApp] Paths used for configuration of common:
    	/Users/USER/.jupyter/nbconfig/common.json
[D 15:12:03.806 NotebookApp] 200 GET /api/config/common?_=1660893123678 (::1) 2.890000ms
[D 15:12:03.813 NotebookApp] 304 GET /static/components/MathJax/extensions/TeX/newcommand.js?V=2.7.9 (::1) 0.680000ms
[D 15:12:03.815 NotebookApp] 304 GET /static/components/MathJax/extensions/TeX/begingroup.js?V=2.7.9 (::1) 1.230000ms
[D 15:12:03.816 NotebookApp] 304 GET /static/components/MathJax/extensions/MathML/content-mathml.js?V=2.7.9 (::1) 0.720000ms
[D 15:12:03.834 NotebookApp] Found kernel python3 in /Users/USER/Library/Jupyter/kernels
[D 15:12:03.836 NotebookApp] Found kernel sparksdikernel in /usr/local/share/jupyter/kernels
[D 15:12:03.840 NotebookApp] 304 GET /api/kernelspecs (::1) 7.590000ms
[D 15:12:03.842 NotebookApp] 200 GET /api/contents/Untitled1.ipynb?type=notebook&_=1660893123679 (::1) 1.820000ms
[D 15:12:03.845 NotebookApp] 304 GET /custom/custom.js (::1) 0.630000ms
[D 15:12:03.848 NotebookApp] 304 GET /static/components/MathJax/jax/output/HTML-CSS/fonts/STIX-Web/fontdata.js?V=2.7.9 (::1) 1.950000ms
[D 15:12:03.877 NotebookApp] 304 GET /nbextensions/jupyterlab-plotly/extension.js (::1) 3.360000ms
[D 15:12:03.882 NotebookApp] 304 GET /nbextensions/jupyter-js-widgets/extension.js (::1) 7.210000ms
[D 15:12:03.883 NotebookApp] 304 GET /static/components/MathJax/extensions/Safe.js?V=2.7.9 (::1) 7.290000ms
[D 15:12:03.915 NotebookApp] 200 GET /api/contents/Untitled1.ipynb/checkpoints?_=1660893123680 (::1) 0.880000ms
[D 15:12:03.916 NotebookApp] Instantiating kernel 'Python 3' with kernel provisioner: local-provisioner
[D 15:12:03.919 NotebookApp] Starting kernel: ['/Users/USER/software/miniconda3/envs/jupyter_2/bin/python3', '-m', 'ipykernel_launcher', '-f', '/Users/USER/Library/Jupyter/runtime/kernel-7cb04636-4990-4f01-b39f-520a81b3636b.json']
[D 15:12:03.932 NotebookApp] Connecting to: tcp://127.0.0.1:63834
[D 15:12:03.945 NotebookApp] Connecting to: tcp://127.0.0.1:63831
[I 15:12:03.947 NotebookApp] Kernel started: 7cb04636-4990-4f01-b39f-520a81b3636b, name: python3
[D 15:12:03.947 NotebookApp] Kernel args: {'kernel_name': 'python3', 'env': {'KERNEL_IPYNB_PATH': 'Untitled1.ipynb'}, 'cwd': '/Users/USER/PycharmProjects/jupyter-livy/jupyter-launcher-1.1/examples'}
[D 15:12:03.948 NotebookApp] 201 POST /api/sessions (::1) 35.580000ms
[D 15:12:04.007 NotebookApp] Initializing websocket connection /api/kernels/7cb04636-4990-4f01-b39f-520a81b3636b/channels
[D 15:12:04.009 NotebookApp] Requesting kernel info from 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:04.009 NotebookApp] Connecting to: tcp://127.0.0.1:63830
[D 15:12:05.758 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.759 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.762 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.766 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.769 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.773 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.774 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.775 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.777 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.781 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.782 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.782 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.787 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.788 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.788 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.789 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.789 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.790 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.790 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.790 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.791 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.793 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.796 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.797 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.800 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.802 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.804 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.805 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.808 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.809 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.810 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.810 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.810 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.811 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.811 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.812 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.812 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.816 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.817 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.820 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.822 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.822 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.823 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.827 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.830 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.832 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.834 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.835 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.835 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.836 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.836 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.838 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.839 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.843 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.844 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.847 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.850 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.851 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.852 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.852 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.855 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.856 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.857 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.857 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.858 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.858 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.859 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.859 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.859 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.860 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.860 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.860 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.861 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.861 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.861 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.864 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.865 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.868 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.869 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.870 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.871 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.872 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.872 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_open
[D 15:12:05.872 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.873 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.874 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.874 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.874 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.875 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (starting)
[D 15:12:05.876 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.877 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)
[D 15:12:05.877 NotebookApp] Received kernel info: {'status': 'ok', 'protocol_version': '5.3', 'implementation': 'ipython', 'implementation_version': '7.30.1', 'language_info': {'name': 'python', 'version': '3.9.12', 'mimetype': 'text/x-python', 'codemirror_mode': {'name': 'ipython', 'version': 3}, 'pygments_lexer': 'ipython3', 'nbconvert_exporter': 'python', 'file_extension': '.py'}, 'banner': "Python 3.9.12 (main, Jun  1 2022, 06:36:29) \nType 'copyright', 'credits' or 'license' for more information\nIPython 7.30.1 -- An enhanced Interactive Python. Type '?' for help.\n", 'help_links': [{'text': 'Python Reference', 'url': 'https://docs.python.org/3.9'}, {'text': 'IPython Reference', 'url': 'https://ipython.org/documentation.html'}, {'text': 'NumPy Reference', 'url': 'https://docs.scipy.org/doc/numpy/reference/'}, {'text': 'SciPy Reference', 'url': 'https://docs.scipy.org/doc/scipy/reference/'}, {'text': 'Matplotlib Reference', 'url': 'https://matplotlib.org/contents.html'}, {'text': 'SymPy Reference', 'url': 'http://docs.sympy.org/latest/index.html'}, {'text': 'pandas Reference', 'url': 'https://pandas.pydata.org/pandas-docs/stable/'}]}
[D 15:12:05.878 NotebookApp] 101 GET /api/kernels/7cb04636-4990-4f01-b39f-520a81b3636b/channels?session_id=7c74bd288a7f492d9144bf6ea9821a97 (::1) 1871.930000ms
[D 15:12:05.878 NotebookApp] Opening websocket /api/kernels/7cb04636-4990-4f01-b39f-520a81b3636b/channels
[D 15:12:05.878 NotebookApp] Getting buffer for 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:05.878 NotebookApp] Connecting to: tcp://127.0.0.1:63831
[D 15:12:05.879 NotebookApp] Connecting to: tcp://127.0.0.1:63830
[D 15:12:05.879 NotebookApp] Connecting to: tcp://127.0.0.1:63834
[D 15:12:05.879 NotebookApp] Connecting to: tcp://127.0.0.1:63832
[D 15:12:05.880 NotebookApp] Connecting to: tcp://127.0.0.1:63830
[D 15:12:05.880 NotebookApp] Connecting to: tcp://127.0.0.1:63834
[D 15:12:05.881 NotebookApp] Nudge: attempt 1 on kernel 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:05.883 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.884 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)
[D 15:12:05.884 NotebookApp] Nudge: IOPub received: 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:05.884 NotebookApp] Nudge: resolving iopub future: 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:05.885 NotebookApp] Nudge: shell info reply received: 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:05.885 NotebookApp] Nudge: resolving shell future: 7cb04636-4990-4f01-b39f-520a81b3636b
[D 15:12:05.887 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.889 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)
[D 15:12:05.890 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.892 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)
[D 15:12:05.893 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.894 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)
[D 15:12:05.922 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.923 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: comm_msg
[D 15:12:05.924 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)
[D 15:12:05.930 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (busy)
[D 15:12:05.930 NotebookApp] activity on 7cb04636-4990-4f01-b39f-520a81b3636b: status (idle)

Versions:

  • SparkMagic 0.20.0
  • Livy (if you know it) 0.8
  • Spark 3.1.2

Additional context
Add any other context about the problem here.