ipython / ipyparallel

IPython Parallel: Interactive Parallel Computing in Python

Home Page:https://ipyparallel.readthedocs.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ResourceWarnings on launcher processes

tommedema opened this issue · comments

I did a fresh install of ipyparallel and ran the example from the tutorial in a Jupyter notebook :

https://ipyparallel.readthedocs.io/en/stable/

import time
import ipyparallel as ipp

task_durations = [1] * 25

# request a cluster
with ipp.Cluster(n = 4) as rc:
    # get a view on the cluster
    view = rc.load_balanced_view()
    # submit the tasks
    asyncresult = view.map_async(time.sleep, task_durations)
    # wait interactively for results
    asyncresult.wait_interactive()
    # retrieve actual results
    result = asyncresult.get()

Output:

Exception ignored in: <function Popen.__del__ at 0x7f7e28112f70>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/subprocess.py", line 1052, in __del__
    _warn("subprocess %s is still running" % self.pid,
ResourceWarning: subprocess 41586 is still running
Exception ignored in: <_io.FileIO name=95 mode='wb' closefd=True>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/site-packages/ipyparallel/cluster/launcher.py", line 665, in start
    return super().start()
ResourceWarning: unclosed file <_io.BufferedWriter name=95>
Starting 4 engines with <class 'ipyparallel.cluster.launcher.LocalEngineSetLauncher'>
Exception ignored in: <function Popen.__del__ at 0x7f7e28112f70>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/subprocess.py", line 1052, in __del__
    _warn("subprocess %s is still running" % self.pid,
ResourceWarning: subprocess 41600 is still running
Exception ignored in: <_io.FileIO name=97 mode='wb' closefd=True>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/site-packages/ipyparallel/cluster/launcher.py", line 749, in start
    d = el.start()
ResourceWarning: unclosed file <_io.BufferedWriter name=97>
Exception ignored in: <function Popen.__del__ at 0x7f7e28112f70>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/subprocess.py", line 1052, in __del__
    _warn("subprocess %s is still running" % self.pid,
ResourceWarning: subprocess 41601 is still running
Exception ignored in: <_io.FileIO name=97 mode='wb' closefd=True>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/site-packages/ipyparallel/cluster/launcher.py", line 749, in start
    d = el.start()
ResourceWarning: unclosed file <_io.BufferedWriter name=97>
Exception ignored in: <function Popen.__del__ at 0x7f7e28112f70>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/subprocess.py", line 1052, in __del__
    _warn("subprocess %s is still running" % self.pid,
ResourceWarning: subprocess 41602 is still running
Exception ignored in: <_io.FileIO name=97 mode='wb' closefd=True>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/site-packages/ipyparallel/cluster/launcher.py", line 749, in start
    d = el.start()
ResourceWarning: unclosed file <_io.BufferedWriter name=97>
Exception ignored in: <function Popen.__del__ at 0x7f7e28112f70>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/subprocess.py", line 1052, in __del__
    _warn("subprocess %s is still running" % self.pid,
ResourceWarning: subprocess 41603 is still running
Exception ignored in: <_io.FileIO name=97 mode='wb' closefd=True>
Traceback (most recent call last):
  File "/Users/tommedema/opt/anaconda3/lib/python3.9/site-packages/ipyparallel/cluster/launcher.py", line 749, in start
    d = el.start()
ResourceWarning: unclosed file <_io.BufferedWriter name=97>
100%
4/4 [00:06<00:00, 6.02s/engine]
sleep: 100%
25/25 [00:07<00:00, 3.17tasks/s]
Stopping engine(s): 1661715279
engine set stopped 1661715279: {'engines': {'0': {'exit_code': 0, 'pid': 41600, 'identifier': '0'}, '1': {'exit_code': 0, 'pid': 41601, 'identifier': '1'}, '2': {'exit_code': 0, 'pid': 41602, 'identifier': '2'}, '3': {'exit_code': 0, 'pid': 41603, 'identifier': '3'}}, 'exit_code': 0}
Stopping controller
Controller stopped: {'exit_code': 0, 'pid': 41586, 'identifier': 'ipcontroller-1661715278-frh9-39986'}

Versions:
The version of the notebook server is: 6.4.5
The server is running on this version of Python:
Python 3.9.7 (default, Sep 16 2021, 08:50:36)
[Clang 10.0.0 ]
IPython 7.29.0

Running on MacOS Monterey 12.5.

Thanks! These are warnings (that Python doesn't show by default), not exceptions, but they should be suppressed by #744