Giters

ilastik / lazyflow

lazy parallel ondemand zero copy numpy array data flows with caching and dirty propagation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Improve memory management on Mac

stuarteberg opened this issue · comments

commented

Check lazyflow/operators/operators.py lines 275ff
psutil.phymem_usage is deprecated, update to virtual_memory().available instead

As we found during testing last week, the memory manager seems to think that most of the memory on the OS is already unavailable upon app startup. This may be due to some difference in how psutil reports available memory on Mac and Linux.

This leads to under-utilization of RAM for caches, causing the caches to be purged much more frequently than desired.

commented

This seems to be fixed according to Stuart with a recent psutil update, virtual_memory().available seems to be consistent with linux behaviour.