logging info in importer
arnaudon opened this issue · comments
Could you move the logging.info in import.py to debug?
Running this code in parallel pollutes my logs:
2024-02-20 22:13:28,409 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,410 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,411 INFO bluecellulab.importer: Loading the mod files.
2024-02-20 22:13:28,412 INFO bluecellulab.importer: Loading the hoc files.
2024-02-20 22:13:28,428 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,429 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,436 INFO bluecellulab.importer: Loading the mod files.
2024-02-20 22:13:28,436 INFO bluecellulab.importer: Loading the hoc files.
2024-02-20 22:13:28,445 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,445 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,456 INFO bluecellulab.importer: Loading the mod files.
2024-02-20 22:13:28,457 INFO bluecellulab.importer: Loading the hoc files.
2024-02-20 22:13:28,468 INFO bluecellulab.importer: Loading the mod files.
2024-02-20 22:13:28,469 INFO bluecellulab.importer: Loading the hoc files.
2024-02-20 22:13:28,486 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,486 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,491 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,491 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,501 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,501 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,524 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,525 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,556 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,556 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
2024-02-20 22:13:28,580 INFO bluecellulab.importer: Imported NEURON from: /gpfs/bbp.cscs.ch/home/arnaudon/base/lib/python3.11/site-packages/neuron/__init__.py
2024-02-20 22:13:28,580 INFO bluecellulab.importer: Mod lib: /gpfs/bbp.cscs.ch/data/scratch/proj148/circuits/test_emodel/x86_64
Interspeced with ones of course (#4 )
Ok this one is easy to fix. One question to better understand the use-case: are you running bluecellulab in parallel?
yes, its same parallel stuff as in #4 (from emodel-generalisation code with dask-dataframe engine)
In #139 these logs in the importer module are set to debug however some other modules still use logger.info. If those become overwhelming then setting a logging Filter can help: https://docs.python.org/3/library/logging.html#logging.Filter.filter
Closing since this is implemented. Thanks for reporting.