Improve log_instrs feature
PhilippvK opened this issue · comments
Creating instruction traces for (multiple) large models with MLonMCU has a few problems:
- Very slow due to I/O bound (using sysout for capturing log)
- Needs post processing to split instruction trace from rest of log
- Complete trace is accumulated in RAM. if one trace would be 4GB big and you trace 32 models in parallel, at least 128GB of memory would be required
- Large Artifacts should be only referenced by paths to reduce memory usage
- Tracing directly to a file is currently not possible due to infrastructure limitations. A feature callback does not have access to the temporary directory of a run.
Proposals on how to deal with this will be added later.
For 5.:
Possible we can provide a temporary directory for each component (similarly to the platform components) which is exposed to targets.