Performance of xdmod-openstack job
rob-baron opened this issue · comments
The time to execute the job dramatically increased to several hours per run, and then dramatically decreased.
It should be taking less tan 20 minutes as it is supposed to run every 20 minutes.
will track times.
Moved all of the processed files to a subdirectory titled processed. This way, the older files are not available to be shredded again.
Some timestamps and run times
start timestamp end timestamp runtime status of process
2023-07-25 12:20:27 2023-07-25 16:00:46 222 completed
2023-07-25 16:01:20 2023-07-25 16:17:16 16 errored out
2023-07-25 16:17:42 2023-07-25 17:47:22 90 completed
2023-08-01 13:46:53 2023-08-01 14:07:39 20 completed