art v3_05_00 I/O performance problem: request for a patched release
Dear art team,
Mu2e has recently identified a severe problem with art I/O performance, excited
when an art job was reading multiple input files with highly pre-selected events
Note, that this is a regular case for an analysis job.
For 50 input files of the same length and with approximately the same number of events in them,
read sequentially, processing the of last file was taking x10 longer than processing of the
first one. For 100 input files, the performance degradation was too severe to be measured.
Kyle - kudos to him - has already found and implemented a remedy.
On behalf of Mu2e I'd like to
a) thank Kyle
b) request a new release of art with the bug fix propagated into it
-- thanks, Pasha
#4 Updated by Kyle Knoepfel 6 months ago
- Status changed from Resolved to Closed
The mu distribution with art 3.05.01 is now available on SciSoft: https://scisoft.fnal.gov/scisoft/bundles/mu/v3_05_01/mu-v3_05_01.html.
I will be working on release notes soon.