Project

General

Profile

Bug #24364

art v3_05_00 I/O performance problem: request for a patched release

Added by Pavel Murat 3 months ago. Updated 3 months ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
Infrastructure
Target version:
Start date:
04/30/2020
Due date:
% Done:

100%

Estimated time:
Spent time:
Occurs In:
Scope:
Internal
Experiment:
Mu2e
SSI Package:
art
Duration:

Description

Dear art team,

Mu2e has recently identified a severe problem with art I/O performance, excited
when an art job was reading multiple input files with highly pre-selected events
in them.

Note, that this is a regular case for an analysis job.

For 50 input files of the same length and with approximately the same number of events in them,
read sequentially, processing the of last file was taking x10 longer than processing of the
first one. For 100 input files, the performance degradation was too severe to be measured.

Kyle - kudos to him - has already found and implemented a remedy.

On behalf of Mu2e I'd like to

a) thank Kyle
b) request a new release of art with the bug fix propagated into it

-- thanks, Pasha

which art

/cvmfs/mu2e.opensciencegrid.org/artexternals/art/v3_05_00/slf7.x86_64.e19.prof/bin/art

History

#1 Updated by Kyle Knoepfel 3 months ago

  • Assignee set to Kyle Knoepfel
  • Status changed from New to Assigned

#2 Updated by Kyle Knoepfel 3 months ago

  • % Done changed from 0 to 100
  • Status changed from Assigned to Resolved
  • Category set to Infrastructure
  • Occurs In 3.05.00 added

Resolved with commits:

#3 Updated by Kyle Knoepfel 3 months ago

  • Target version set to 3.05.01

#4 Updated by Kyle Knoepfel 3 months ago

  • Status changed from Resolved to Closed

The mu distribution with art 3.05.01 is now available on SciSoft: https://scisoft.fnal.gov/scisoft/bundles/mu/v3_05_01/mu-v3_05_01.html.

I will be working on release notes soon.



Also available in: Atom PDF