Project

General

Profile

Simulation production — August-October 2018

Production managers: Francesco Tortorici, Filippo Varanini (interim)

LAST EDIT: 2018-10-25 11:15 CDT

The books of this submission are kept by hand, since we are not yet ready to use POMS.

Standard configurations

stage standard configuration alternative versions purity versions
filter filter_genie_active.fcl
G4 standard_g4_icarus.fcl cosmics_g4_icarus_volDetEnc.fcl (for cosmic samples) cosmics_g4_icarus_volDetEnc_*ms.fcl, *=2,4,6,8,15
DetSim standard_detsim_icarus.fcl
McReco reco_icarus_driver_reco_all.fcl

Samples
Unless otherwise specified, nominally there are 50 events/job.

number of events goal reached completely or very near
number of events is becoming about "good enough" for some purposes
number of events goal is far away

See the list of SAM Dataset Definitions.

Sample stage configuration version events submitted on completed output location
"intrinsic" electrons1 Gen prod_electrons_intrinsic_workshop2018.fcl v07_02_00 reco both v07_02_00 v07_05_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_intrinsic/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_intrinsic/out/
DetSim standard 100000 2018-09-04 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/detsim/prod_electron_intrinsic/out/
McReco standard 100000 2000/2000 /pnfs/icarus/scratch/...
"oscillated" electrons1 Gen prod_electrons_oscilllated_workshop2018.fcl v07_02_00 reco both v07_02_00 v07_05_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_oscillated/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_oscillated/out/
DetSim standard 100000 2018-09-04 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_oscillated/out/
McReco standard 100000 2000/2000 /pnfs/icarus/scratch/...
isotropic electrons Gen prod_eminus_0-1GeV_isotropic_icarus.fcl v07_02_00 reco both v07_02_00 v07_05_00 100000 2018-08-23 2000/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/gen/prod_electron/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron/out/
DetSim standard 100000 2018-09-04 2000/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/detsim/prod_electron/out/
McReco standard 100000 2000/2000 /pnfs/icarus/scratch/...
Electron neutrinos2 old Gen simulation_genie_icarus_Aug2018_nue.fcl gen v07_02_00 filter g4 detsim reco v07_05_00 500000 2018-08-24 10000/10000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_nue/out/
filter filter_genie_active.fcl 500000 2018-08-26 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_05_00/filter/prod_nue/out/
G4 standard 123000 2018-08-20 600/600 /pnfs/icarus/scratch/...
DetSim standard 148204 2018-09-04 686/686 /pnfs/icarus/scratch/...
McReco standard 148457 687/687 /pnfs/icarus/scratch/...
Electron neutrinos2 new Gen simulation_genie_icarus_Aug2018_nue.fcl v07_06_01 1000 2018-10-5 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_nue/out/
filter filter_genie_active.fcl 263 2018-08-26 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_05_00/filter/prod_nue/out/
G4 standard 263 2018-08-20 100/100 /pnfs/icarus/scratch/...
DetSim standard 263 2018-09-04 100/100 /pnfs/icarus/scratch/...
McReco standard 263 100/100 /pnfs/icarus/scratch/...
Muon neutrinos2 old Gen simulation_genie_icarus_Aug2018_numu.fcl gen v07_02_00 filter g4 detsim reco v07_05_00 reco_old v07_03_00 500000 2018-08-25 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_numu/out/
filter filter_genie_active.fcl 500000 2018-08-26 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_05_00/filter/prod_numu/out/
G4 standard 120000 2018-08-27 600/600 /pnfs/icarus/scratch/...
DetSim standard 143352 2018-09-04 691/691 /pnfs/icarus/scratch/...
McReco standard 149981 718/718 /pnfs/icarus/scratch/...
reco_old standard 100000 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_03_00/reco/prod_numu/out
Muon neutrinos2 new Gen simulation_genie_icarus_Aug2018_numu.fcl v07_06_01 1000 2018-10-5 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_numu/out/
filter filter_genie_active.fcl 244 2018-08-26 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_05_00/filter/prod_nue/out/
G4 standard 244 2018-08-20 100/100 /pnfs/icarus/scratch/...
DetSim standard 244 2018-09-04 100/100 /pnfs/icarus/scratch/...
McReco standard 244 100/100 /pnfs/icarus/scratch/...
Nu_e+cosmics (old) Gen prodcorsika_genie_standard_icarus_Aug2018_nue.fcl v07_02_00 reco v07_05_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_nue/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 99800 2018-09-04 1996/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_cosmics_nue/out/
DetSim standard 20650 413/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
Nu_e+cosmics (new, v07_06_01 from scratch, 10 ev/job) Gen prodcorsika_genie_standard_icarus_Aug2018_nue.fcl v07_06_01 10000 2018-09-?? 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_cosmics_nue/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 10000 1000/1000 /pnfs/icarus/scratch...
DetSim standard 3320 332/1000 /pnfs/icarus/scratch/...
McReco standard 0 0/1000 /pnfs/icarus/scratch/...
Nu_mu+cosmics (old) Gen prodcorsika_genie_standard_icarus_Aug2018_numu.fcl v07_02_00 reco v07_05_00 10000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_numu/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 100000 2018-09-04 1995/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics_numu/out/
DetSim standard 25650 513/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
Nu_mu+cosmics (new, v07_06_01 from scratch, 10 ev/job) Gen prodcorsika_genie_standard_icarus_Aug2018_numu.fcl v07_06_01 10000 2018-09-?? 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_cosmics_numu/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 10000 1000/1000 /pnfs/icarus/scratch...
DetSim standard 10000 1000/1000 /pnfs/icarus/scratch/...
McReco standard 9990 999/1000 /pnfs/icarus/scratch/...
cosmics (old, stopped at detsim) Gen prodcorsika_standard_icarus.fcl v07_02_00 reco v07_05_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 99650 2018-09-04 1993/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics/out/
DetSim standard 75750 1515/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
cosmics3 (new, v07_06_01 from scratch, 10 ev/job) Gen prodcorsika_standard_icarus.fcl v07_06_01 20000 2018-10-05 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_cosmics/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 19990 1999/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/g4/prod_cosmics/out/
DetSim standard 18730 1873/2000 /pnfs/icarus/scratch/...
McReco standard 9290 929/2000 /pnfs/icarus/scratch/...
cosmics(small test, 10 events/job) Gen prodcorsika_standard_icarus.fcl v07_02_00 reco 07_05_00 1000 2018-09-01 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_smalltest/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 2018-09-01 100/100 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics_smalltest/out/
DetSim standard 1000 2018-09-01 100/100 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/detsim/prod_cosmics_smalltest/out/
McReco standard 1000 2018-09-12 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_05_00/reco/prod_cosmics_smalltest/out/
cosmics(small test #2, 10 events/job) Gen prodcorsika_standard_icarus.fcl v07_05_00 100 2018-09-24 10/10 /pnfs/icarus/scratch/icaruspro/test_v07/v07_05_00/gen/prod_cosmics_all05/out
G4 cosmics_g4_icarus_volDetEnc.fcl 100 2018-09-24 10/10 /pnfs/icarus/scratch/icaruspro/test_v07/v07_05_00/g4/prod_cosmics_all05/out
DetSim standard 100 10/10 /pnfs/icarus/scratch/icaruspro/test_v07/v07_05_00/detsim/prod_cosmics_all05/out
McReco standard 100 10/10 /pnfs/icarus/scratch/icaruspro/test_v07/v07_05_00/reco/prod_cosmics_all05/out
Muons BNB-like Gen prod_mu_workshop2018.fcl v07_02_00 reco both v07_02_00 v07_05_00 100000 2018-08-31 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/gen/prod_muons_BNB/out/
G4 standard 100000 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/g4/prod_muons_BNB/out/
DetSim standard 100000 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/detsim/prod_muons_BNB/out/
McReco old standard 72900
1458/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/reco/prod_muons_BNB/out/
McReco new standard 100000
2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_05_00/reco/prod_muons_BNB/out/
Muons cosmics Gen /icarus/app/users/icaruspro/test_07_02_00/prod_muon_as_cosmics.fcl v07_03_00 reco both v07_03_00 v07_05_00 300000 2018-08-31 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/gen/prod_muons_cosmics/out/
G4 standard 300000 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/g4/prod_muons_cosmics/out/
DetSim standard 300000 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/detsim/prod_muons_cosmics/out/
McReco old standard 6400 128/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/reco/prod_muons_cosmics/out/
McReco new standard 169150 3383/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_05_00/reco/prod_muons_cosmics/out/
NUMI nue off axis test4 Gen simulation_numi_nue.fcl v07_06_01 1000 2018-09-26 10/10 /pnfs/icarus/scratch/icaruspro/test_v07/v07_06_01/gen/test_numi_nue/out/
filter standard 223 10/10 /pnfs/icarus/scratch/...
G4 standard 223 10/10 /pnfs/icarus/scratch/...
DetSim standard 223 10/10 /pnfs/icarus/scratch/...
McReco standard 223
10/10 /pnfs/icarus/scratch/...
NUMI numu off axis test4 Gen simulation_numi_numu.fcl v07_06_01 1000 2018-09-26 10/10 /pnfs/icarus/scratch/icaruspro/test_v07/v07_06_01/gen/test_numi_numu/out/
filter standard 268 10/10 /pnfs/icarus/scratch/...
G4 standard 268 10/10 /pnfs/icarus/scratch/...
DetSim standard 268 10/10 /pnfs/icarus/scratch/...
McReco standard 268
10/10 /pnfs/icarus/scratch/...
NUMI nue off axis5 Gen simulation_numi_nue.fcl v07_06_01 1000 2018-10-01 10/10 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/test_numi_nue/out/
filter standard 222 10/10 /pnfs/icarus/scratch/...
G4 standard 222 10/10 /pnfs/icarus/scratch/...
DetSim standard 222 10/10 /pnfs/icarus/scratch/...
McReco standard 222
10/10 /pnfs/icarus/scratch/...
NUMI numu off axis5 Gen simulation_numi_numu.fcl v07_06_01 1000 2018-10-01 10/10 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/test_numi_numu/out/
filter standard 238 10/10 /pnfs/icarus/scratch/...
G4 standard 238 10/10 /pnfs/icarus/scratch/...
DetSim standard 238 10/10 /pnfs/icarus/scratch/...
McReco standard 238
10/10 /pnfs/icarus/scratch/...
Purity 2 ms Gen prodcorsika_standard_icarus.fcl v07_06_01 20000 2018-10-5 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_purity_2ms/out/
G4 cosmics_g4_icarus_volDetEnc_2ms.fcl 20000 2000/2000 /pnfs/icarus/scratch/...
DetSim standard 7990 799/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
Purity 4 ms Gen prodcorsika_standard_icarus.fcl v07_06_01 20000 2018-10-5 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_purity_4ms/out/
G4 cosmics_g4_icarus_volDetEnc_4ms.fcl 19960 1996/2000 /pnfs/icarus/scratch/...
DetSim standard 0 0/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
Purity 6 ms Gen prodcorsika_standard_icarus.fcl v07_06_01 20000 2018-10-5 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_purity_6ms/out/
G4 cosmics_g4_icarus_volDetEnc_6ms.fcl 19990 1999/2000 /pnfs/icarus/scratch/...
DetSim standard 0 0/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
Purity 8 ms Gen prodcorsika_standard_icarus.fcl v07_06_01 20000 2018-10-5 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_purity_8ms/out/
G4 cosmics_g4_icarus_volDetEnc_8ms.fcl 39890 3989/4000 /pnfs/icarus/scratch/...
DetSim standard 25760 2576/4000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...
Purity 15 ms Gen prodcorsika_standard_icarus.fcl v07_06_01 20000 2018-10-5 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_06_01/gen/prod_purity_15ms/out/
G4 cosmics_g4_icarus_volDetEnc_15ms.fcl 19990 1999/2000 /pnfs/icarus/scratch/...
DetSim standard 17180 1718/2000 /pnfs/icarus/scratch/...
McReco standard 0 0/2000 /pnfs/icarus/scratch/...

1 The momentum distribution of the single electrons in the "intrinsic" sample is the one expected from interactions of ν e from BNB beam. The one for the "oscillated" sample is expected from ν e after oscillation from ν μ from BNB beam.

2 The number of total jobs for some stages may seem a bit funny. That is essentially due to a quirk from many check/makeup cycles, and in part to a change in the number of required g4 and following stages jobs after the filter stage completed. As usual, the number of events credited to such stages is the one given as "total good events" from project.py check. The most interesting figure for each stage is just the number of events anyway.

3 This sample doubles as purity 9.7 ms

4 Horn off configuration

5 Normal configuration

Resource tests

icaruscode v07_01_00

The following tests were performed with local icaruscode v07_01_00 runs on icarusbuild01.fnal.gov on August 16, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk
[events] per event VmHWM [MB] [MB/event]
prod_electrons_oscilllated_workshop2018.fcl Gen 50 <0.1"/event 310 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 10"/event 2100 MB 2 MB/event
+ standard_detsim_icarus.fcl DetSim 5 1'/event 740 MB 4 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 5 22'/event 1100 MB 12 MB/event
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen 50 7.6"/event 1350 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 2'/event 4200 MB 120 MB/event
+ standard_detsim_icarus.fcl DetSim 2 10.5'/event 3900 MB 260 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 2 4.5h/event 14000 MB 650 MB/event

Output files include the data from the previous stages.

icaruscode v07_02_00 (tagged)

The following tests were performed with local icaruscode v07_02_00 (icaruscode:1dbd5b7f1, see the commit message for explanation) runs on icarusbuild01.fnal.gov on August 27, 2018 (first one), August 31, 2018 (second one), September 16, 2018 (others).

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen 10 7.8"/event 1350 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 50 107 s/event 12.6 GB 3 MB/event
+ standard_detsim_icarus.fcl DetSim 50 328 s/event 7900 MB 25 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 2 2h/event 10000 MB 420 MB/event roughly 66% GausHitFinder, 30% ICARUSHitFinder
prodcorsika_genie_standard_icarus_Aug2018_numu.fcl Gen 50 - - - root files deleted by the time of these measures
+ standard_g4_icarus.fcl G4 50 average 117 s/event, max 5h 30' /event 11.4 GB average 49.6 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 322 s/event, max 7h 52'/event 6460 MB average 305 MB/event
+ reco_icarus_driver_reco_all.fcl McReco - - - -
prodcorsika_standard_icarus.fcl Gen - - - - root files deleted by the time of these measures
+ standard_g4_icarus.fcl G4 50 average 101 s/event, max 6' / event, total = 5h 4' 12.6 GB average - MB/event, max - MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 460 s/event, max 4'/event, total= 2h 52' 10.3 GB average 198 MB/event, max 222.4 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 - - -
prod_mu_workshop2018.fcl Gen 50 average 0.14 s/event, max 1 s/event 700 MB 3 KB/event
+ standard_g4_icarus.fcl G4 50 average 3.4 s/event, max 228 s/event 2700 MB average 1 MB/event, max 1.2 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 61 s/event, max 83 minutes/event 1290 MB average 3.2 MB/event, max 3.65 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 93 s/event, max 1h 50'/event 5000 MB average 10.5 MB/event, max 11.9 MB/event
prod_electrons_intrinsic_workshop2018.fcl Gen 50 - - - root files deleted by the time of these measures
+ standard_g4_icarus.fcl G4 50 - - - root files deleted by the time of these measures
+ standard_detsim_icarus.fcl DetSim 50 average 63 s/event, max 4h 17'/event 1424 MB average 4.9 MB/event, max 6.2 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 73 s/event, max 3h 50'/event 9640 MB average 13.5 MB/event, max 16.5 MB/event
prod_electrons_oscilllated_workshop2018.fcl Gen - - - - root files deleted by the time of these measures
+ standard_g4_icarus.fcl G4 50 - - - root files deleted by the time of these measures
+ standard_detsim_icarus.fcl DetSim 50 average 55.5 s/event, max 1h 41' /event 1350 MB average 4.4 MB/event, max 8.7 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 36 s/event, max 4h 24'/event 9.3 GB average 6.2 MB/event, max 12 MB/event
prod_eminus_0-1GeV_isotropic_icarus.fcl Gen - - - - root files deleted by the time of these measures
+ standard_g4_icarus.fcl G4 50 - - - root files deleted by the time of these measures
+ standard_detsim_icarus.fcl DetSim 50 average 49.4 s/event, max 5h 45' s/event 1260 MB average 2.6 MB/event, max 6.1 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 32 s/event, max 2h 20'/event 10.3 GB average 8.2 MB/event, max 19.4 MB/event

Output files include the data from the previous stages.

icaruscode v07_03_00 (tagged)

The following tests were performed with local icaruscode v07_03_00 (icaruscode:8256feeb, see the commit message for explanation) runs on icarusbuild01.fnal.gov on August 31, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
prod_muon_as_cosmics.fcl Gen 50 average <0.1 s/event, max 1.3 s/event 710 MB 2.6 KB/event
+ standard_g4_icarus.fcl G4 50 average 4.4 s/event, max 5 minutes/event 2800 MB 2 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 66 s/event, max 1h 35' /event 1400 MB average 4.9 MB/event, max 6 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 230 s/event, max 5h 15' /event 5700 MB average 15.9 MB/event, max 19.7 MB/event
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen reused v07_02_00
+ standard_g4_icarus.fcl G4
+ standard_detsim_icarus.fcl DetSim
+ reco_icarus_driver_reco_all.fcl McReco 2 2h/event 7000 MB 420 MB/event roughly 66% GausHitFinder, 30% ICARUSHitFinder; pandora: 2'; RawDigitFilterICARUS: 30"

Output files include the data from the previous stages.

icaruscode v07_05_00 (tagged)

The following tests were performed with local icaruscode v07_05_00 (icaruscode:aeffe894, see the commit message for explanation) runs on icarusbuild01.fnal.gov on September, 16, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
simulation_genie_icarus_Aug2018_nue.fcl Gen - average - s/event, max - s/event - MB - KB/event USED v07_02_00, root files deleted by the time of these measures
+ filter_genie_active.fcl filter 50 average < 0.01 s/event, max 6.5 s/event 830 MB average 3 kB/event, max 3.6 kB/event
+ standard_g4_icarus.fcl G4 50 average 20.9 s/event, max 1994 s/event 3.3 GB average 22.8 MB/event, max 39.3 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 97 s/event, max 2h 5'/event 1.9 GB average 10.2 MB/event, max 15.8 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 46 s/event, max 44 minutes/event 1.9 GB average 31.5 MB/event, max 48.2 MB/event
simulation_genie_icarus_Aug2018_numu.fcl Gen - average - s/event, max - s/event - MB - KB/event USED v07_02_00, root files deleted by the time of these measures
+ filter_genie_active.fcl filter 50 average < 0.01 s/event, max 9.5 s/event 826 MB average 3 kB/event, max 3.6 kB/event
+ standard_g4_icarus.fcl G4 50 average 6.3 s/event, max 22.7 minutes/event 3 GB average 4.8 MB/event, max 7.7 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 80 s/event, max 16h 53' /event 1700 MB average 6.6 MB/event, max 9 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 20.6 s/event, max 1 h/event 2300 MB average 19.5 MB/event, max 27 MB/event
prod_muon_as_cosmics.fcl Reco 50 average 9.9 s/event, max 1314 s/event 1700 MB average 15.8 MB/event, max 23.2 MB/event
prod_mu_workshop2018.fcl Reco 50 average 6.3 s/event, max 525 s/event 1700 MB average 10.7 MB/event, max 14.6 MB/event
prod_eminus_0-1GeV_isotropic_icarus.fcl Reco 50 average 7.8 s/event, max 1135 s/event 1512 MB average 8.2 MB/event, max 19.4 MB/event
prod_electrons_intrinsic_workshop2018.fcl Reco 50 average 12.2 s/event, max 1334 s/event 1560 MB average 13.5 MB/event, max 16.5 MB/event
prod_prod_electrons_oscilllated_workshop2018.fcl Reco 50 average 11 s/event, max 1145 s/event 1530 MB average 12.5 MB/event, max 24.2 MB/event
cosmics small test #2 prodcorsika_standard_icarus.fcl Gen 10 average 10 s/event, max 120 s/event 720 MB average 57 KB/event, max 59 kB/event
+ cosmics_g4_icarus_volDetEnc.fcl G4 10 average 87 s/event, max 18' /event 4800 MB average 96.7 MB/event, max 105.5 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average 303 s/event, max 380 s/event 4400 MB average 200 MB/event, max - MB/event
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event

icaruscode v07_06_01 (tagged)

The following tests were performed with local icaruscode v07_06_01 (icaruscode:62cbb9dd, see the commit message for explanation) runs on icarusbuild01.fnal.gov on October, 09, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
cosmics + nue simulation_genie_icarus_Aug2018_nue.fcl Gen 10 average 11.4 s/event, max 10 m/event 2360 MB 63 KB/event
+ standard_g4_icarus.fcl G4 10 average 95 s/event, max 35 m/event 10160 MB average 99 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event TBD
cosmics + numu simulation_genie_icarus_Aug2018_numu.fcl Gen 10 average 10 s/event, max 200 s/event 2300 MB 63 KB/event
+ standard_g4_icarus.fcl G4 10 average 77 s/event, max 39 m/event 11060 MB average 98 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average 320 s/event, max 2h 55' /event 8600 MB average 203 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 10 average 1520 s/event, max 9h 25'/event 7900 MB average 511 MB/event
cosmics prodcorsika_standard_icarus.fcl Gen 10 average 9.5 s/event, max 3'45'' /event 720 MB 55 KB/event
+ standard_g4_icarus.fcl G4 10 average 95 s/event, max 45 m/event 7600 MB average 96 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average 326 s/event, max 3h /event 6500 MB average 202 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 10 average 1500 s/event, max 9h30'/event 8500 MB average 502 MB/event
nue simulation_genie_icarus_Aug2018_nue.fcl Gen 10 average 2.3 s/event, max 89 s/event 2340 MB 14 KB/event
+ filter_genie_active.fcl filter 10 average 0.14 s/event, max 17 s/event 826 MB average 13 kB/event
+ standard_g4_icarus.fcl G4 10 average 22 s/event, max 2 m/event 2850 MB average 3.87 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average 55 s/event, max 9 m/event 1400 MB average 8.2 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 10 average 30 s/event, max 10 m/event 1600 MB average 21 MB/event
numu simulation_genie_icarus_Aug2018_numu.fcl Gen 10 average 61 s/event, max 3h 33' /event 2300 MB 4 KB/event
+ filter_genie_active.fcl filter 10 average 0.14 s/event, max 42 s/event 825 MB average 18 kB/event
+ standard_g4_icarus.fcl G4 10 average 8 s/event, max 9 m/event 2900 MB average 2.6 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average 88 s/event, max 1 h/event 1560 MB average 7.2 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 10 average 29 s/event, max 19 m/event 1880 MB average 22 MB/event
numi nue simulation_numi_nue.fcl Gen 100 average 112 s/event, max 7h 10' /event 2250 MB 4 KB/event
+ filter_genie_active.fcl filter 100 average 0.12 s/event, max 55 s/event 825 MB average 18 kB/event
+ standard_g4_icarus.fcl G4 100 average 9 s/event, max 4h 40' /event 2950 MB average 4.2 MB/event
+ standard_detsim_icarus.fcl DetSim 100 average 70 s/event, max 35 m/event 1500 MB average 8.8 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 100 average 43 s/event, max 35 m/event 1800 MB average 22.5 MB/event
numi numu simulation_numi_numu.fcl Gen 100 average 1 m/event, max 3h 33' /event 2300 MB 4 KB/event
+ filter_genie_active.fcl filter 100 average 0.15 s/event, max 42 s/event 825 MB average 18 kB/event
+ standard_g4_icarus.fcl G4 100 average 8 s/event, max 9 m/event 2900 MB average 2.6 MB/event
+ standard_detsim_icarus.fcl DetSim 100 average 88 s/event, max 58 m/event 1560 MB average 7.2 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 100 average 30 s/event, max 19 m/event 1880 MB average 22 MB/event
purity 2 ms prodcorsika_standard_icarus.fcl Gen 10 average 10 s/event, max 5 m/event 720 MB 56 KB/event
+ cosmics_g4_icarus_volDetEnc_2ms.fcl G4 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ standard_detsim_icarus.fcl DetSim 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event TBD
purity 4 ms prodcorsika_standard_icarus.fcl Gen 10 average 9 s/event, max 4'35'' /event 720 MB 56 KB/event
+ cosmics_g4_icarus_volDetEnc_4ms.fcl G4 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ standard_detsim_icarus.fcl DetSim 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event TBD
purity 6 ms prodcorsika_standard_icarus.fcl Gen 10 average 9 s/event, max 2'47''/event 720 MB 56 KB/event
+ cosmics_g4_icarus_volDetEnc_6ms.fcl G4 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ standard_detsim_icarus.fcl DetSim 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event TBD
purity 8 ms prodcorsika_standard_icarus.fcl Gen 10 average 10 s/event, max 4'18'' /event 720 MB 56 KB/event
+ cosmics_g4_icarus_volDetEnc_8ms.fcl G4 10 average 102 s/event, max 28 m/event 5700 MB average 122 MB/event
+ standard_detsim_icarus.fcl DetSim 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event TBD
purity 15 ms prodcorsika_standard_icarus.fcl Gen 10 average 9.4 s/event, max 5'42''/event 720 MB 56 KB/event
+ cosmics_g4_icarus_volDetEnc_15ms.fcl G4 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ standard_detsim_icarus.fcl DetSim 10 average - s/event, max - s/event - MB average - MB/event, max - MB/event TBD
+ reco_icarus_driver_reco_all.fcl McReco 10 average - s/event, max -/event - MB average - MB/event, max - MB/event TBD