Project

General

Profile

Simulation production August 2018 » History » Version 108

« Previous - Version 108/162 (diff) - Next » - Current version
Filippo Varanini, 09/03/2018 10:36 AM


Simulation production — August 2018

Production managers: Francesco Tortorici, Filippo Varanini (interim)

The books of this submission are kept by hand, since we are not yet ready to use POMS.

Standard configurations

stage standard configuration alternative versions
G4 standard_g4_icarus.fcl cosmics_g4_icarus_volDetEnc.fcl (for cosmic samples)
DetSim standard_detsim_icarus.fcl
McReco reco_icarus_driver_reco_all.fcl

Samples

Sample stage configuration version events submitted on completed output location
"intrinsic" electrons1 Gen prod_electrons_intrinsic_workshop2018.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_intrinsic/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_intrinsic/out/
DetSim standard 10000 2018-09-03 1706/2000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
"oscillated" electrons1 Gen prod_electrons_oscilllated_workshop2018.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_oscillated/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_oscillated/out/
DetSim standard 10000 1733/2000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
isotropic electrons Gen prod_eminus_0-1GeV_isotropic_icarus.fcl v07_02_00 100000 2018-08-23 2000/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/gen/prod_electron/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron/out/
DetSim standard 10000 1907/2000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Electron neutrinos Gen simulation_genie_icarus_Aug2018_nue.fcl v07_02_00 500000 2018-08-24 10000/10000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_nue/out/
filter filter_genie_active.fcl 500000 2018-08-26 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/filter/prod_nue/out/
G4 standard 500000 2018-08-20 10000/10000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_01_00/g4/prod_nue/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Muon neutrinos Gen simulation_genie_icarus_Aug2018_numu.fcl v07_02_00 500000 2018-08-25 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_numu/out/
filter filter_genie_active.fcl 500000 2018-08-26 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/filter/prod_numu/out/
G4 standard 5000 2018-08-27 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_numu/out/
DetSim standard 10000 10000/10000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Nu_e+cosmics Gen prodcorsika_genie_standard_icarus_Aug2018_nue.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_nue/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 1997/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_cosmics_nue/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Nu_mu+cosmics Gen prodcorsika_genie_standard_icarus_Aug2018_numu.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_numu/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 1995/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_01_00/g4/prod_cosmics_numu/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
cosmics Gen prodcorsika_standard_icarus.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 100000 2018-08-20 1996/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000
cosmics(small test) Gen prodcorsika_standard_icarus.fcl v07_02_00 1000 2018-08-25 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_smalltest/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 2018-08-20 100/100 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics_smalltest/out/
DetSim standard 1000 100/100 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/detsim/prod_cosmics_smalltest/out/
McReco standard 10000
Muons BNB-like Gen prod_mu_workshop2018.fcl v07_02_00 1000 2018-08-31 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/gen/prod_muons_BNB/out/
G4 standard 1000 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/g4/prod_muons_BNB/out/
DetSim standard 1000 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/detsim/prod_muons_BNB/out/
McReco standard 1000
1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/reco/prod_muons_BNB/out/
Muons cosmics Gen /icarus/app/users/icaruspro/test_07_02_00/prod_muon_as_cosmics.fcl v07_03_00 6000 2018-08-31 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/gen/prod_muons_cosmics/out/
G4 standard 6000 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/g4/prod_muons_cosmics/out/
DetSim standard 6000 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/detsim/prod_muons_cosmics/out/
McReco standard 6000 5000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/reco/prod_muons_cosmics/out/

1 The momentum distribution of the single electrons in the "intrinsic" sample is the one expected from interactions of ν e from BNB beam. The one for the "oscillated" sample is expected from ν e after oscillation from ν μ from BNB beam.

Resource tests

icaruscode v07_01_00

The following tests were performed with local icaruscode v07_01_00 runs on icarusbuild01.fnal.gov on August 16, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk
[events] per event VmHWM [MB] [MB/event]
prod_electrons_oscilllated_workshop2018.fcl Gen 50 <0.1"/event 310 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 10"/event 2100 MB 2 MB/event
+ standard_detsim_icarus.fcl DetSim 5 1'/event 740 MB 4 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 5 22'/event 1100 MB 12 MB/event
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen 50 7.6"/event 1350 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 2'/event 4200 MB 120 MB/event
+ standard_detsim_icarus.fcl DetSim 2 10.5'/event 3900 MB 260 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 2 4.5h/event 14000 MB 650 MB/event

Output files include the data from the previous stages.

icaruscode v07_02_00 (tagged)

The following tests were performed with local icaruscode v07_02_00 (icaruscode:1dbd5b7f1, see the commit message for explanation) runs on icarusbuild01.fnal.gov on August 27, 2018 (first one) and August 31, 2018 (second one).

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen 10 7.8"/event 1350 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 1.6'/event 3400 MB 100 MB/event no known explanation for reduction of time and memory, might be statistical
+ standard_detsim_icarus.fcl DetSim 5 9.5'/event 3000 MB 180 MB/event roughly 85% PMT, 5% wires, 5% CRT
+ reco_icarus_driver_reco_all.fcl McReco 2 2h/event 10000 MB 420 MB/event roughly 66% GausHitFinder, 30% ICARUSHitFinder
prod_mu_workshop2018.fcl Gen 50 average 0.14 s/event, max 1 s/event 700 MB 3 KB/event
+ standard_g4_icarus.fcl G4 50 average 3.4 s/event, max 228 s/event 2700 MB average 1 MB/event, max 1.2 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 61 s/event, max 83 minutes/event 1290 MB average 3.2 MB/event, max 3.65 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 93 s/event, max 1h 50'/event 5000 MB average 10.5 MB/event, max 11.9 MB/event

The following tests were performed with local icaruscode v07_03_00 (icaruscode:8256feeb, see the commit message for explanation) runs on icarusbuild01.fnal.gov on August 31, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
prod_muon_as_cosmics.fcl Gen 50 average <0.1 s/event, max 1.3 s/event 710 MB 2.6 KB/event
+ standard_g4_icarus.fcl G4 50 average 4.4 s/event, max 5 minutes/event 2800 MB 2 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 66 s/event, max 1h 35' /event 1400 MB average 4.9 MB/event, max 6 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 230 s/event, max 5h 15' /event 5700 MB average 15.9 MB/event, max 19.7 MB/event

Output files include the data from the previous stages.