Project

General

Profile

Simulation production August 2018 » History » Version 102

« Previous - Version 102/162 (diff) - Next » - Current version
Filippo Varanini, 09/02/2018 03:14 AM


Simulation production — August 2018

Production managers: Francesco Tortorici, Filippo Varanini (interim)

The books of this submission are kept by hand, since we are not yet ready to use POMS.

Standard configurations

stage standard configuration alternative versions
G4 standard_g4_icarus.fcl cosmics_g4_icarus_volDetEnc.fcl (for cosmic samples)
DetSim standard_detsim_icarus.fcl
McReco reco_icarus_driver_reco_all.fcl

Samples

Sample stage configuration version events submitted on completed output location
"intrinsic" electrons1 Gen prod_electrons_intrinsic_workshop2018.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_intrinsic/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_intrinsic/out/
DetSim standard 10000 1391/2000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
"oscillated" electrons1 Gen prod_electrons_oscilllated_workshop2018.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_oscillated/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_oscillated/out/
DetSim standard 10000 1456/2000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
isotropic electrons Gen prod_eminus_0-1GeV_isotropic_icarus.fcl v07_02_00 100000 2018-08-23 2000/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/gen/prod_electron/out/
G4 standard 100000 2018-08-26 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron/out/
DetSim standard 10000 1698/2000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Electron neutrinos Gen simulation_genie_icarus_Aug2018_nue.fcl v07_02_00 500000 2018-08-24 10000/10000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_nue/out/
filter filter_genie_active.fcl 500000 2018-08-26 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/filter/prod_nue/out/
G4 standard 500000 2018-08-20 10000/10000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_01_00/g4/prod_nue/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Muon neutrinos Gen simulation_genie_icarus_Aug2018_numu.fcl v07_02_00 500000 2018-08-25 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_numu/out/
filter filter_genie_active.fcl 500000 2018-08-26 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/filter/prod_numu/out/
G4 standard 5000 2018-08-27 10000/10000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_numu/out/
DetSim standard 10000 9069/10000 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Nu_e+cosmics Gen prodcorsika_genie_standard_icarus_Aug2018_nue.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_nue/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 1996/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_cosmics_nue/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
Nu_mu+cosmics Gen prodcorsika_genie_standard_icarus_Aug2018_numu.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_numu/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 1995/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_01_00/g4/prod_cosmics_numu/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000 0/100 /pnfs/icarus/scratch/...
cosmics Gen prodcorsika_standard_icarus.fcl v07_02_00 100000 2018-08-25 2000/2000 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 100000 2018-08-20 1993/2000 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics/out/
DetSim standard 10000 0/100 /pnfs/icarus/scratch/...
McReco standard 10000
cosmics(small test) Gen prodcorsika_standard_icarus.fcl v07_02_00 1000 2018-08-25 100/100 /pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_smalltest/out/
G4 cosmics_g4_icarus_volDetEnc.fcl 1000 2018-08-20 100/100 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics_smalltest/out/
DetSim standard 1000 100/100 /pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/detsim/prod_cosmics_smalltest/out/
McReco standard 10000
Muons BNB-like Gen prod_mu_workshop2018.fcl v07_02_00 1000 2018-08-31 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/gen/prod_muons_BNB/out/
G4 standard 1000 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/g4/prod_muons_BNB/out/
DetSim standard 1000 1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/detsim/prod_muons_BNB/out/
McReco standard 1000
1000/1000 /pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/reco/prod_muons_BNB/out/
Muons cosmics Gen /icarus/app/users/icaruspro/test_07_02_00/prod_muon_as_cosmics.fcl v07_03_00 6000 2018-08-31 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/gen/prod_muons_cosmics/out/
G4 standard 6000 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/g4/prod_muons_cosmics/out/
DetSim standard 6000 6000/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/detsim/prod_muons_cosmics/out/
McReco standard 6000 50/6000 /pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/reco/prod_muons_cosmics/out/

1 The momentum distribution of the single electrons in the "intrinsic" sample is the one expected from interactions of ν e from BNB beam. The one for the "oscillated" sample is expected from ν e after oscillation from ν μ from BNB beam.

Resource tests

icaruscode v07_01_00

The following tests were performed with local icaruscode v07_01_00 runs on icarusbuild01.fnal.gov on August 16, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk
[events] per event VmHWM [MB] [MB/event]
prod_electrons_oscilllated_workshop2018.fcl Gen 50 <0.1"/event 310 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 10"/event 2100 MB 2 MB/event
+ standard_detsim_icarus.fcl DetSim 5 1'/event 740 MB 4 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 5 22'/event 1100 MB 12 MB/event
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen 50 7.6"/event 1350 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 2'/event 4200 MB 120 MB/event
+ standard_detsim_icarus.fcl DetSim 2 10.5'/event 3900 MB 260 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 2 4.5h/event 14000 MB 650 MB/event

Output files include the data from the previous stages.

icaruscode v07_02_00 (tagged)

The following tests were performed with local icaruscode v07_02_00 (icaruscode:1dbd5b7f1, see the commit message for explanation) runs on icarusbuild01.fnal.gov on August 27, 2018 (first one) and August 31, 2018 (second one).

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
prodcorsika_genie_standard_icarus_Aug2018_nue.fcl Gen 10 7.8"/event 1350 MB <0.1 MB/event
+ standard_g4_icarus.fcl G4 5 1.6'/event 3400 MB 100 MB/event no known explanation for reduction of time and memory, might be statistical
+ standard_detsim_icarus.fcl DetSim 5 9.5'/event 3000 MB 180 MB/event roughly 85% PMT, 5% wires, 5% CRT
+ reco_icarus_driver_reco_all.fcl McReco 2 2h/event 10000 MB 420 MB/event roughly 66% GausHitFinder, 30% ICARUSHitFinder
prod_mu_workshop2018.fcl Gen 50 average 0.14 s/event, max 1 s/event 700 MB 3 KB/event
+ standard_g4_icarus.fcl G4 50 average 3.4 s/event, max 228 s/event 2700 MB average 1 MB/event, max 1.2 MB/event
+ standard_detsim_icarus.fcl DetSim 50 average 61 s/event, max 83 minutes/event 1290 MB average 3.2 MB/event, max 3.65 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 average 93 s/event, max 1h 50'/event 5000 MB average 10.5 MB/event, max 11.9 MB/event

The following tests were performed with local icaruscode v07_03_00 (icaruscode:8256feeb, see the commit message for explanation) runs on icarusbuild01.fnal.gov on August 31, 2018.

Sample Stage Statistics CPU time Memory peak Data size on disk comments
[events] per event VmHWM [MB] [MB/event]
prod_muon_as_cosmics.fcl Gen 50 <0.1"/event 710 MB 2.6 KB/event
+ standard_g4_icarus.fcl G4 50 46"/event 2800 MB 2 MB/event
+ standard_detsim_icarus.fcl DetSim 50 2'/event 1300 MB 4.2 MB/event
+ reco_icarus_driver_reco_all.fcl McReco 50 2'/event 3700 MB 10.8 MB/event

Output files include the data from the previous stages.