Project

General

Profile

Simulation production August 2018 » History » Version 104

Version 103 (Filippo Varanini, 09/03/2018 03:08 AM) → Version 104/162 (Francesco Tortorici, 09/03/2018 03:15 AM)

h1. Simulation production — August 2018

Production managers: "Francesco Tortorici":mailto:francesco.tortorici@ct.infn.it, "Filippo Varanini":mailto:filippo.varanini@pd.infn.it _(interim)_

The books of this submission are kept by hand, since we are not yet ready to use POMS.

h2. Standard configurations

|_. stage |_. standard configuration |_. alternative versions |
| @G4@ | @standard_g4_icarus.fcl@ | @cosmics_g4_icarus_volDetEnc.fcl@ (for cosmic samples) |
| @DetSim@ | @standard_detsim_icarus.fcl@ |
| @McReco@ | @reco_icarus_driver_reco_all.fcl@ |

h2. Samples

table(sortable).
|_. Sample |_. stage |_. configuration |_. version |_>. events |_=. submitted on |_. completed |_. output location |
|/4. "intrinsic" electrons[1] | @Gen@ | @prod_electrons_intrinsic_workshop2018.fcl@ |/4. @v07_02_00@ |>. 100000 |=. 2018-08-25 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_intrinsic/out/@ |
| @G4@ | _standard_ |>. 100000 |=. 2018-08-26 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_intrinsic/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 1391/2000% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/4. "oscillated" electrons[1] | @Gen@ | @prod_electrons_oscilllated_workshop2018.fcl@ |/4. @v07_02_00@ |>. 100000 |=. 2018-08-25 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_electron_oscillated/out/@ |
| @G4@ | _standard_ |>. 100000 |=. 2018-08-26 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron_oscillated/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 1456/2000% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/4. isotropic electrons | @Gen@ | @prod_eminus_0-1GeV_isotropic_icarus.fcl@ |/4. @v07_02_00@ |>. 100000 |=. 2018-08-23 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/gen/prod_electron/out/@ |
| @G4@ | _standard_ |>. 100000 |=. 2018-08-26 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_electron/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 1907/2000% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/5. Electron neutrinos | @Gen@ | @simulation_genie_icarus_Aug2018_nue.fcl@ |/5. @v07_02_00@ |>. 500000 |=. 2018-08-24 |>. %{color: green} 10000/10000% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_nue/out/@ |
| @filter@ | @filter_genie_active.fcl@ |>. 500000 |=. 2018-08-26 |>. %{color: green} 10000/10000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/filter/prod_nue/out/@ |
| @G4@ | _standard_ |>. 500000 |=. 2018-08-20 |>. %{color: green} 10000/10000% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_01_00/g4/prod_nue/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/5. Muon neutrinos | @Gen@ | @simulation_genie_icarus_Aug2018_numu.fcl@ |/5. @v07_02_00@ |>. 500000 |=. 2018-08-25 |>. %{color: green} 10000/10000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_numu/out/@ |
| @filter@ | @filter_genie_active.fcl@ |>. 500000 |=. 2018-08-26 |>. %{color: green} 10000/10000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/filter/prod_numu/out/@ |
| @G4@ | _standard_ |>. 5000 |=. 2018-08-27 |>. %{color: green} 10000/10000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_numu/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 9069/10000% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/4. Nu_e+cosmics | @Gen@ | @prodcorsika_genie_standard_icarus_Aug2018_nue.fcl@ |/4. @v07_02_00@ |>. 100000 |=. 2018-08-25 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_nue/out/@ |
| @G4@ | @cosmics_g4_icarus_volDetEnc.fcl@ |>. 1000 |=. |>. %{color: green} 1996/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/g4/prod_cosmics_nue/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/4. Nu_mu+cosmics | @Gen@ | @prodcorsika_genie_standard_icarus_Aug2018_numu.fcl@ |/4. @v07_02_00@ |>. 100000 |=. 2018-08-25 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_numu/out/@ |
| @G4@ | @cosmics_g4_icarus_volDetEnc.fcl@ |>. 1000 |=. |>. %{color: green} 1995/2000% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_01_00/g4/prod_cosmics_numu/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
|/4.cosmics | @Gen@ | @prodcorsika_standard_icarus.fcl@ |/4. @v07_02_00@ |>. 100000 |=. 2018-08-25 |>. %{color: green} 2000/2000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics/out/@ |
| @G4@ | @cosmics_g4_icarus_volDetEnc.fcl@ |>. 100000 |=. 2018-08-20 |>. %{color: green} 1993/2000% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics/out/@ |
| @DetSim@ | _standard_ |>. 10000 |=. |>. %{color: red } 0/100% | @/pnfs/icarus/scratch/...@ |
| @McReco@ | _standard_ |>. 10000 |=.
|
|/4.cosmics(small test) | @Gen@ | @prodcorsika_standard_icarus.fcl@ |/4. @v07_02_00@ |>. 1000 |=. 2018-08-25 |>. %{color: green} 100/100% | @/pnfs/icarus/scratch/icaruspro/prod_v07/v07_02_00/gen/prod_cosmics_smalltest/out/@ |
| @G4@ | @cosmics_g4_icarus_volDetEnc.fcl@ |>. 1000 |=. 2018-08-20 |>. %{color: green} 100/100% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/g4/prod_cosmics_smalltest/out/@ |
| @DetSim@ | _standard_ |>. 1000 |=. |>. %{color: red } 100/100% | @/pnfs/icarus/scratch/icaruspro/test_v07/v07_02_00/detsim/prod_cosmics_smalltest/out/@ |
| @McReco@ | _standard_ |>. 10000 |=.
|
|/4. Muons BNB-like | @Gen@ | @prod_mu_workshop2018.fcl@ |/4. @v07_02_00@ |>. 1000 |=. 2018-08-31 |>. %{color: green} 1000/1000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/gen/prod_muons_BNB/out/@ |
| @G4@ | _standard_ |>. 1000 |=. |>. %{color: green} 1000/1000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/g4/prod_muons_BNB/out/@ |
| @DetSim@ | _standard_ |>. 1000 |=. |>. %{color: green} 1000/1000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/detsim/prod_muons_BNB/out/@ |
| @McReco@ | _standard_ |>. 1000 |=.
|>. %{color: green} 1000/1000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/musimilBNB/v07_02_00/reco/prod_muons_BNB/out/@ |
|
|/4. Muons cosmics | @Gen@ | @/icarus/app/users/icaruspro/test_07_02_00/prod_muon_as_cosmics.fcl@ |/4. @v07_03_00@ |>. 6000 |=. 2018-08-31 |>. %{color: green} 6000/6000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/gen/prod_muons_cosmics/out/@ |
| @G4@ | _standard_ |>. 6000 |=. |>. %{color: green} 6000/6000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/g4/prod_muons_cosmics/out/@ |
| @DetSim@ | _standard_ |>. 6000 |=. |>. %{color: green} 6000/6000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/detsim/prod_muons_cosmics/out/@ |
| @McReco@ | _standard_ |>. 6000 |=. |>. %{color: red} 5000/6000% 50/6000% | @/pnfs/icarus/scratch/icaruspro/prod_v07/mucosmics/v07_03_00/reco/prod_muons_cosmics/out/@ |

fn1. The momentum distribution of the single electrons in the "intrinsic" sample is the one expected from interactions of ν ~e~ from BNB beam. The one for the "oscillated" sample is expected from ν ~e~ after oscillation from ν ~μ~ from BNB beam.

h3. Resource tests

h4. @icaruscode@ @v07_01_00@

The following tests were performed with local @icaruscode@ @v07_01_00@ runs on @icarusbuild01.fnal.gov@ on August 16, 2018.

|_/2. Sample |_/2. Stage |_. Statistics |_. CPU time |_. Memory peak |_. Data size on disk |
|. _[events]_ |=. _per event_ | VmHWM _[MB]_ | _[MB/event]_ |
|_. @prod_electrons_oscilllated_workshop2018.fcl@ | @Gen@ |>. 50 |>. <0.1"/event |>. 310 MB |>. <0.1 MB/event |
| %{font-style: italic}+ @standard_g4_icarus.fcl@% | @G4@ |>. 5 |>. 10"/event |>. %{color: orange} 2100 MB% |>. 2 MB/event |
| %{font-style: italic}+ @standard_detsim_icarus.fcl@% | @DetSim@ |>. 5 |>. %{color: orange} 1'/event% |>. 740 MB |>. 4 MB/event |
| %{font-style: italic}+ @reco_icarus_driver_reco_all.fcl@% | @McReco@ |>. 5 |>. 22'/event |>. 1100 MB |>. 12 MB/event |
|_. @prodcorsika_genie_standard_icarus_Aug2018_nue.fcl@ | @Gen@ |>. 50 |>. 7.6"/event |>. %{color: green } 1350 MB% |>. <0.1 MB/event |
| %{font-style: italic}+ @standard_g4_icarus.fcl@% | @G4@ |>. 5 |>. %{color: orange} 2'/event% |>. %{color: red } 4200 MB% |>. 120 MB/event |
| %{font-style: italic}+ @standard_detsim_icarus.fcl@% | @DetSim@ |>. 2 |>. %{color: red }10.5'/event% |>. %{color: orange} 3900 MB% |>. 260 MB/event |
| %{font-style: italic}+ @reco_icarus_driver_reco_all.fcl@% | @McReco@ |>. 2 |>. %{color: red } 4.5h/event% |>. %{color: red }14000 MB% |>. 650 MB/event |

Output files include the data from the previous stages.

h4. @icaruscode@ @v07_02_00@ (tagged)

The following tests were performed with local @icaruscode@ @v07_02_00@ (icaruscode:commit:1dbd5b7f1, see the commit message for explanation) runs on @icarusbuild01.fnal.gov@ on August 27, 2018 (first one) and August 31, 2018 (second one).

|_/2. Sample |_/2. Stage |_. Statistics |_. CPU time |_. Memory peak |_. Data size on disk |_. comments |
|. _[events]_ |=. _per event_ | VmHWM _[MB]_ | _[MB/event]_ |
|_. @prodcorsika_genie_standard_icarus_Aug2018_nue.fcl@ | @Gen@ |>. 10 |>. 7.8"/event |>. %{color: green } 1350 MB% |>. <0.1 MB/event |
| %{font-style: italic}+ @standard_g4_icarus.fcl@% | @G4@ |>. 5 |>. %{color: orange} 1.6'/event% |>. %{color: orange} 3400 MB% |>. 100 MB/event | no known explanation for reduction of time and memory, might be statistical |
| %{font-style: italic}+ @standard_detsim_icarus.fcl@% | @DetSim@ |>. 5 |>. %{color: red } 9.5'/event% |>. %{color: green } 3000 MB% |>. 180 MB/event | roughly 85% PMT, 5% wires, 5% CRT |
| %{font-style: italic}+ @reco_icarus_driver_reco_all.fcl@% | @McReco@ |>. 2 |>. %{color: red } 2h/event% |>. %{color: red }10000 MB% |>. 420 MB/event | roughly 66% @GausHitFinder@, 30% @ICARUSHitFinder@ |
|_. @prod_mu_workshop2018.fcl@ | @Gen@ |>. 50 |>. average 0.14 s/event, max 1 s/event |>. 700 MB |>. 3 KB/event | |
| %{font-style: italic}+ @standard_g4_icarus.fcl@% | @G4@ |>. 50 |>. average 3.4 s/event, max 228 s/event |>. 2700 MB |>. average 1 MB/event, max 1.2 MB/event | |
| %{font-style: italic}+ @standard_detsim_icarus.fcl@% | @DetSim@ |>. 50 |>. average 61 s/event, max 83 minutes/event |>. 1290 MB |>. average 3.2 MB/event, max 3.65 MB/event | |
| %{font-style: italic}+ @reco_icarus_driver_reco_all.fcl@% | @McReco@ |>. 50 |>. average 93 s/event, max 1h 50'/event |>. 5000 MB |>. average 10.5 MB/event, max 11.9 MB/event | |

The following tests were performed with local @icaruscode@ @v07_03_00@ (icaruscode:commit:8256feeb, see the commit message for explanation) runs on @icarusbuild01.fnal.gov@ on August 31, 2018.

|_/2. Sample |_/2. Stage |_. Statistics |_. CPU time |_. Memory peak |_. Data size on disk |_. comments |
|. _[events]_ |=. _per event_ | VmHWM _[MB]_ | _[MB/event]_ |
|_. @prod_muon_as_cosmics.fcl@ | @Gen@ |>. 50 |>. average <0.1 s/event, max 1.3 s/event <0.1"/event |>. 710 MB |>. 2.6 KB/event | |
| %{font-style: italic}+ @standard_g4_icarus.fcl@% | @G4@ |>. 50 |>. average 4.4 s/event, max 5 minutes/event 46"/event |>. 2800 MB |>. 2 MB/event | |
| %{font-style: italic}+ @standard_detsim_icarus.fcl@% | @DetSim@ |>. 50 |>. average 66 s/event, max 1h 35' /event 2'/event |>. 1400 1300 MB |>. average 4.9 MB/event, max 6 4.2 MB/event | |
| %{font-style: italic}+ @reco_icarus_driver_reco_all.fcl@% | @McReco@ |>. 50 |>. average 230 s/event, max 5h 15' /event 2'/event |>. 5700 3700 MB |>. average 15.9 MB/event, max 19.7 10.8 MB/event | |

Output files include the data from the previous stages.