Project

General

Profile

Production - Status

Production Activities

Current priorities for production samples actively being run by the production group either through PUBS or by hand.

  1. Ext BNB Data - reco1, reco2, anatree - All events
  2. Single Photons (prod_gamma_0.05-2.0GeV_isotropic) MC - reco1, reco2 - 10K
  3. Single muminus (isotropic) and piminus (isotropic) and proton (forward-going) samples MC - reco1, reco2, anatree 20K
  4. MuCS Data - reco1, reco2, anatree - All events
  5. Unbiased BNB Data - reco1, reco2, anatree - All events
  6. CORSIKA inTime - gen/g4/detsim - 250K events - reco1, reco2, anatree - 50K events
  7. GENIE BNB only - reco1, reco2, anatree - 50K events
  8. test Gen/G4/DetSim in v04_36_00_03 - test
  9. run reco stage1 and stage2 in a single job - test

samples completed based on Neutrino2016 request

  1. BNB SW Trig Data - reco1, reco2, anatree - 500K events
  2. GENIE BNB+Cosmic - reco1, reco2, anatree - 50K

development of PUBS or project.py

  • movement of file validation to worker node
    • extract sam metadata on worker * declare file to sam on worker
  • development of DAGs for Monte Carlo production
  • run multiple stages in one batch job
  • Adaptive merging to target file size
  • Remove hard-wired posix calls from project.py (done via python module larbatch_posix.py).
  • Separate bookkeeping information generated by project.py from data in dCache (local database).
  • holding more meetings

Data Processing and Reconstruction Status

Current swizzler version: v04_26_04_08
Current reconstruction version: v05_08_00_01
Current anatree version: v05_08_00_01

Current Progress (Apr 26 06:00)

Data Stream Goal Neut2016 Swizzled % done Reco1 % done Reco2 % done anatree % done
BNB SWTrig on tape 500000 976937 195.39 788940 157.79 788593 157.72 786535 157.31
BNB SWTrig any locale 500000 991831 198.37 788940 157.79 795204 159.04 787086 157.42
BNB Off Beam on tape 524065 518901 99.01 513710 98.02 512134 97.72 507099 96.76
BNB Off Beam any locale 524065 524065 100.00 513710 98.02 516101 98.48 507175 96.78
BNB Unbiased on tape 52478 52478 100.00 31700 60.41 31196 59.45 5221 9.95
BNB Unbiased any locale 52478 52478 100.00 31700 60.41 31302 59.65 5221 9.95

Note that Reco1 files are never declared to tape so those numbers will always be the same.

SAM Dataset Definitions

Data Stream Swizzled Reco1 Reco2 anatree
BNB SWTrig prod_bnb_swizzle_inclusive_v3 N/A prod_bnb_reco_inclusive_v5 prod_bnb_anatree_inclusive_v5
BNB Off Beam prod_extbnb_swizzle_inclusive_v3 N/A prod_extbnb_reco_inclusive_v5 prod_extbnb_anatree_inclusive_v5
BNB Unbiased prod_bnbunbiased_swizzle_inclusive_v3 N/A prod_bnbunbiased_reco_inclusive_v5 rod_bnbunbiased_anatree_inclusive_v5

Monte Carlo Processing and Reconstruction Status

Current Gen/G4/Detsim version: v04_36_00_01
Current reconstruction version: v05_08_00_01
Current anatree version: v05_08_00_01

Current Progress (Apr 26 06:00)

Sample Goal DetSim Gen % done G4 % done DetSim % done Goal Reco Reco1 % done Reco2 % done anatree % done
GENIE BNB + Cosmics on tape 500000 597700 119.54 572100 114.42 295160 59.03 50000 240640 481.28 188880 377.76 189380 378.76
GENIE BNB + Cosmics any locale 500000 597700 119.54 572100 114.42 570740 114.15 50000 240640 481.28 190880 381.76 189380 378.76
GENIE BNB on tape 1000000 1210720 121.07 1187040 118.70 892440 89.24 50000 154180 308.36 155720 311.44 0 0.00
GENIE BNB any locale 1000000 1210720 121.07 1187040 118.70 1111000 111.10 50000 154180 308.36 155740 311.48 0 0.00
CORSIKA on tape 250000 244504 97.80 195864 78.35 51896 20.76 50000 0 0.00 0 0.00 0 0.00
CORSIKA any locale 250000 244504 97.80 195864 78.35 85934 34.37 50000 0 0.00 0 0.00 0 0.00

Note that Gen, G4, and Reco1 files are never declared to tape so those numbers will always be the same.

Processing Status Updated Hourly

SAM Dataset Definitions

Data Stream DetSim Reco1 Reco2 anatree
GENIE BNB + Cosmics prodgenie_bnb_nu_cosmic_uboone_mcc7_detsim N/A prodgenie_bnb_nu_cosmic_uboone_mcc7_reco2 prodgenie_bnb_nu_cosmic_uboone_mcc7_anatree
GENIE BNB prodgenie_bnb_nu_uboone_mcc7_detsim N/A prodgenie_bnb_nu_uboone_mcc7_reco2 prodgenie_bnb_nu_uboone_mcc7_anatree
CORSIKA prodcosmics_corsika_inTime_uboone_mcc7_detsim N/A prodcosmics_corsika_inTime_uboone_mcc7_reco2 prodcosmics_corsika_inTime_uboone_mcc7_anatree

Data reconstruction PUBS projects

Data reconstruction using standard asic settings

These configurations are being used for runs 5113 and later (including keep up reconstruction). There are three processing stages that use the following fcl files. The current release in use for these projects is uboonecode v05_08_00_01.

Stage Fcl Description
reco1 reco_uboone_data_Feb2016_driver_stage1.fcl Stage 1 reconstruction: signal processing, hit reconstruction, and "fuzzy path" 2D and 3D econstruction
reco2 reco_uboone_data_Feb2016_driver_stage2.fcl Stage 2 reconstruction: pandora and line cluster 2D and 3D reconstruction
anatree standard_ana_uboone_data.fcl Make analysis trees

Here is the enabled status of this type of reconstruction for the eight software trigger streams.

Stream Reco1 Reco2 Anatree
BNB Y Y Y
BNB External Y Y Y
BNB Unbiased Y Y Y
NUMI N N N
NUMI External N N N
NUMI Unbiased N N N
External unbiased Y Y Y
MUCS Y Y Y

Data reconstruction using "quiet wires" asic settings

These configurations are being used for runs 4952-5112. There are three processing stages that use the following fcl files. Only the stage 1 reco fcl file differs from standard asic fcls. The current release in use for these projects is uboonecode v05_08_00_01.

Stage Fcl Description
reco1 reco_uboone_data_Feb2016_driver_stage1_quietwires.fcl Stage 1 reconstruction: signal processing, hit reconstruction, and "fuzzy path" 2D and 3D econstruction
reco2 reco_uboone_data_Feb2016_driver_stage2.fcl Stage 2 reconstruction: pandora and line cluster 2D and 3D reconstruction
anatree standard_ana_uboone_data.fcl Make analysis trees

Here is the enabled status of this type of reconstruction for the eight software trigger streams.

Stream Reco1 Reco2 Anatree
BNB Y Y Y
BNB External Y Y Y
BNB Unbiased Y Y Y
NUMI N N N
NUMI External N N N
NUMI Unbiased N N N
External unbiased Y Y Y
MUCS Y Y Y

Offline PUBS Daemon Configuration

Node Uboonecode Version Project Type Projects Running
uboonegpvm01 v05_08_00_05 Keep up data analysis tree
uboonegpvm02 v05_08_00_05 Keep up data stage 1 reconstruction
uboonegpvm03 v05_08_00_01 MC reconstruction BNB Only (reco1, reco2, ana)
uboonegpvm04 v05_08_00_03 Keep up swizzling
uboonegpvm05 v05_08_00_05 Keep up data stage 2 reconstruction
uboonegpvm06 v05_08_00_06 disabled
uboonegpvm07 v04_36_00_03 Simulation
uboonepubsgpvm01 v05_08_00_06 Run 1 open trigger swizzling
uboonepubsgpvm02 v06_26_01_01 Data processing???
uboonepubsgpvm03 v06_26_01_01
uboonepubsgpvm04 v06_26_01_01
uboonepubsgpvm05 v06_26_01_01
uboonepubsgpvm06 v06_26_01_01

Open Trigger Dataset staging

Dataset Staging Staged Flushed Submitted
prod_raw_binary_open_trigger_3420_3449_inclusive_v2 X X
prod_raw_binary_open_trigger_3450_3499_inclusive_v2 X X
prod_raw_binary_open_trigger_3500_3549_inclusive_v2 X X
prod_raw_binary_open_trigger_3550_3599_inclusive_v2 X X
prod_raw_binary_open_trigger_3600_3649_inclusive_v2 X X
prod_raw_binary_open_trigger_3650_3699_inclusive_v2 X X
prod_raw_binary_open_trigger_3700_3749_inclusive_v2 X X
prod_raw_binary_open_trigger_3750_3799_inclusive_v2 X X
prod_raw_binary_open_trigger_3800_3849_inclusive_v2 X X
prod_raw_binary_open_trigger_3850_3899_inclusive_v2 X X
prod_raw_binary_open_trigger_3900_3949_inclusive_v2 X X
prod_raw_binary_open_trigger_3950_3999_inclusive_v2 X X
prod_raw_binary_open_trigger_4000_4049_inclusive_v2 X X
prod_raw_binary_open_trigger_4050_4099_inclusive_v2 X X
prod_raw_binary_open_trigger_4100_4149_inclusive_v2 X X
prod_raw_binary_open_trigger_4150_4199_inclusive_v2 X X
prod_raw_binary_open_trigger_4200_4249_inclusive_v2 X X
prod_raw_binary_open_trigger_4250_4299_inclusive_v2 X X
prod_raw_binary_open_trigger_4300_4349_inclusive_v2 X X
prod_raw_binary_open_trigger_4350_4399_inclusive_v2 X X
prod_raw_binary_open_trigger_4400_4449_inclusive_v2 X X
prod_raw_binary_open_trigger_4450_4499_inclusive_v2 X X
prod_raw_binary_open_trigger_4500_4549_inclusive_v2 X X
prod_raw_binary_open_trigger_4550_4599_inclusive_v2 X X
prod_raw_binary_open_trigger_4600_4649_inclusive_v2 X X
prod_raw_binary_open_trigger_4650_4699_inclusive_v2 X X
prod_raw_binary_open_trigger_4700_4749_inclusive_v2 X X
prod_raw_binary_open_trigger_4750_4799_inclusive_v2 X X
prod_raw_binary_open_trigger_4800_4849_inclusive_v2 X X
prod_raw_binary_open_trigger_4850_4899_inclusive_v2 X X
prod_raw_binary_open_trigger_4900_4951_inclusive_v2 X X