Production - Status¶
Production Activities¶
Current priorities for production samples actively being run by the production group either through PUBS or by hand.¶
- Ext BNB Data - reco1, reco2, anatree - All events
- Single Photons (prod_gamma_0.05-2.0GeV_isotropic) MC - reco1, reco2 - 10K
- Single muminus (isotropic) and piminus (isotropic) and proton (forward-going) samples MC - reco1, reco2, anatree 20K
- MuCS Data - reco1, reco2, anatree - All events
- Unbiased BNB Data - reco1, reco2, anatree - All events
- CORSIKA inTime - gen/g4/detsim - 250K events - reco1, reco2, anatree - 50K events
- GENIE BNB only - reco1, reco2, anatree - 50K events
- test Gen/G4/DetSim in v04_36_00_03 - test
- run reco stage1 and stage2 in a single job - test
samples completed based on Neutrino2016 request¶
- BNB SW Trig Data - reco1, reco2, anatree - 500K events
- GENIE BNB+Cosmic - reco1, reco2, anatree - 50K
development of PUBS or project.py¶
- movement of file validation to worker node
- extract sam metadata on worker
* declare file to sam on worker
- development of DAGs for Monte Carlo production
- run multiple stages in one batch job
- Adaptive merging to target file size
- Remove hard-wired posix calls from project.py (done via python module larbatch_posix.py).
- Separate bookkeeping information generated by project.py from data in dCache (local database).
- holding more meetings
Data Processing and Reconstruction Status¶
| Current swizzler version: |
v04_26_04_08 |
| Current reconstruction version: |
v05_08_00_01 |
| Current anatree version: |
v05_08_00_01 |
Current Progress (Apr 26 06:00)
| Data Stream |
Goal Neut2016 |
Swizzled |
% done |
Reco1 |
% done |
Reco2 |
% done |
anatree |
% done |
| BNB SWTrig on tape |
500000 |
976937 |
195.39 |
788940 |
157.79 |
788593 |
157.72 |
786535 |
157.31 |
| BNB SWTrig any locale |
500000 |
991831 |
198.37 |
788940 |
157.79 |
795204 |
159.04 |
787086 |
157.42 |
| BNB Off Beam on tape |
524065 |
518901 |
99.01 |
513710 |
98.02 |
512134 |
97.72 |
507099 |
96.76 |
| BNB Off Beam any locale |
524065 |
524065 |
100.00 |
513710 |
98.02 |
516101 |
98.48 |
507175 |
96.78 |
| BNB Unbiased on tape |
52478 |
52478 |
100.00 |
31700 |
60.41 |
31196 |
59.45 |
5221 |
9.95 |
| BNB Unbiased any locale |
52478 |
52478 |
100.00 |
31700 |
60.41 |
31302 |
59.65 |
5221 |
9.95 |
Note that Reco1 files are never declared to tape so those numbers will always be the same.
SAM Dataset Definitions
| Data Stream |
Swizzled |
Reco1 |
Reco2 |
anatree |
| BNB SWTrig |
prod_bnb_swizzle_inclusive_v3 |
N/A |
prod_bnb_reco_inclusive_v5 |
prod_bnb_anatree_inclusive_v5 |
| BNB Off Beam |
prod_extbnb_swizzle_inclusive_v3 |
N/A |
prod_extbnb_reco_inclusive_v5 |
prod_extbnb_anatree_inclusive_v5 |
| BNB Unbiased |
prod_bnbunbiased_swizzle_inclusive_v3 |
N/A |
prod_bnbunbiased_reco_inclusive_v5 |
rod_bnbunbiased_anatree_inclusive_v5 |
Monte Carlo Processing and Reconstruction Status¶
| Current Gen/G4/Detsim version: |
v04_36_00_01 |
| Current reconstruction version: |
v05_08_00_01 |
| Current anatree version: |
v05_08_00_01 |
Current Progress (Apr 26 06:00)
| Sample |
Goal DetSim |
Gen |
% done |
G4 |
% done |
DetSim |
% done |
Goal Reco |
Reco1 |
% done |
Reco2 |
% done |
anatree |
% done |
| GENIE BNB + Cosmics on tape |
500000 |
597700 |
119.54 |
572100 |
114.42 |
295160 |
59.03 |
50000 |
240640 |
481.28 |
188880 |
377.76 |
189380 |
378.76 |
| GENIE BNB + Cosmics any locale |
500000 |
597700 |
119.54 |
572100 |
114.42 |
570740 |
114.15 |
50000 |
240640 |
481.28 |
190880 |
381.76 |
189380 |
378.76 |
| GENIE BNB on tape |
1000000 |
1210720 |
121.07 |
1187040 |
118.70 |
892440 |
89.24 |
50000 |
154180 |
308.36 |
155720 |
311.44 |
0 |
0.00 |
| GENIE BNB any locale |
1000000 |
1210720 |
121.07 |
1187040 |
118.70 |
1111000 |
111.10 |
50000 |
154180 |
308.36 |
155740 |
311.48 |
0 |
0.00 |
| CORSIKA on tape |
250000 |
244504 |
97.80 |
195864 |
78.35 |
51896 |
20.76 |
50000 |
0 |
0.00 |
0 |
0.00 |
0 |
0.00 |
| CORSIKA any locale |
250000 |
244504 |
97.80 |
195864 |
78.35 |
85934 |
34.37 |
50000 |
0 |
0.00 |
0 |
0.00 |
0 |
0.00 |
Note that Gen, G4, and Reco1 files are never declared to tape so those numbers will always be the same.
Processing Status Updated Hourly
SAM Dataset Definitions
| Data Stream |
DetSim |
Reco1 |
Reco2 |
anatree |
| GENIE BNB + Cosmics |
prodgenie_bnb_nu_cosmic_uboone_mcc7_detsim |
N/A |
prodgenie_bnb_nu_cosmic_uboone_mcc7_reco2 |
prodgenie_bnb_nu_cosmic_uboone_mcc7_anatree |
| GENIE BNB |
prodgenie_bnb_nu_uboone_mcc7_detsim |
N/A |
prodgenie_bnb_nu_uboone_mcc7_reco2 |
prodgenie_bnb_nu_uboone_mcc7_anatree |
| CORSIKA |
prodcosmics_corsika_inTime_uboone_mcc7_detsim |
N/A |
prodcosmics_corsika_inTime_uboone_mcc7_reco2 |
prodcosmics_corsika_inTime_uboone_mcc7_anatree |
Data reconstruction PUBS projects¶
Data reconstruction using standard asic settings¶
These configurations are being used for runs 5113 and later (including keep up reconstruction). There are three processing stages that use the following fcl files. The current release in use for these projects is uboonecode v05_08_00_01.
| Stage |
Fcl |
Description |
| reco1 |
reco_uboone_data_Feb2016_driver_stage1.fcl |
Stage 1 reconstruction: signal processing, hit reconstruction, and "fuzzy path" 2D and 3D econstruction |
| reco2 |
reco_uboone_data_Feb2016_driver_stage2.fcl |
Stage 2 reconstruction: pandora and line cluster 2D and 3D reconstruction |
| anatree |
standard_ana_uboone_data.fcl |
Make analysis trees |
Here is the enabled status of this type of reconstruction for the eight software trigger streams.
| Stream |
Reco1 |
Reco2 |
Anatree |
| BNB |
Y |
Y |
Y |
| BNB External |
Y |
Y |
Y |
| BNB Unbiased |
Y |
Y |
Y |
| NUMI |
N |
N |
N |
| NUMI External |
N |
N |
N |
| NUMI Unbiased |
N |
N |
N |
| External unbiased |
Y |
Y |
Y |
| MUCS |
Y |
Y |
Y |
Data reconstruction using "quiet wires" asic settings¶
These configurations are being used for runs 4952-5112. There are three processing stages that use the following fcl files. Only the stage 1 reco fcl file differs from standard asic fcls. The current release in use for these projects is uboonecode v05_08_00_01.
| Stage |
Fcl |
Description |
| reco1 |
reco_uboone_data_Feb2016_driver_stage1_quietwires.fcl |
Stage 1 reconstruction: signal processing, hit reconstruction, and "fuzzy path" 2D and 3D econstruction |
| reco2 |
reco_uboone_data_Feb2016_driver_stage2.fcl |
Stage 2 reconstruction: pandora and line cluster 2D and 3D reconstruction |
| anatree |
standard_ana_uboone_data.fcl |
Make analysis trees |
Here is the enabled status of this type of reconstruction for the eight software trigger streams.
| Stream |
Reco1 |
Reco2 |
Anatree |
| BNB |
Y |
Y |
Y |
| BNB External |
Y |
Y |
Y |
| BNB Unbiased |
Y |
Y |
Y |
| NUMI |
N |
N |
N |
| NUMI External |
N |
N |
N |
| NUMI Unbiased |
N |
N |
N |
| External unbiased |
Y |
Y |
Y |
| MUCS |
Y |
Y |
Y |
Offline PUBS Daemon Configuration¶
| Node |
Uboonecode Version |
Project Type |
Projects Running |
| uboonegpvm01 |
v05_08_00_05 |
Keep up data analysis tree |
|
| uboonegpvm02 |
v05_08_00_05 |
Keep up data stage 1 reconstruction |
|
| uboonegpvm03 |
v05_08_00_01 |
MC reconstruction |
BNB Only (reco1, reco2, ana) |
| uboonegpvm04 |
v05_08_00_03 |
Keep up swizzling |
|
| uboonegpvm05 |
v05_08_00_05 |
Keep up data stage 2 reconstruction |
|
| uboonegpvm06 |
v05_08_00_06 |
disabled |
|
| uboonegpvm07 |
v04_36_00_03 |
Simulation |
|
| uboonepubsgpvm01 |
v05_08_00_06 |
Run 1 open trigger swizzling |
|
| uboonepubsgpvm02 |
v06_26_01_01 |
Data processing??? |
|
| uboonepubsgpvm03 |
v06_26_01_01 |
|
|
| uboonepubsgpvm04 |
v06_26_01_01 |
|
|
| uboonepubsgpvm05 |
v06_26_01_01 |
|
|
| uboonepubsgpvm06 |
v06_26_01_01 |
|
|
Open Trigger Dataset staging¶
| Dataset |
Staging |
Staged |
Flushed |
Submitted |
| prod_raw_binary_open_trigger_3420_3449_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3450_3499_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3500_3549_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3550_3599_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3600_3649_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3650_3699_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3700_3749_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3750_3799_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3800_3849_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3850_3899_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3900_3949_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_3950_3999_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4000_4049_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4050_4099_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4100_4149_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4150_4199_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4200_4249_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4250_4299_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4300_4349_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4350_4399_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4400_4449_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4450_4499_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4500_4549_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4550_4599_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4600_4649_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4650_4699_inclusive_v2 |
|
X |
|
X |
| prod_raw_binary_open_trigger_4700_4749_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4750_4799_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4800_4849_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4850_4899_inclusive_v2 |
|
|
X |
X |
| prod_raw_binary_open_trigger_4900_4951_inclusive_v2 |
|
|
X |
X |