Reproducing the nue 2017 Analysis results¶

Datasets¶

Of course the details of all datasets are always available on the official datasets page, but these are the key concat datasets you're most likely to start with:
(NB: The Decaf Cuts live in CAFAna/Cuts/NueCuts2017.h for both ND and FD, See also: Making the Concats below)

ND data¶

• prod_sumdecaf_R17-03-01-prod3reco.d_nd_numi_fhc_full_v1_goodruns_nue2017

ND nominal¶

• prod_sumdecaf_R17-03-01-prod3reco.d_nd_genie_nonswap_fhc_nova_v08_full_v1_nue2017

FD nominal¶

• prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_tau_fhc_nova_v08_full_v1_nue2017

(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).

• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_v1_nue2017

ND systematics¶

• prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017

(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).

• prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.j_nd_genie_nonswap_fhc_nova_v08_full_calib-shift-nd-func_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-neg-offset_v1_nue2017

The concat for ND MC light-level no-shift are also shown here as a cross-check :

• prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v1_nue2017

FD systematics¶

• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017

(same as for FD MC, superceded by the following)

• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017

• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017

The concats for FD MC light-level no-shift are also shown here as a cross-check :

• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017
• prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017

FD Cosmic Data¶

• prod_sumdecaf_R17-03-01-prod3reco.h_fd_cosmic_full_v1_goodruns_nue2017

FD Data¶

The unblinded definitions are here :

• prod_restricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017 // 200 files

Above concats have mangled events, use the below for unblinded :

• prod_sumrestricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017 // 200 files

Blinded :

• prod_decaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017 // 200 files

Central weights¶

All plots should be using these weights, which adjust the flux and cross-sections to our central tunes:

kPPFXFluxCVWgt * kXSecCVWgt2017

Selections¶

As selection cuts are finalized they're added to NueCuts2017.h
To select the "core" sample use: kNue2017FD.
To select the "peripheral" sample use: kNue2017FDPeripheral.

The best default for other cuts for now is probably whatever was used in the second analysis

Exposures¶

Until the final processing of the data files, and all the accounting and crosschecks, are done, we will use round-number estimates of the beam exposure: 9e20 POT, and livetime within the beam spill (for scaling cosmic backgrounds) of 440s. These values are also available in CAFAna/Analysis/Exposures.h

The POT and livetime numbers for FD data now live in CAFAna/Analysis/Exposures.h

Creating predictions¶

Ana2017 prediction framework¶

With the 2017 analysis, we met two complications in creating our far detector predictions. In short, we need a way to extrapolate background events in the peripheral sample without a good ND handle on these events and a way to add the FD rock estimate with the fiducial prediction. For every prediction we make, we must first prepare three constituent pieces. We need a PredictionNoExtrap that gives the simulation's fiducial prediction at the far detector for both the core and peripheral samples, a PredictionExtrap that sets up ND decompositions and an extrapolation just for the FD core fiducial sample, and a PredictionNoExtrap that gives the simulation's rock estimate. Assuming you have pointers to all three, you need to do:

PredictionExtendToPeripheral *predFid = new PredictionExtendToPeripheral(PredictionExtrap *predCore, PredictionNoExtrap *predNoExtrap);
PredictionAddRock *pred = new PredictionAddRock(IPrediction *predFid,PredictionNoExtrap *predRock, 1./10.87, 1./13.13);

Here, predCore gives your extrapolated prediction to the core sample, predNoExtrap gives the MC prediction of all samples, and predRock gives the rock prediction. The 10.87 and 13.13 are rock spill duty factors. See DocDB 23108 if you want to learn more. The final pred is the prediction we actually want to use in the analysis.

Creating systematically shifted predictions¶

This section was written by a convener who hasn't tried actually running any of the jobs. To be fleshed out.

$ for k in `seq 0 4`; do cafe -bq nue/Ana2017/make_nue_filesyst_pred.C $k; done
$ cafe -bq nue/Ana2017/make_nue_xsec_pred.C
$ hadd_cafana hadded.root fout_make_nue_*_pred.root pred_xsec_fhc_*.root

These files are read in by PredictionSystNue2017

Creating cosmic background predictions¶

For cosmic bkg prediction run CAFAna/nue/Ana2017/get_cosmic_spectra.C. It will produce a file with spectra, for reading the spectra from the *.root file follow the little instruction in the end of get_cosmic_spectra.C file.

Creating concats¶

The reduce script used for making the above listed datasets from the parent CAFs is CAFAna/nue/reduce_bendecomp.C. It can be used for making both the ND and FD concats. The following nue selection cuts are used :

• kNueFD2017DecafCut (= kNue2017BasicPart && kCVNe > 0.5) for FD
• kNueND2017DecafCut (= kNueDQ2017CVN && kNue2017NDFiducial && kNue2017NDContain && kNue2017NDFrontPlanes) for ND

Both these cuts live in CAFAna/Cuts/NueCuts2017.h

In addition, to constrain the beam nue backgrounds using BEN, we look at high-statistics samples of contained and uncontained numuCC events.
Therefore, additional cuts (in CAFAna/Cuts/BeamNueCuts.h) are applied to fit them into the ND concats. They are :

• kNumuContainNDDecafCut (= kNumuBasicQuality && (kNumuContainND2017 || kNumuContainND) && (kNumuPID2017 || kNumuNCRej))
• kNumuUncontainNDDecafCut (= kNumuBasicQuality && kBENKaNumuFiducial && (!kNumuContainND2017 || !kNumuContainND) && (kNumuPID2017 || kNumuNCRej))

To prevent the concat size blowing up by adding in so many numuCC events, a special reduction method called ReduceForBENDecaf (in CAFAna/Decomp/BENDecomp.cxx) is used in the macro. This essentially keeps only the necessary branches required for BEN for the numuCC sample. The nue sample is otherwise untouched by this method. This keeps the concats at a manageable size and allows us to calculate the BEN scale factors on-the-fly for both nominal and systematically shifted datasets (in contrast to the Second Analysis).

The interface to the reduction script is basically through submit_concat_project.sh which lives in the NovaGridUtils package. A couple of extra concat scripts have been committed to NovaGridUtils to make the task simpler. The procedure is :

• Create a comma-separated txt file with the different CAF definitions you want to concat and the number of output concat files you want to create for each of them. An example is given in NovaGridUtils/bin/extra_concat_scripts/datasets.txt
• Run NovaGridUtils/bin/extra_concat_scripts/submit_multiple_concats.sh to submit a bunch of concat projects at once. The "nue2017" parameter runs reduce_bendecomp.C on the grid
  

  submit_multiple_concats.sh <output_dir for concat jobs> <release> "nue2017" <comma-separated txt file>
  

• Run NovaGridUtils/bin/extra_concat_scripts/get_metadata.sh to check for metadata differences between output concats and parent CAFs. Check with #production if there's anything weird in them. (IMPORTANT!!)
  

  get_metadata.sh <output dir for metadata json files> <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
  

• If everything is okay, then use NovaGridUtils/bin/extra_concat_scripts/cp_dropbox.sh to copy over your concat files to the FTS dropbox. You'll need novapro permissions for this step. Either request on #production or get someone who has them to copy them over for you.
  

  cp_dropbox.sh <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
  

• Finally, once they are copied over and declared (might take a while), run NovaGridUtils/bin/extra_concat_scripts/make_definitions.sh to well..make the definitions (like the ones given above)
  

  make_definitions.sh "nue2017" <comma-separated txt file>
  

make_definitions.sh checks the comma-separated txt file for the expected number of concat files and aborts if it doesn't find the required number. That could mean either that the files haven't been declared yet from Step 3 or more SAM lookup-parameters need to be added to nail down the concat files.