Reproducing the nue 2017 Analysis results » History » Version 22
« Previous -
Version 22/34
(diff) -
Next » -
Current version
Nitish Nayak, 10/22/2017 12:45 AM
Reproducing the nue 2017 Analysis results¶
Datasets¶
Of course the details of all datasets are always available on the official datasets page, but these are the key concat datasets you're most likely to start with:
(NB: The Decaf Cuts live in CAFAna/Cuts/NueCuts2017.h for both ND and FD, See also: Making the Concats below)
ND data¶
prod_sumdecaf_R17-03-01-prod3reco.d_nd_numi_fhc_full_v1_goodruns_nue2017
ND nominal¶
prod_sumdecaf_R17-03-01-prod3reco.d_nd_genie_nonswap_fhc_nova_v08_full_v1_nue2017
FD nominal¶
prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_tau_fhc_nova_v08_full_v1_nue2017
(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_v1_nue2017
ND systematics¶
prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).
prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_nd_genie_nonswap_fhc_nova_v08_full_calib-shift-nd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-neg-offset_v1_nue2017
The concat for ND MC light-level no-shift are also shown here as a cross-check :
prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v1_nue2017
FD systematics¶
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
(same as for FD MC, superceded by the following)
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017
The concats for FD MC light-level no-shift are also shown here as a cross-check :
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017
prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017
FD Cosmic Data¶
prod_sumdecaf_R17-03-01-prod3reco.h_fd_cosmic_full_v1_goodruns_nue2017
FD Data¶
The unblinded definitions are here :
prod_restricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017
// 200 files
Above concats have mangled events, use the below for unblinded :
prod_sumrestricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017
// 200 files
Blinded :
prod_decaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017
// 200 files
Central weights¶
All plots should be using these weights, which adjust the flux and cross-sections to our central tunes:
kPPFXFluxCVWgt * kXSecCVWgt2017
Selections¶
As selection cuts are finalized they're added to NueCuts2017.h
To select the "core" sample use: kNue2017FD
.
To select the "peripheral" sample use: kNue2017FDPeripheral
.
The best default for other cuts for now is probably whatever was used in the second analysis
Exposures¶
Until the final processing of the data files, and all the accounting and crosschecks, are done, we will use round-number estimates of the beam exposure: 9e20 POT, and livetime within the beam spill (for scaling cosmic backgrounds) of 440s. These values are also available in CAFAna/Analysis/Exposures.h
The POT and livetime numbers for FD data now live in CAFAna/Analysis/Exposures.h
Creating predictions¶
Ana2017 prediction framework¶
With the 2017 analysis, we met two complications in creating our far detector predictions. In short, we need a way to extrapolate background events in the peripheral sample without a good ND handle on these events and a way to add the FD rock estimate with the fiducial prediction. For every prediction we make, we must first prepare three constituent pieces. We need a PredictionNoExtrap
that gives the simulation's fiducial prediction at the far detector for both the core and peripheral samples, a PredictionExtrap
that sets up ND decompositions and an extrapolation just for the FD core fiducial sample, and a PredictionNoExtrap
that gives the simulation's rock estimate. Assuming you have pointers to all three, you need to do:
PredictionExtendToPeripheral *predFid = new PredictionExtendToPeripheral(PredictionExtrap *predCore, PredictionNoExtrap *predNoExtrap); PredictionAddRock *pred = new PredictionAddRock(IPrediction *predFid,PredictionNoExtrap *predRock, 1./10.87, 1./13.13);
Here, predCore
gives your extrapolated prediction to the core sample, predNoExtrap
gives the MC prediction of all samples, and predRock
gives the rock prediction. The 10.87 and 13.13 are rock spill duty factors. See DocDB 23108 if you want to learn more. The final pred
is the prediction we actually want to use in the analysis.
Creating systematically shifted predictions¶
This section was written by a convener who hasn't tried actually running any of the jobs. To be fleshed out.
$ for k in `seq 0 4`; do cafe -bq nue/Ana2017/make_nue_filesyst_pred.C $k; done $ cafe -bq nue/Ana2017/make_nue_xsec_pred.C $ hadd_cafana hadded.root fout_make_nue_*_pred.root pred_xsec_fhc_*.root
These files are read in by PredictionSystNue2017
Creating cosmic background predictions¶
For cosmic bkg prediction run CAFAna/nue/Ana2017/get_cosmic_spectra.C
. It will produce a file with spectra, for reading the spectra from the *.root file follow the little instruction in the end of get_cosmic_spectra.C
file.
Creating concats¶
The reduce script used for making the above listed datasets from the parent CAFs is CAFAna/nue/reduce_bendecomp.C
. It can be used for making both the ND and FD concats. The following nue selection cuts are used :
- kNueFD2017DecafCut (= kNue2017BasicPart && kCVNe > 0.5) for FD
- kNueND2017DecafCut (= kNueDQ2017CVN && kNue2017NDFiducial && kNue2017NDContain && kNue2017NDFrontPlanes) for ND
Both these cuts live in CAFAna/Cuts/NueCuts2017.h
In addition, to constrain the beam nue backgrounds using BEN, we look at high-statistics samples of contained and uncontained numuCC events.
Therefore, additional cuts (in CAFAna/Cuts/BeamNueCuts.h
) are applied to fit them into the ND concats. They are :
- kNumuContainNDDecafCut (= kNumuBasicQuality && (kNumuContainND2017 || kNumuContainND) && (kNumuPID2017 || kNumuNCRej))
- kNumuUncontainNDDecafCut (= kNumuBasicQuality && kBENKaNumuFiducial && (!kNumuContainND2017 || !kNumuContainND) && (kNumuPID2017 || kNumuNCRej))
To prevent the concat size blowing up by adding in so many numuCC events, a special reduction method called ReduceForBENDecaf
(in CAFAna/Decomp/BENDecomp.cxx
) is used in the macro. This essentially keeps only the necessary branches required for BEN for the numuCC sample. The nue sample is otherwise untouched by this method. This keeps the concats at a manageable size and allows us to calculate the BEN scale factors on-the-fly for both nominal and systematically shifted datasets (in contrast to the Second Analysis).
The interface to the reduction script is basically through submit_concat_project.sh
which lives in the NovaGridUtils
package. A couple of extra concat scripts have been committed to NovaGridUtils
to make the task simpler. The procedure is :
- Create a comma-separated txt file with the different CAF definitions you want to concat and the number of output concat files you want to create for each of them. An example is given in
NovaGridUtils/bin/extra_concat_scripts/datasets.txt
- Run
NovaGridUtils/bin/extra_concat_scripts/submit_multiple_concats.sh
to submit a bunch of concat projects at once. The "nue2017" parameter runsreduce_bendecomp.C
on the gridsubmit_multiple_concats.sh <output_dir for concat jobs> <release> "nue2017" <comma-separated txt file>
- Run
NovaGridUtils/bin/extra_concat_scripts/get_metadata.sh
to check for metadata differences between output concats and parent CAFs. Check with #production if there's anything weird in them. (IMPORTANT!!)get_metadata.sh <output dir for metadata json files> <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
- If everything is okay, then use
NovaGridUtils/bin/extra_concat_scripts/cp_dropbox.sh
to copy over your concat files to the FTS dropbox. You'll need novapro permissions for this step. Either request on #production or get someone who has them to copy them over for you.cp_dropbox.sh <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
- Finally, once they are copied over and declared (might take a while), run
NovaGridUtils/bin/extra_concat_scripts/make_definitions.sh
to well..make the definitions (like the ones given above)make_definitions.sh "nue2017" <comma-separated txt file>
make_definitions.sh
checks the comma-separated txt file for the expected number of concat files and aborts if it doesn't find the required number. That could mean either that the files haven't been declared yet from Step 3 or more SAM lookup-parameters need to be added to nail down the concat files.