Reproducing the nue 2017 Analysis results » History » Version 28

Version 27 (Erika Catano Mur, 02/09/2018 10:06 AM) → Version 28/34 (Erika Catano Mur, 02/09/2018 10:12 AM)


h1. Reproducing the nue 2017 Analysis results

%{color:orchid} TODO everywhere: what you need, how long does it take to run%
%{color:orchid} TODO everywhere: better links to repo%

h2. Set up the appropriate release

The 2017 analysis branch is "R17-11-22-2017ana-br": The most recent tagged release is "R17-11-22-2017ana.a":

Setup the release and check out @CAFAna@
setup_nova -b maxopt -r R17-11-22-2017ana.a
newrel -t R17-11-22-2017ana.a rel_2017ana
cd rel_2017ana/
srt_setup -a
addpkg_svn -b R17-11-22-2017ana-br CAFAna

Learn more about "releases and release branches":


h2. Datasets

Of course the details of all datasets are always available on "the official datasets page":, but these are the key concat datasets you're most likely to start with:
(NB: The Decaf Cuts live in CAFAna/Cuts/NueCuts2017.h for both ND and FD, See also: [[Reproducing the nue 2017 Analysis results#Creating concats|Creating concats]] below)

%{color:orchid} TODO Add notes about prod3loaders; light level nominal%

%{color:orchid} TODO Move this + concats to thir own page%

h3. ND data

* @prod_sumdecaf_R17-03-01-prod3reco.d_nd_numi_fhc_full_v1_goodruns_nue2017@

h3. ND nominal

* @prod_sumdecaf_R17-03-01-prod3reco.d_nd_genie_nonswap_fhc_nova_v08_full_v1_nue2017@

h3. FD nominal

* -@prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_tau_fhc_nova_v08_full_v1_nue2017@-

(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).

* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_v1_nue2017@

h3. ND systematics

* -@prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-

(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).

* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@

* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@

* @prod_sumdecaf_R17-03-01-prod3reco.j_nd_genie_nonswap_fhc_nova_v08_full_calib-shift-nd-func_v1_nue2017@

* @prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-pos-offset_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-neg-offset_v1_nue2017@

The concat for ND MC light-level no-shift are also shown here as a cross-check :

* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v1_nue2017@

h3. FD systematics

* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-

* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-

* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@-

* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@-
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@-

(same as for FD MC, superceded by the following)

* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@

* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@

* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@

The concats for FD MC light-level no-shift are also shown here as a cross-check :

* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017@

h3. FD Rock+Cosmic Singles

* @prod_sumdecaf_R17-03-01-prod3reco.m_fd_rock+cosmic-overlay_genie_nonswap_fhc_nova_v08_full_v2_nue2017@
* @prod_sumdecaf_R17-03-01-prod3reco.m_fd_rock+cosmic-overlay_genie_fluxswap_fhc_nova_v08_full_v2_nue2017@

h3. FD Cosmic Data

* @prod_sumdecaf_R17-03-01-prod3reco.h_fd_cosmic_full_v1_goodruns_nue2017@

h3. FD Data

The unblinded definitions are here :

* -@prod_restricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017@ // 200 files-

Above concats have mangled events, use the below for unblinded :

* @prod_sumrestricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017@ // 200 files

Blinded :

* @prod_decaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017@ // 200 files


h2. Central weights

All plots should be using these weights, which adjust the flux and cross-sections to our central tunes:

<pre>kPPFXFluxCVWgt * kXSecCVWgt2017</pre>


h2. Selections

As selection cuts are finalized they're added to "NueCuts2017.h":
To select the "core" sample use: @kNue2017FD@.
To select the "peripheral" sample use: @kNue2017FDPeripheral@.

The best default for other cuts for now is probably whatever was used "in the second analysis":

h3. Sideband cuts

%{color:orchid} TODO%

h2. Exposures

%{color:orchid} TODO this isn't true anymore%

Until the final processing of the data files, and all the accounting and crosschecks, are done, we will use round-number estimates of the beam exposure: 9e20 POT, and livetime within the beam spill (for scaling cosmic backgrounds) of 440s. These values are also available in CAFAna/Analysis/Exposures.h

The POT and livetime numbers for FD data now live in CAFAna/Analysis/Exposures.h


h2. Creating predictions

h3. Ana2017 prediction framework

With the 2017 analysis, we met two complications in creating our far detector predictions. In short, we need a way to extrapolate background events in the peripheral sample without a good ND handle on these events and a way to add the FD rock estimate with the fiducial prediction. For every prediction we make, we must first prepare three constituent pieces. We need a @PredictionNoExtrap@ that gives the simulation's fiducial prediction at the far detector for both the core and peripheral samples, a @PredictionExtrap@ that sets up ND decompositions and an extrapolation just for the FD core fiducial sample, and a @PredictionNoExtrap@ that gives the simulation's rock estimate. Assuming you have pointers to all three, you need to do:

PredictionExtendToPeripheral *predFid = new PredictionExtendToPeripheral(PredictionExtrap *predCore, PredictionNoExtrap *predNoExtrap);
PredictionAddRock *pred = new PredictionAddRock(IPrediction *predFid,PredictionNoExtrap *predRock, 1./10.87, 1./13.13);

Here, @predCore@ gives your extrapolated prediction to the core sample, @predNoExtrap@ gives the MC prediction of all samples, and @predRock@ gives the rock prediction. The 10.87 and 13.13 are rock spill duty factors. See DocDB 23108 if you want to learn more. The final @pred@ is the prediction we actually want to use in the analysis.

h3. Creating systematically shifted predictions

%{color:orchid} TODO short description and link to shared nue numu wiki. Remove macros from repository that were not used%

This section was written by a convener who hasn't tried actually running any of the jobs. To be fleshed out.

$ for k in `seq 0 4`; do cafe -bq nue/Ana2017/make_nue_filesyst_pred.C $k; done
$ cafe -bq nue/Ana2017/make_nue_xsec_pred.C
$ hadd_cafana hadded.root fout_make_nue_*_pred.root pred_xsec_fhc_*.root

These files are read in by @PredictionSystNue2017@

[[Systematic predictions for the nue and numu 2017 analyses]]

%{color:orchid} TODO extrapdolation systematics might require a special place%
%{color:orchid} TODO link to PPFX principal components wiki if it exists%

h3. Creating cosmic background predictions

%{color:orchid} TODO add note about sideband weight. What's in the file%

For cosmic bkg prediction run @CAFAna/nue/Ana2017/get_cosmic_spectra.C@. It will produce a file with spectra, for reading the spectra from the *.root file follow the little instruction in the end of @get_cosmic_spectra.C@ file.

%{color:orchid} TODO rock prediction%

%{color:orchid} TODO data spectrum%

%{color:orchid} TODO add note on binning%


h2. Creating concats

The reduce script used for making the above listed datasets from the parent CAFs is @CAFAna/nue/reduce_bendecomp.C@. It can be used for making both the ND and FD concats. The following nue selection cuts are used :

* kNueFD2017DecafCut (= kNue2017BasicPart && kCVNe > 0.5) for FD
* kNueND2017DecafCut (= kNueDQ2017CVN && kNue2017NDFiducial && kNue2017NDContain && kNue2017NDFrontPlanes) for ND

Both these cuts live in @CAFAna/Cuts/NueCuts2017.h@

In addition, to constrain the beam nue backgrounds using BEN, we look at high-statistics samples of contained and uncontained numuCC events.
Therefore, additional cuts (in @CAFAna/Cuts/BeamNueCuts.h@) are applied to fit them into the ND concats. They are :

* kNumuContainNDDecafCut (= kNumuBasicQuality && (kNumuContainND2017 || kNumuContainND) && (kNumuPID2017 || kNumuNCRej))
* kNumuUncontainNDDecafCut (= kNumuBasicQuality && kBENKaNumuFiducial && (!kNumuContainND2017 || !kNumuContainND) && (kNumuPID2017 || kNumuNCRej))

To prevent the concat size blowing up by adding in so many numuCC events, a special reduction method called @ReduceForBENDecaf@ (in @CAFAna/Decomp/BENDecomp.cxx@) is used in the macro. This essentially keeps only the necessary branches required for BEN for the numuCC sample. The nue sample is otherwise untouched by this method. This keeps the concats at a manageable size and allows us to calculate the BEN scale factors on-the-fly for both nominal and systematically shifted datasets (in contrast to the Second Analysis).

The interface to the reduction script is basically through which lives in the @NovaGridUtils@ package. A couple of extra concat scripts have been committed to @NovaGridUtils@ to make the task simpler. The procedure is :

* Create a comma-separated txt file with the different CAF definitions you want to concat and the number of output concat files you want to create for each of them. An example is given in @NovaGridUtils/bin/extra_concat_scripts/datasets.txt@
* Run @NovaGridUtils/bin/extra_concat_scripts/ to submit a bunch of concat projects at once. The "nue2017" parameter runs @reduce_bendecomp.C@ on the grid
<pre> <output_dir for concat jobs> <release> "nue2017" <comma-separated txt file>
* Run @NovaGridUtils/bin/extra_concat_scripts/ to check for metadata differences between output concats and parent CAFs. Check with #production if there's anything weird in them. (IMPORTANT!!)
<pre> <output dir for metadata json files> <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
* If everything is okay, then use @NovaGridUtils/bin/extra_concat_scripts/ to copy over your concat files to the FTS dropbox. You'll need novapro permissions for this step. Either request on #production or get someone who has them to copy them over for you.
<pre> <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
* Finally, once they are copied over and declared (might take a while), run @NovaGridUtils/bin/extra_concat_scripts/ to well..make the definitions (like the ones given above)
<pre> "nue2017" <comma-separated txt file>
</pre> checks the comma-separated txt file for the expected number of concat files and aborts if it doesn't find the required number. That could mean either that the files haven't been declared yet from Step 3 or more SAM lookup-parameters need to be added to nail down the concat files.


h2. Reproducing ND Data/MC comparisons


h2. Reproducing FD Data/MC comparisons

h3. Sidebands


h2. Sensitivities and fit results


h2. Feldman-Cousins corrections


h2. Other blessed plots