Project

General

Profile

Reproducing the nue 2017 Analysis results » History » Version 24

Erika Catano Mur, 11/01/2017 11:05 AM

1 24 Erika Catano Mur
{{>toc}}
2 24 Erika Catano Mur
3 1 Christopher Backhouse
h1. Reproducing the nue 2017 Analysis results
4 1 Christopher Backhouse
5 24 Erika Catano Mur
%{color:orchid} TODO everywhere: what you need, how long does it take to run%
6 24 Erika Catano Mur
%{color:orchid} TODO everywhere: better links to repo%
7 24 Erika Catano Mur
8 1 Christopher Backhouse
h2. Datasets
9 1 Christopher Backhouse
10 1 Christopher Backhouse
Of course the details of all datasets are always available on "the official datasets page":http://nusoft.fnal.gov/nova/production/production3/index.html, but these are the key concat datasets you're most likely to start with:
11 24 Erika Catano Mur
(NB: The Decaf Cuts live in CAFAna/Cuts/NueCuts2017.h for both ND and FD, See also: [[Reproducing the nue 2017 Analysis results#Creating concats|Creating concats]] below)
12 1 Christopher Backhouse
13 24 Erika Catano Mur
%{color:orchid} TODO Add notes about prod3loaders; light level nominal%
14 24 Erika Catano Mur
15 24 Erika Catano Mur
%{color:orchid} TODO Move this + concats to thir own page%
16 24 Erika Catano Mur
17 2 Christopher Backhouse
h3. ND data
18 2 Christopher Backhouse
19 1 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.d_nd_numi_fhc_full_v1_goodruns_nue2017@
20 2 Christopher Backhouse
21 2 Christopher Backhouse
h3. ND nominal
22 2 Christopher Backhouse
23 2 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.d_nd_genie_nonswap_fhc_nova_v08_full_v1_nue2017@
24 2 Christopher Backhouse
25 2 Christopher Backhouse
h3. FD nominal
26 2 Christopher Backhouse
27 7 Christopher Backhouse
* -@prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017@-
28 7 Christopher Backhouse
* -@prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017@-
29 7 Christopher Backhouse
* -@prod_sumdecaf_R17-03-01-prod3reco.g_fd_genie_tau_fhc_nova_v08_full_v1_nue2017@-
30 7 Christopher Backhouse
31 7 Christopher Backhouse
(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).
32 7 Christopher Backhouse
33 7 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_v1_nue2017@
34 7 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_v1_nue2017@
35 2 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_v1_nue2017@
36 2 Christopher Backhouse
37 2 Christopher Backhouse
h3. ND systematics
38 13 Nitish Nayak
39 1 Christopher Backhouse
* -@prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
40 13 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
41 13 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-
42 1 Christopher Backhouse
43 13 Nitish Nayak
(these were with the bad calibrations (uncalibrated hits in low gains) and cosmic-overlay-driven run-matching issue (missing 13 and 14 DB in period 1). Superceded by the below).
44 13 Nitish Nayak
45 13 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@
46 13 Nitish Nayak
47 13 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@
48 13 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@
49 13 Nitish Nayak
50 4 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.j_nd_genie_nonswap_fhc_nova_v08_full_calib-shift-nd-func_v1_nue2017@
51 1 Christopher Backhouse
52 1 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-pos-offset_v1_nue2017@
53 1 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.h_nd_genie_nonswap_fhc_nova_v08_periods1235_calib-shift-nd-xyview-neg-offset_v1_nue2017@
54 1 Christopher Backhouse
55 13 Nitish Nayak
The concat for ND MC light-level no-shift are also shown here as a cross-check :
56 13 Nitish Nayak
57 13 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_nd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v1_nue2017@
58 13 Nitish Nayak
59 13 Nitish Nayak
60 2 Christopher Backhouse
h3. FD systematics
61 1 Christopher Backhouse
62 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
63 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
64 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v1_nue2017@-
65 2 Christopher Backhouse
66 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
67 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
68 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v1_nue2017@-
69 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-
70 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-
71 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v1_nue2017@-
72 1 Christopher Backhouse
73 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@-
74 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@-
75 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@-
76 1 Christopher Backhouse
77 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@-
78 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@-
79 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@-
80 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@-
81 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@-
82 10 Nitish Nayak
* -@prod_sumdecaf_R17-03-01-prod3reco.j_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@-
83 1 Christopher Backhouse
84 10 Nitish Nayak
(same as for FD MC, superceded by the following)
85 10 Nitish Nayak
86 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017@
87 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017@
88 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017@
89 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@
90 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@
91 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@
92 10 Nitish Nayak
93 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017@
94 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017@
95 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017@
96 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@
97 1 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@
98 1 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@
99 1 Christopher Backhouse
100 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_ckv-proton-shift-down_v2_nue2017@
101 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightup-calibdown_v2_nue2017@
102 12 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-lightdown-calibup_v2_nue2017@
103 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-func_v1_nue2017@
104 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-pos-offset_v1_nue2017@
105 10 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_calib-shift-fd-xyview-neg-offset_v1_nue2017@
106 12 Nitish Nayak
107 12 Nitish Nayak
The concats for FD MC light-level no-shift are also shown here as a cross-check :
108 12 Nitish Nayak
109 19 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_nonswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017@                                                                                                    
110 19 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_fluxswap_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017@                                                                                                   
111 20 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.l_fd_genie_tau_fhc_nova_v08_full_lightmodel-noshift_v2_nue2017@
112 1 Christopher Backhouse
113 23 Nitish Nayak
h3. FD Rock+Cosmic Singles
114 23 Nitish Nayak
115 23 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.m_fd_rock+cosmic-overlay_genie_nonswap_fhc_nova_v08_full_v2_nue2017@
116 23 Nitish Nayak
* @prod_sumdecaf_R17-03-01-prod3reco.m_fd_rock+cosmic-overlay_genie_fluxswap_fhc_nova_v08_full_v2_nue2017@
117 23 Nitish Nayak
118 1 Christopher Backhouse
h3. FD Cosmic Data
119 1 Christopher Backhouse
120 1 Christopher Backhouse
* @prod_sumdecaf_R17-03-01-prod3reco.h_fd_cosmic_full_v1_goodruns_nue2017@
121 13 Nitish Nayak
122 13 Nitish Nayak
h3. FD Data
123 13 Nitish Nayak
124 13 Nitish Nayak
The unblinded definitions are here : 
125 13 Nitish Nayak
126 21 Nitish Nayak
* -@prod_restricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017@ // 200 files-
127 22 Nitish Nayak
128 21 Nitish Nayak
Above concats have mangled events, use the below for unblinded :
129 22 Nitish Nayak
130 21 Nitish Nayak
* @prod_sumrestricteddecaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017@ // 200 files
131 13 Nitish Nayak
132 13 Nitish Nayak
Blinded :
133 13 Nitish Nayak
134 1 Christopher Backhouse
* @prod_decaf_R17-03-01-prod3reco.k_fd_numi_fhc_full_v1_goodruns_nue2017@ // 200 files
135 1 Christopher Backhouse
136 24 Erika Catano Mur
137 24 Erika Catano Mur
---
138 24 Erika Catano Mur
139 1 Christopher Backhouse
h2. Central weights
140 1 Christopher Backhouse
141 1 Christopher Backhouse
All plots should be using these weights, which adjust the flux and cross-sections to our central tunes:
142 1 Christopher Backhouse
143 1 Christopher Backhouse
<pre>kPPFXFluxCVWgt * kXSecCVWgt2017</pre>
144 1 Christopher Backhouse
145 24 Erika Catano Mur
---
146 24 Erika Catano Mur
147 1 Christopher Backhouse
h2. Selections
148 1 Christopher Backhouse
149 1 Christopher Backhouse
As selection cuts are finalized they're added to "NueCuts2017.h":https://cdcvs.fnal.gov/redmine/projects/novaart/repository/entry/trunk/CAFAna/Cuts/NueCuts2017.h
150 1 Christopher Backhouse
To select the "core" sample use: @kNue2017FD@.
151 1 Christopher Backhouse
To select the "peripheral" sample use: @kNue2017FDPeripheral@.
152 9 Alexander Himmel
153 1 Christopher Backhouse
The best default for other cuts for now is probably whatever was used "in the second analysis":https://cdcvs.fnal.gov/redmine/projects/novaart/repository/entry/trunk/CAFAna/Cuts/NueCutsSecondAna.h
154 1 Christopher Backhouse
155 24 Erika Catano Mur
h3. Sideband cuts
156 24 Erika Catano Mur
157 24 Erika Catano Mur
%{color:orchid} TODO%
158 24 Erika Catano Mur
---
159 24 Erika Catano Mur
160 1 Christopher Backhouse
h2. Exposures
161 1 Christopher Backhouse
162 24 Erika Catano Mur
163 24 Erika Catano Mur
%{color:orchid} TODO this isn't true anymore%
164 24 Erika Catano Mur
165 5 Christopher Backhouse
Until the final processing of the data files, and all the accounting and crosschecks, are done, we will use round-number estimates of the beam exposure: 9e20 POT, and livetime within the beam spill (for scaling cosmic backgrounds) of 440s. These values are also available in CAFAna/Analysis/Exposures.h
166 10 Nitish Nayak
167 1 Christopher Backhouse
The POT and livetime numbers for FD data now live in CAFAna/Analysis/Exposures.h
168 1 Christopher Backhouse
169 24 Erika Catano Mur
---
170 24 Erika Catano Mur
171 1 Christopher Backhouse
h2. Creating predictions
172 11 Christopher Backhouse
173 24 Erika Catano Mur
174 16 Daniel Pershey
h3. Ana2017 prediction framework
175 16 Daniel Pershey
176 16 Daniel Pershey
With the 2017 analysis, we met two complications in creating our far detector predictions.  In short, we need a way to extrapolate background events in the peripheral sample without a good ND handle on these events and a way to add the FD rock estimate with the fiducial prediction.  For every prediction we make, we must first prepare three constituent pieces.  We need a @PredictionNoExtrap@ that gives the simulation's fiducial prediction at the far detector for both the core and peripheral samples, a @PredictionExtrap@ that sets up ND decompositions and an extrapolation just for the FD core fiducial sample, and a @PredictionNoExtrap@ that gives the simulation's rock estimate.  Assuming you have pointers to all three, you need to do:
177 16 Daniel Pershey
178 16 Daniel Pershey
<pre>
179 16 Daniel Pershey
PredictionExtendToPeripheral *predFid = new PredictionExtendToPeripheral(PredictionExtrap *predCore, PredictionNoExtrap *predNoExtrap);
180 16 Daniel Pershey
PredictionAddRock *pred = new PredictionAddRock(IPrediction *predFid,PredictionNoExtrap *predRock, 1./10.87, 1./13.13);
181 16 Daniel Pershey
</pre>
182 16 Daniel Pershey
183 16 Daniel Pershey
Here, @predCore@ gives your extrapolated prediction to the core sample, @predNoExtrap@ gives the MC prediction of all samples, and @predRock@ gives the rock prediction.  The 10.87 and 13.13 are rock spill duty factors.  See DocDB 23108 if you want to learn more.  The final @pred@ is the prediction we actually want to use in the analysis.
184 16 Daniel Pershey
185 1 Christopher Backhouse
h3. Creating systematically shifted predictions
186 1 Christopher Backhouse
187 24 Erika Catano Mur
%{color:orchid} TODO short description and link to shared nue numu wiki. Remove macros from repository that were not used%
188 24 Erika Catano Mur
189 11 Christopher Backhouse
This section was written by a convener who hasn't tried actually running any of the jobs. To be fleshed out.
190 11 Christopher Backhouse
191 11 Christopher Backhouse
<pre>
192 11 Christopher Backhouse
$ for k in `seq 0 4`; do cafe -bq nue/Ana2017/make_nue_filesyst_pred.C $k; done
193 11 Christopher Backhouse
$ cafe -bq nue/Ana2017/make_nue_xsec_pred.C
194 11 Christopher Backhouse
$ hadd_cafana hadded.root fout_make_nue_*_pred.root pred_xsec_fhc_*.root
195 11 Christopher Backhouse
</pre>
196 11 Christopher Backhouse
197 1 Christopher Backhouse
These files are read in by @PredictionSystNue2017@
198 1 Christopher Backhouse
199 24 Erika Catano Mur
%{color:orchid} TODO extrapdolation systematics might require a special place%
200 24 Erika Catano Mur
%{color:orchid} TODO link to PPFX principal components wiki if it exists%
201 24 Erika Catano Mur
202 1 Christopher Backhouse
h3. Creating cosmic background predictions
203 1 Christopher Backhouse
204 24 Erika Catano Mur
%{color:orchid} TODO add note about sideband weight. What's in the file%
205 24 Erika Catano Mur
206 1 Christopher Backhouse
For cosmic bkg prediction run @CAFAna/nue/Ana2017/get_cosmic_spectra.C@. It will produce a file with spectra, for reading the spectra from the *.root file follow the little instruction in the end of  @get_cosmic_spectra.C@ file.
207 1 Christopher Backhouse
208 24 Erika Catano Mur
%{color:orchid} TODO rock prediction%
209 24 Erika Catano Mur
210 24 Erika Catano Mur
%{color:orchid} TODO data spectrum%
211 24 Erika Catano Mur
212 24 Erika Catano Mur
%{color:orchid} TODO add note on binning%
213 24 Erika Catano Mur
214 24 Erika Catano Mur
---
215 24 Erika Catano Mur
216 17 Nitish Nayak
h2. Creating concats
217 17 Nitish Nayak
218 17 Nitish Nayak
The reduce script used for making the above listed datasets from the parent CAFs is @CAFAna/nue/reduce_bendecomp.C@. It can be used for making both the ND and FD concats. The following nue selection cuts are used :
219 17 Nitish Nayak
220 17 Nitish Nayak
* kNueFD2017DecafCut (= kNue2017BasicPart && kCVNe > 0.5) for FD
221 17 Nitish Nayak
* kNueND2017DecafCut (=  kNueDQ2017CVN &&  kNue2017NDFiducial && kNue2017NDContain && kNue2017NDFrontPlanes) for ND
222 17 Nitish Nayak
223 17 Nitish Nayak
Both these cuts live in @CAFAna/Cuts/NueCuts2017.h@
224 17 Nitish Nayak
225 17 Nitish Nayak
In addition, to constrain the beam nue backgrounds using BEN, we look at high-statistics samples of contained and uncontained numuCC events. 
226 17 Nitish Nayak
Therefore, additional cuts (in @CAFAna/Cuts/BeamNueCuts.h@) are applied to fit them into the ND concats. They are :
227 17 Nitish Nayak
228 17 Nitish Nayak
* kNumuContainNDDecafCut (= kNumuBasicQuality && (kNumuContainND2017 || kNumuContainND) && (kNumuPID2017 || kNumuNCRej))
229 17 Nitish Nayak
* kNumuUncontainNDDecafCut (= kNumuBasicQuality && kBENKaNumuFiducial && (!kNumuContainND2017 || !kNumuContainND) && (kNumuPID2017 || kNumuNCRej))
230 17 Nitish Nayak
231 17 Nitish Nayak
To prevent the concat size blowing up by adding in so many numuCC events, a special reduction method called @ReduceForBENDecaf@ (in @CAFAna/Decomp/BENDecomp.cxx@) is used in the macro. This essentially keeps only the necessary branches required for BEN for the numuCC sample. The nue sample is otherwise untouched by this method. This keeps the concats at a manageable size and allows us to calculate the BEN scale factors on-the-fly for both nominal and systematically shifted datasets (in contrast to the Second Analysis).
232 17 Nitish Nayak
233 17 Nitish Nayak
The interface to the reduction script is basically through @submit_concat_project.sh@ which lives in the @NovaGridUtils@ package. A couple of extra concat scripts have been committed to @NovaGridUtils@ to make the task simpler. The procedure is :
234 17 Nitish Nayak
235 17 Nitish Nayak
* Create a comma-separated txt file with the different CAF definitions you want to concat and the number of output concat files you want to create for each of them. An example is given in @NovaGridUtils/bin/extra_concat_scripts/datasets.txt@
236 17 Nitish Nayak
* Run @NovaGridUtils/bin/extra_concat_scripts/submit_multiple_concats.sh@ to submit a bunch of concat projects at once. The "nue2017" parameter runs @reduce_bendecomp.C@ on the grid
237 17 Nitish Nayak
<pre>
238 17 Nitish Nayak
submit_multiple_concats.sh <output_dir for concat jobs> <release> "nue2017" <comma-separated txt file>
239 17 Nitish Nayak
</pre>
240 17 Nitish Nayak
* Run @NovaGridUtils/bin/extra_concat_scripts/get_metadata.sh@ to check for metadata differences between output concats and parent CAFs. Check with #production if there's anything weird in them. (IMPORTANT!!)
241 17 Nitish Nayak
<pre>
242 17 Nitish Nayak
get_metadata.sh <output dir for metadata json files> <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
243 17 Nitish Nayak
</pre>
244 17 Nitish Nayak
* If everything is okay, then use @NovaGridUtils/bin/extra_concat_scripts/cp_dropbox.sh@ to copy over your concat files to the FTS dropbox. You'll need novapro permissions for this step. Either request on #production or get someone who has them to copy them over for you. 
245 17 Nitish Nayak
<pre>
246 17 Nitish Nayak
cp_dropbox.sh <output_dir for concat jobs from previous step> "nue2017" <comma-separated txt file>
247 17 Nitish Nayak
</pre>
248 17 Nitish Nayak
* Finally, once they are copied over and declared (might take a while), run @NovaGridUtils/bin/extra_concat_scripts/make_definitions.sh@ to well..make the definitions (like the ones given above)
249 17 Nitish Nayak
<pre>
250 17 Nitish Nayak
make_definitions.sh "nue2017" <comma-separated txt file>
251 17 Nitish Nayak
</pre>
252 1 Christopher Backhouse
253 1 Christopher Backhouse
@make_definitions.sh@ checks the comma-separated txt file for the expected number of concat files and aborts if it doesn't find the required number. That could mean either that the files haven't been declared yet from Step 3 or more SAM lookup-parameters need to be added to nail down the concat files. 
254 24 Erika Catano Mur
255 24 Erika Catano Mur
256 24 Erika Catano Mur
---
257 24 Erika Catano Mur
258 24 Erika Catano Mur
h2. Reproducing ND Data/MC comparisons
259 24 Erika Catano Mur
260 24 Erika Catano Mur
---
261 24 Erika Catano Mur
262 24 Erika Catano Mur
h2. Reproducing FD Data/MC comparisons 
263 24 Erika Catano Mur
264 24 Erika Catano Mur
265 24 Erika Catano Mur
h3. Sidebands
266 24 Erika Catano Mur
267 24 Erika Catano Mur
268 24 Erika Catano Mur
---
269 24 Erika Catano Mur
270 24 Erika Catano Mur
h2.  Sensitivities and fit results
271 24 Erika Catano Mur
272 24 Erika Catano Mur
---
273 24 Erika Catano Mur
274 24 Erika Catano Mur
h2. Feldman-Cousins corrections
275 24 Erika Catano Mur
276 24 Erika Catano Mur
---
277 24 Erika Catano Mur
278 24 Erika Catano Mur
h2. Other blessed plots
279 24 Erika Catano Mur
280 24 Erika Catano Mur
---