Project

General

Profile

Official Datasets » History » Version 56

Satish Desai, 11/13/2014 05:54 PM

1 11 Dominick Rocco
h1. Official Datasets
2 11 Dominick Rocco
3 44 Dominick Rocco
4 1 Gavin Davies
The vast majority of NOvA's data and MC reside within a data handling system called Sequential Access Metadata (SAM).  The files are stored on a tape-backed disk array called dCache.  Locations for the files are tracked using a database with a web interface, accessible through the @samweb@ command line client utility.  The [[NOvA-SAM:SAM_web_cookbook]] provides an introduction to using the system.  
5 45 Dominick Rocco
6 45 Dominick Rocco
As a throwback to the old days, some of the data is still stored on bluearc.  CAFs are a notable group of files of which the most recent are almost always stored on bluearc.  There are also small, selected samples of ART files available on bluearc in <some location, documented where?>
7 45 Dominick Rocco
8 45 Dominick Rocco
{{toc}}
9 1 Gavin Davies
10 12 Gavin Davies
h1. Monte Carlo
11 1 Gavin Davies
12 54 Gavin Davies
h1. Latest datasets for detector-like conditions MC
13 54 Gavin Davies
14 54 Gavin Davies
| *FarDet* | *FHC swap*                                 | *FHC nonswap*                             | *RHC swap* | *RHC nonswap* | *FHC tau*                             | *Cosmics*                       |
15 54 Gavin Davies
| *artdaq* | prod_daq_FA14-10-03_fd_genie_fhc_fluxswap  | prod_daq_FA14-10-03_fd_genie_fhc_nonswap  |            |               | prod_daq_FA14-10-03_fd_genie_fhc_tau  | prod_daq_FA14-10-03_fd_cry_all  |
16 56 Satish Desai
| *reco*   | prod_reco_FA14-10-28_fd_genie_fhc_fluxswap | prod_reco_FA14-10-28_fd_genie_fhc_nonswap |            |               | prod_reco_FA14-10-28_fd_genie_fhc_tau | prod_reco_FA14-10-28_fd_cry_all |
17 54 Gavin Davies
| *pid*    | prod_pid_FA14-10-28_fd_genie_fhc_fluxswap  | prod_pid_FA14-10-28_fd_genie_fhc_nonswap  |            |               | prod_pid_FA14-10-28_fd_genie_fhc_tau  | prod_pid_FA14-10-28_fd_cry_all  |
18 54 Gavin Davies
| *caf*    | prod_caf_FA14-10-28_fd_genie_fhc_fluxswap  | prod_caf_FA14-10-28_fd_genie_fhc_nonswap  |            |               | prod_caf_FA14-10-28_fd_genie_fhc_tau  | prod_caf_FA14-10-28_fd_cry_all  |
19 54 Gavin Davies
20 40 Christopher Backhouse
h1. Latest datasets for regular configurations
21 40 Christopher Backhouse
22 40 Christopher Backhouse
| *FarDet* | *FHC swap*                               | *FHC nonswap*                              | *RHC swap*                              | *RHC nonswap*                              | *Cosmics*                  |
23 40 Christopher Backhouse
| *artdaq* | prod_artdaq_S14-03-25_fd_genie_fhc_swap  | prod_artdaq_S14-03-25_fd_genie_fhc_nonswap | prod_artdaq_S14-03-25_fd_genie_rhc_swap | prod_artdaq_S14-03-25_fd_genie_rhc_nonswap | prodartdaq_S14-02-05_fdcry |
24 40 Christopher Backhouse
| *reco*   | prodreco_S14-03-25_FDGENIE_fhc_swap      | prodreco_S14-03-25_FDGENIE_fhc_nonswap     | prodreco_S14-03-25_FDGENIE_rhc_swap     | prodreco_S14-03-25_FDGENIE_rhc_nonswap     | prodreco_S14-03-25_FDCRY   |
25 40 Christopher Backhouse
| *pid*    | prod_pid_S14-05-12_fd_genie_neutrino2014 |
26 40 Christopher Backhouse
| *caf*    | prod_caf_S14-07-11_fd_genie_neutrino2014 |
27 40 Christopher Backhouse
28 40 Christopher Backhouse
29 40 Christopher Backhouse
| *NearDet* | *FHC*                            | *RHC* | *Cosmics*                  |
30 40 Christopher Backhouse
| *artdaq*  | prodartdaq_S14-05-12_ndgenie_fix | -     | prodartdaq_S14-05-12_ndcry |
31 40 Christopher Backhouse
| *reco*    | prodreco_S14-08-01_ndgenie_fix   | -     | -                          |
32 40 Christopher Backhouse
| *pid*     | prodpid_S14-08-19_ndgenie_fix    | -     | -                          |
33 40 Christopher Backhouse
| *caf*     | prodcaf_S14-08-19_ndgenie_fix    | -     | -                          |
34 40 Christopher Backhouse
35 18 Gavin Davies
h1. GENIE
36 1 Gavin Davies
37 17 Gavin Davies
h2. ARTDAQ
38 17 Gavin Davies
39 4 Gavin Davies
h3. FD
40 4 Gavin Davies
41 54 Gavin Davies
Real detector-like conditions MC
42 54 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_fluxswap*
43 54 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_nonswap*
44 54 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_tau*
45 54 Gavin Davies
46 54 Gavin Davies
Nominal
47 35 Gavin Davies
FHC SWAP/NONSWAP
48 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_fhc_swap* (709)
49 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_fhc_nonswap* (709)
50 1 Gavin Davies
51 35 Gavin Davies
RHC SWAP/NONSWAP
52 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_rhc_swap* (709)
53 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_rhc_nonswap* (709)
54 35 Gavin Davies
55 4 Gavin Davies
h3. ND
56 13 Gavin Davies
57 23 Gavin Davies
Fixed version of overlay files
58 26 Gavin Davies
*prodartdaq_S14-05-12_ndgenie_fix* (4359)
59 23 Gavin Davies
60 23 Gavin Davies
-*prodartdaq_S14-05-12_ndgenie* (20087)-
61 4 Gavin Davies
62 24 Gavin Davies
h3. Special
63 24 Gavin Davies
64 36 Gavin Davies
Nominal geometry
65 36 Gavin Davies
*prod_artdaq_S14-08-19_fd_genie_fhc_nonswap* (34)
66 36 Gavin Davies
*prod_artdaq_S14-08-19_fd_genie_fhc_swap* (34)
67 36 Gavin Davies
68 24 Gavin Davies
Jittered geometry
69 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_nonswap_geojittered* (37)
70 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_swap_geojittered* (39)
71 24 Gavin Davies
72 24 Gavin Davies
CRY+GENIE
73 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_nonswap_crygenie* (510)
74 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_swap_crygenie* (511)
75 24 Gavin Davies
76 17 Gavin Davies
h2. RECO
77 8 Gavin Davies
78 1 Gavin Davies
Official production datasets containing all reconstructed files
79 1 Gavin Davies
80 1 Gavin Davies
h3. FD 
81 1 Gavin Davies
82 54 Gavin Davies
Real detector-like conditions MC
83 54 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_fluxswap*
84 54 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_nonswap*
85 54 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_tau*
86 54 Gavin Davies
87 54 Gavin Davies
Nominal
88 1 Gavin Davies
ALL FD GENIE RECO:          
89 1 Gavin Davies
*prodreco_S14-03-25_FDGENIE* (2807 files)
90 1 Gavin Davies
91 35 Gavin Davies
FHC SWAP/NONSWAP: 
92 35 Gavin Davies
*prodreco_S14-03-25_FDGENIE_fhc_swap* (703)
93 1 Gavin Davies
*prodreco_S14-03-25_FDGENIE_fhc_nonswap* (703)
94 1 Gavin Davies
95 35 Gavin Davies
RHC SWAP/NONSWAP
96 1 Gavin Davies
*prodreco_S14-03-25_FDGENIE_rhc_swap* (698)
97 35 Gavin Davies
*prodreco_S14-03-25_FDGENIE_rhc_nonswap* (703)
98 4 Gavin Davies
99 5 Gavin Davies
h3. ND
100 4 Gavin Davies
101 1 Gavin Davies
ND (FHC) GENIE (rock+detector) OVERLAY RECO
102 25 Gavin Davies
*prodreco_S14-08-01_ndgenie_fix* (4295)
103 1 Gavin Davies
104 24 Gavin Davies
-*prodreco_S14-07-03_ndgenie* (20057 and increasing)-
105 1 Gavin Davies
106 1 Gavin Davies
h3. Special
107 1 Gavin Davies
108 36 Gavin Davies
Nominal geometry
109 36 Gavin Davies
*prod_reco_S14-08-01_fd_genie_fhc_nonswap* (34)
110 36 Gavin Davies
*prod_reco_S14-08-01_fd_genie_fhc_swap* (34)
111 1 Gavin Davies
112 36 Gavin Davies
Jittered geometry
113 36 Gavin Davies
Simulated with jitter and reco+ with standard geom
114 38 Matthew Tamsett
*prod_reco_S14-08-01_fd_fhc_nonswap_geojittered_v5* (37)
115 38 Matthew Tamsett
*prod_reco_S14-08-01_fd_fhc_swap_geojittered_v5* (39)
116 36 Gavin Davies
117 36 Gavin Davies
All tiers with geojittered geometry
118 36 Gavin Davies
-*prod_reco_S14-08-01_fd_fhc_nonswap_geojittered_v1* (34)-
119 36 Gavin Davies
-*prod_reco_S14-08-01_fd_fhc_swap_geojittered_v1* (34)-
120 36 Gavin Davies
121 24 Gavin Davies
CRY+GENIE
122 30 Gavin Davies
*prod_reco_S14-08-01_fd_fhc_nonswap_crygenie* (510)
123 30 Gavin Davies
*prod_reco_S14-08-01_fd_fhc_swap_crygenie* (511)
124 16 Gavin Davies
125 53 Gavin Davies
NO MASK
126 53 Gavin Davies
These files have bad channels turned off.
127 53 Gavin Davies
*prod_reco_S14-10-15_genie_nonswap_nomask*
128 53 Gavin Davies
Note, these files have the POT counting error that propagates from the generation stage so correctly scaling POT is required, i.e. divide by 2 totalpot.
129 53 Gavin Davies
130 53 Gavin Davies
131 17 Gavin Davies
h2. PID
132 34 Gavin Davies
133 32 Satish Desai
h3. FD
134 32 Satish Desai
135 54 Gavin Davies
Real detector-like conditions MC
136 54 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_fluxswap*
137 54 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_nonswap*
138 54 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_tau*
139 54 Gavin Davies
140 54 Gavin Davies
OLD
141 16 Gavin Davies
*prod_pid_S14-05-12_fd_genie_neutrino2014*
142 16 Gavin Davies
143 1 Gavin Davies
h3. ND
144 16 Gavin Davies
145 1 Gavin Davies
ND (FHC) GENIE (rock+detector) OVERLAY reco
146 1 Gavin Davies
147 1 Gavin Davies
*prodpid_S14-08-19_ndgenie_fix* (4072)
148 1 Gavin Davies
149 30 Gavin Davies
-*prodpid_S14-08-01_ndgenie* (2715, will grow)-
150 1 Gavin Davies
151 1 Gavin Davies
h3. Special
152 1 Gavin Davies
153 36 Gavin Davies
Nominal
154 36 Gavin Davies
*prod_pid_S14-08-19_fd_genie_fhc_nonswap* (34)
155 36 Gavin Davies
*prod_pid_S14-08-19_fd_genie_fhc_swap* (34)
156 36 Gavin Davies
157 1 Gavin Davies
Jittered geometry
158 36 Gavin Davies
Simulated with jitter and reco+ with standard geom
159 36 Gavin Davies
*prod_pid_S14-08-19_fd_fhc_nonswap_geojittered_v5* (37)
160 36 Gavin Davies
*prod_pid_S14-08-19_fd_fhc_swap_geojittered_v5* (39)
161 30 Gavin Davies
162 36 Gavin Davies
All tiers with geojittered geometry
163 36 Gavin Davies
-*prod_pid_S14-08-19_fd_fhc_nonswap_geojittered_v1* (34)-
164 36 Gavin Davies
-*prod_pid_S14-08-19_fd_fhc_swap_geojittered_v1* (34)-
165 36 Gavin Davies
166 19 Gavin Davies
CRY+GENIE
167 1 Gavin Davies
*prod_pid_S14-08-19_fd_fhc_nonswap_crygenie* (486)
168 33 Satish Desai
*prod_pid_S14-08-19_fd_fhc_swap_crygenie* (492)
169 34 Gavin Davies
170 53 Gavin Davies
NO MASK
171 53 Gavin Davies
These files have bad channels turned off.
172 53 Gavin Davies
*prod_pid_S14-10-28_nd_genie_nonswap_nomask*
173 53 Gavin Davies
Note, these files have the POT counting error that propagates from the generation stage so correctly scaling POT is required, i.e. divide by 2 totalpot.
174 53 Gavin Davies
The module "nuecosrej" is empty in the PID files. It is filled at the CAF stage for this set however.
175 53 Gavin Davies
176 33 Satish Desai
h2. CAF
177 19 Gavin Davies
178 33 Satish Desai
h3. FD
179 29 Gavin Davies
180 54 Gavin Davies
Real detector-like conditions MC
181 54 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_fluxswap*
182 54 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_nonswap*
183 54 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_tau*
184 54 Gavin Davies
185 54 Gavin Davies
Bluearc: /nova/prod/mc/FA14-10-28/genie/fd/caf/000XXX/XXXYY/ 
186 54 Gavin Davies
where XXX are the first three digits of the run number and YY are the last two.
187 54 Gavin Davies
You'll need to use appropriate wildcard flags.
188 54 Gavin Davies
189 54 Gavin Davies
OLD
190 29 Gavin Davies
*prod_caf_S14-07-11_fd_genie_neutrino2014*
191 29 Gavin Davies
192 28 Gavin Davies
h3. ND
193 19 Gavin Davies
194 28 Gavin Davies
SAM: *prodcaf_S14-08-19_ndgenie_fix* (4072)
195 1 Gavin Davies
196 1 Gavin Davies
Bluearc: */nova/prod/mc/S14-08-19/genie/nd/caf* (4072)
197 1 Gavin Davies
198 1 Gavin Davies
First pass post-pid:
199 1 Gavin Davies
-*/nova/prod/mc/S14-08-15/genie/nd/caf/* (2441 files)-
200 30 Gavin Davies
(find . -name "neardet*")
201 30 Gavin Davies
CAFMaker Floating point exception for all failures.
202 1 Gavin Davies
203 1 Gavin Davies
Caveat: Two significant issues have been found in this sample in the last day or two.  An old version of PhotonTransport was used in the overlay production, making the light levels low by a factor of two, and also the rock overlay scheme re-used rock events at a much higher rate than intended.  Both of these issues are fixed and replacements for these ND MC CAFs will tentatively be ready in a week we hope. We'll keep you posted. 
204 1 Gavin Davies
The current CAFs should be useful for code development and certain physics studies in the meantime.
205 1 Gavin Davies
206 1 Gavin Davies
h3. Special
207 1 Gavin Davies
208 36 Gavin Davies
Nominal
209 37 Matthew Tamsett
*prod_caf_S14-08-19_fd_genie_fhc_nonswap* (34)
210 37 Matthew Tamsett
*prod_caf_S14-08-19_fd_genie_fhc_swap* (34)
211 36 Gavin Davies
212 1 Gavin Davies
Jittered geometry
213 36 Gavin Davies
Simulated with jitter and reco+ with standard geom
214 36 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_nonswap_geojittered_v5* (37)
215 36 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_swap_geojittered_v5* (39)
216 31 Gavin Davies
217 36 Gavin Davies
All tiers with geojittered geometry
218 36 Gavin Davies
-*prod_caf_S14-08-19_fd_fhc_nonswap_geojittered_v1* (32)-
219 36 Gavin Davies
-*prod_caf_S14-08-19_fd_fhc_swap_geojittered_v1* (33)-
220 36 Gavin Davies
221 30 Gavin Davies
CRY+GENIE
222 30 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_nonswap_crygenie* (484)
223 30 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_swap_crygenie* (490)
224 30 Gavin Davies
225 30 Gavin Davies
Bluearc:
226 19 Gavin Davies
*/nova/prod/mc/S14-08-19/genie/fd/caf/* 
227 36 Gavin Davies
(need to grab *fhc_nonswap* or *fhc_swap* plus either *crygenie* or *geojittered*v5*)
228 1 Gavin Davies
229 53 Gavin Davies
NO MASK
230 53 Gavin Davies
These files have bad channels turned off.
231 53 Gavin Davies
*/nova/ana/nu_e_ana/S14-10-28/nd_nomask/mc*
232 53 Gavin Davies
Note, these files have the POT counting error that propagates from the generation stage so correctly scaling POT is required, i.e. divide by 2 totalpot.
233 53 Gavin Davies
These CAFs have "nuecosrej" filled.
234 53 Gavin Davies
235 17 Gavin Davies
h1. CRY
236 17 Gavin Davies
237 6 Gavin Davies
h2. ARTDAQ
238 1 Gavin Davies
239 54 Gavin Davies
Real detector-like conditions MC
240 54 Gavin Davies
*prod_daq_FA14-10-03_fd_cry_all*
241 54 Gavin Davies
242 54 Gavin Davies
Nominal
243 9 Gavin Davies
ND CRY COSMICS:
244 9 Gavin Davies
*prodartdaq_S14-05-12_ndcry*
245 6 Gavin Davies
246 1 Gavin Davies
FD CRY COSMICS:
247 17 Gavin Davies
*prodartdaq_S14-02-05_fdcry*
248 1 Gavin Davies
249 2 Gavin Davies
h2. RECO
250 1 Gavin Davies
251 54 Gavin Davies
Real detector-like conditions MC
252 54 Gavin Davies
*prod_reco_FA14-10-28_fd_cry_all*
253 54 Gavin Davies
254 54 Gavin Davies
Nominal
255 2 Gavin Davies
FD CRY COSMICS: 
256 17 Gavin Davies
*prodreco_S14-03-25_FDCRY* (10069)
257 3 Gavin Davies
258 2 Gavin Davies
h2. CALIBRATION (pchitlists)
259 2 Gavin Davies
260 2 Gavin Davies
ND CRY COSMICS:
261 2 Gavin Davies
*prodcalib_S14-05-12_ndcry_pclist*
262 2 Gavin Davies
*prodcalib_S14-05-12_ndcry_pcliststop*
263 2 Gavin Davies
264 1 Gavin Davies
FD CRY COSMICS:
265 11 Dominick Rocco
*prodcalib_S14-03-05_FDCry_pclist*
266 12 Gavin Davies
*prodcalib_S14-03-05_FDCry_pcliststop*
267 54 Gavin Davies
268 54 Gavin Davies
h2. PID
269 54 Gavin Davies
270 54 Gavin Davies
Real detector-like conditions MC
271 54 Gavin Davies
*prod_pid_FA14-10-28_fd_cry_all*
272 54 Gavin Davies
273 54 Gavin Davies
h2. CAF
274 54 Gavin Davies
275 54 Gavin Davies
Real detector-like conditions MC
276 54 Gavin Davies
*prod_caf_FA14-10-28_fd_cry_all*
277 54 Gavin Davies
278 54 Gavin Davies
Bluearc: /nova/prod/mc/FA14-10-28/cry/fd/caf/000XXX/XXXYY/ 
279 54 Gavin Davies
where XXX are the first three digits of the run number and YY are the last two.
280 54 Gavin Davies
You'll need to use appropriate wildcard flags.
281 1 Gavin Davies
282 15 Dominick Rocco
h1. DATA
283 1 Gavin Davies
284 50 Dominick Rocco
h2.  First-Analysis -- First Pass FD Processing (FA14-10-28)
285 50 Dominick Rocco
286 50 Dominick Rocco
In advance of the final calibration intended for first-analysis, a first pass with old calibration constants will be produced.  The input to these samples is the official first-analysis run lists generated by Ryan Patterson and stored in this directory: 
287 50 Dominick Rocco
<pre>
288 50 Dominick Rocco
  /nova/app/users/rbpatter/runlists/
289 50 Dominick Rocco
</pre>
290 50 Dominick Rocco
291 50 Dominick Rocco
Those lists have been adapted into very specific datasets.  
292 52 Dominick Rocco
|*Data Tier*|*Cosmic Trigger*| *NuMI Trigger*| 
293 52 Dominick Rocco
|artdaq|@prod_artdaq_fd_cosmic_fa_goodruns@|@prod_artdaq_fd_numi_fa_goodruns @|
294 52 Dominick Rocco
|reco|@prod_reco_FA14-10-28_fd_cosmic_fa_goodruns@|@prod_reco_FA14-10-28_fd_numi_fa_goodruns@|
295 50 Dominick Rocco
296 46 Dominick Rocco
h2. S14-09-29 Keep-up Reconstruction 
297 46 Dominick Rocco
298 46 Dominick Rocco
Most of the same caveats apply as did for the S14-09-09 sample, but will be repeated below for completeness.  The big change in the S14-09-29 is the addition of new information to facilitate basic neutrino searches.  There is a new sel.containment branch in the CAFs and the numu CosRej has been included for the FD stream.  
299 46 Dominick Rocco
300 46 Dominick Rocco
Keep-up reconstuction provides reconstructed art root files and CAFs.  For quick testing the last three files from each of the below datasets is stored on bluearc and updated nightly. They can be found here:
301 46 Dominick Rocco
302 46 Dominick Rocco
/nova/prod/data/keepup/samples/ 
303 46 Dominick Rocco
304 49 Dominick Rocco
h3. ND with MC Calibration 
305 1 Gavin Davies
306 49 Dominick Rocco
In lieu of official ND calibration, the old MC calibration can be applied.  The output of any module which relies on calibration should be taken with a heavy grain of salt, but these files will contain non-zero values for calibrated energies rather than zeroes.  
307 49 Dominick Rocco
308 49 Dominick Rocco
The database has now been populated with bad channel masks, which have been applied in this round of processing.  
309 49 Dominick Rocco
310 49 Dominick Rocco
The following SAM datasets are available.   
311 49 Dominick Rocco
Reco art rootfiles: _prod_reco_S14-09-29_neardet_numi_keepup_mccalib_
312 49 Dominick Rocco
CAF:  _prod_caf_S14-09-29_neardet_numi_keepup_mccalib_
313 49 Dominick Rocco
314 49 Dominick Rocco
The CAFs can also be found on bluearc:
315 49 Dominick Rocco
/nova/prod/data/keepup/S14-09-29/numi/nd/000XXX/XXXYY/ 
316 49 Dominick Rocco
where XXX are the first three digits of the run number and YY are the last two.  Note, the MC calibrated files have "mccalib" in their name.  The standard ones do not.  
317 49 Dominick Rocco
318 49 Dominick Rocco
As of October 16, there is an FTS issue keeping these files from being transferred to bluearc.  The CD experts have been notified and are working on a solution.  
319 49 Dominick Rocco
320 49 Dominick Rocco
h3.  ND (no calibration)
321 49 Dominick Rocco
322 46 Dominick Rocco
Near detector reconstruction is currently lacking calibration, which will affect the output of any module depends on it.  The most notable example is FuzzyKVertex, but the MichelE filters could also be affected.  Slicer, CosmicTrack and KalmanTrack produce output independent of reconstruction.  
323 46 Dominick Rocco
324 46 Dominick Rocco
Near detector reconstruction is also currently lacking channel masks and data quality information.  
325 46 Dominick Rocco
326 46 Dominick Rocco
The following SAM datasets are available.   
327 46 Dominick Rocco
Reco art rootfiles: _prod_reco_S14-09-29_neardet_numi_keepup_
328 46 Dominick Rocco
CAF:  _prod_caf_S14-09-29_neardet_numi_keepup_
329 1 Gavin Davies
330 49 Dominick Rocco
331 1 Gavin Davies
The CAFs can also be found on bluearc:
332 48 Dominick Rocco
/nova/prod/data/keepup/S14-09-29/numi/nd/000XXX/XXXYY/ 
333 49 Dominick Rocco
where XXX are the first three digits of the run number and YY are the last two.  Note, the MC calibrated files mentioned above have "mccalib" in their name.  The standard ones do not.  
334 46 Dominick Rocco
335 46 Dominick Rocco
h3.  FD 
336 46 Dominick Rocco
337 46 Dominick Rocco
The initial target for this processing is all of the data before the shutdown and after the end of the neutrino hunt.  Unless problems are found, back-processing will extend the sample to before the neutrino hunt.  
338 48 Dominick Rocco
339 46 Dominick Rocco
FD calibration constants are currently only available through diblock 7, but averaged constants are used beyond that point.  
340 46 Dominick Rocco
341 46 Dominick Rocco
*NB: The datasets listed below are very large.*  Using SAM projects which include the entire dataset is discouraged.  For assistance in breaking up the sample, reference the [[Sam Web Cookbook]] or email nova_sam@fnal.gov.
342 46 Dominick Rocco
343 46 Dominick Rocco
The following SAM datasets are available: 
344 46 Dominick Rocco
Reco art rootfiles: _prod_reco_S14-09-29_fardet_numi_keepup_ 
345 46 Dominick Rocco
CAF, blinded information removed:  _prod_caf_S14-09-29_fardet_numi_keepup_
346 1 Gavin Davies
347 46 Dominick Rocco
The CAFs can be found here:
348 46 Dominick Rocco
/nova/prod/data/keepup/S14-09-29/numi/fd/000XXX/XXXYY/ 
349 49 Dominick Rocco
where XXX are the first three digits of the run number and YY are the last two.  
350 46 Dominick Rocco
351 46 Dominick Rocco
h2. S14-09-09 Keep-up Reconstruction 
352 41 Dominick Rocco
353 43 Matthew Tamsett
Keep-up reconstuction provides reconstructed art root files and CAFs.  For quick testing the last three files from each of the below datasets is stored on bluearc and updated nightly. They can be found here:
354 1 Gavin Davies
355 43 Matthew Tamsett
/nova/prod/data/keepup/samples/ 
356 43 Matthew Tamsett
357 41 Dominick Rocco
h3.  ND 
358 41 Dominick Rocco
359 41 Dominick Rocco
Near detector reconstruction is currently lacking calibration, which will affect the output of any module depends on it.  The most notable example is FuzzyKVertex, but the MichelE filters could also be affected.  Slicer, CosmicTrack and KalmanTrack produce output independent of reconstruction.  
360 41 Dominick Rocco
361 41 Dominick Rocco
Near detector reconstruction is also currently lacking channel masks and data quality information.  
362 41 Dominick Rocco
363 41 Dominick Rocco
The following SAM datasets are available.   
364 41 Dominick Rocco
Reco art rootfiles: _prod_reco_keepup_S14-09-09_neardet_numi_preshutdown_fullgain_cold_
365 41 Dominick Rocco
CAF:  _prod_caf_keepup_S14-09-09_neardet_numi_preshutdown_fullgain_cold_
366 41 Dominick Rocco
367 41 Dominick Rocco
The CAFs can also be found on bluearc:
368 41 Dominick Rocco
/nova/prod/data/keepup/S14-09-09/numi/nd/000XXX/YYYYY/ 
369 41 Dominick Rocco
where XXX are the first three digits of the run number and YYYYY is the complete run number.  
370 41 Dominick Rocco
371 41 Dominick Rocco
h3.  FD 
372 41 Dominick Rocco
373 41 Dominick Rocco
Far detector keep-up processing is still underway.  When this effort is complete, the goal is to have processed all of the data after the cease of the neutrino hunt, but before the shutdown.  Since the processing is still underway, these datasets will grow.
374 41 Dominick Rocco
375 41 Dominick Rocco
FD calibration constants are currently only available through diblock 7, but averaged constants are used beyond that point.  
376 41 Dominick Rocco
377 41 Dominick Rocco
The following SAM datasets are available: 
378 41 Dominick Rocco
Reco art rootfiles: _prod_reco_keepup_S14-09-09_fardet_numi_preshutdown_posthunt_ 
379 41 Dominick Rocco
CAF, blinded information removed:  _prod_caf_keepup_S14-09-09_fardet_numi_preshutdown_posthunt_
380 1 Gavin Davies
381 41 Dominick Rocco
The CAFs can be found here:
382 41 Dominick Rocco
/nova/prod/data/keepup/S14-09-09/numi/fd/000XXX/YYYYY/ 
383 43 Matthew Tamsett
where XXX are the first three digits of the run number and YYYYY is the complete run number.
384 53 Gavin Davies
385 53 Gavin Davies
386 53 Gavin Davies
h2. Special
387 53 Gavin Davies
388 53 Gavin Davies
h3. No Mask ND
389 53 Gavin Davies
390 53 Gavin Davies
ND datasets with bad channel masks turned off. Runs included from the full gain, pre-shutdown era (runs 10377 -> 10407)
391 53 Gavin Davies
392 53 Gavin Davies
RECO: *prod_reco_S14-10-15_neardet_numi_fullgain_cold_preshutdown_mccalib-nomask*
393 53 Gavin Davies
PID:  *prod_pid_S14-10-28_neardet_numi_fullgain_cold_preshutdown_mccalib-nomask*
394 53 Gavin Davies
CAF:  /nova/ana/nu_e_ana/S14-10-28/nd_nomask/data (Bluearc location only)
395 53 Gavin Davies
Only the CAF files contain filled "nuecosrej" variables.
396 41 Dominick Rocco
397 47 Dominick Rocco
h2.  FD Cosmic Trigger, Summer 2014, Post-Neutrino
398 1 Gavin Davies
399 15 Dominick Rocco
h3. Datasets
400 1 Gavin Davies
401 15 Dominick Rocco
The datasets for these files can be found in SAM.  For PID, there is also a small sample living on Bluearc.  For CAFs, the entire sample lives on Bluearc.  All of the official datasets specify the run range for the the 4db and 7db configurations based on the Stable Partition Milestones wiki page.  The datasets also require subruns (files) to pass the data quality cuts.   
402 1 Gavin Davies
403 15 Dominick Rocco
The SAM datasets and Bluearc locations are as follows:
404 15 Dominick Rocco
405 15 Dominick Rocco
PID - 4db: 
406 1 Gavin Davies
prod_pid_S14-05-12_fardet_cosmics_p1_4db_good
407 15 Dominick Rocco
/nova/prod/data/S14-05-12/fd/pid/   (Run numbers less than 14702)
408 15 Dominick Rocco
409 15 Dominick Rocco
PID - 7db
410 15 Dominick Rocco
prod_pid_S14-05-12_fardet_cosmics_p1_7db_good
411 15 Dominick Rocco
/nova/prod/data/S14-05-12/fd/pid/ (Run numbers greater than or equal to 14702)
412 15 Dominick Rocco
413 15 Dominick Rocco
CAF - 4db: 
414 15 Dominick Rocco
prod_caf_S14-07-11_fardet_cosmics_p1_4db_good
415 47 Dominick Rocco
/nova/prod/data/S14-07-11/cosmic/fd/caf/  (Run numbers less than 14702, excluding runs 14563-14594 which were 9 diblock stress tests.)
416 15 Dominick Rocco
417 15 Dominick Rocco
CAF - 7db
418 15 Dominick Rocco
prod_caf_S14-07-11_fardet_cosmics_p1_7db_good
419 15 Dominick Rocco
/nova/prod/data/S14-07-11/cosmic/fd/caf/ (Run numbers greater than or equal to 14702)
420 15 Dominick Rocco
421 15 Dominick Rocco
The underlying reco and pidpart(sans LEM) datasets exist only in SAM:
422 15 Dominick Rocco
pidpart - 4db:
423 15 Dominick Rocco
prod_pidpart_S14-05-12_fardet_cosmics_p1_4db_good
424 15 Dominick Rocco
425 15 Dominick Rocco
pidpart - 7db:
426 15 Dominick Rocco
prod_pidpart_S14-05-08_fardet_cosmics_p1_7db_good
427 15 Dominick Rocco
428 15 Dominick Rocco
reco - 4db:
429 15 Dominick Rocco
prod_reco_S14-05-08_fardet_cosmics_p1_4db_good
430 15 Dominick Rocco
431 15 Dominick Rocco
reco - 7db:
432 15 Dominick Rocco
prod_reco_S14-05-08_fardet_cosmics_p1_7db_good
433 15 Dominick Rocco
434 15 Dominick Rocco
h3. Comments on Livetime
435 15 Dominick Rocco
436 15 Dominick Rocco
In terms of livetime, the 4db sample is much larger than the 7db sample.  The 4db PID sample is roughly ten times larger than that used for Neutrino 2014.  The four diblock CAF sample is currently twice the size of the Neutrino sample, although it's growing.  The CAFMaking process has been tedious due to CAFMaker crashes*, and the sample will never be as large as the PID sample as a result.  The 7db sample, in terms of livetime, is roughly the same size as the Neutrino 2014 sample.  However, that detector configuration has 75 percent more detector mass.  The same caveat applies to the size of the CAF sample.  
437 15 Dominick Rocco
438 15 Dominick Rocco
h4.  Processing history
439 15 Dominick Rocco
440 15 Dominick Rocco
The processing history for these files is as follows:
441 15 Dominick Rocco
Reco:  S14-05-08 - Notably, this tag resolves the KalmanTrack association bug 
442 1 Gavin Davies
PID: S14-05-12 - Loose nue preselection 
443 39 Matthew Tamsett
CAF: S14-07-11 - Uses LiveGeometry, but gets the CAF metadata right.