Project

General

Profile

Official Datasets » History » Version 59

Christopher Backhouse, 11/18/2014 08:50 PM
I've been reading up on table formatting syntax...

1 11 Dominick Rocco
h1. Official Datasets
2 11 Dominick Rocco
3 44 Dominick Rocco
4 1 Gavin Davies
The vast majority of NOvA's data and MC reside within a data handling system called Sequential Access Metadata (SAM).  The files are stored on a tape-backed disk array called dCache.  Locations for the files are tracked using a database with a web interface, accessible through the @samweb@ command line client utility.  The [[NOvA-SAM:SAM_web_cookbook]] provides an introduction to using the system.  
5 45 Dominick Rocco
6 45 Dominick Rocco
As a throwback to the old days, some of the data is still stored on bluearc.  CAFs are a notable group of files of which the most recent are almost always stored on bluearc.  There are also small, selected samples of ART files available on bluearc in <some location, documented where?>
7 45 Dominick Rocco
8 45 Dominick Rocco
{{toc}}
9 1 Gavin Davies
10 12 Gavin Davies
h1. Monte Carlo
11 1 Gavin Davies
12 54 Gavin Davies
h1. Latest datasets for detector-like conditions MC
13 54 Gavin Davies
14 54 Gavin Davies
| *FarDet* | *FHC swap*                                 | *FHC nonswap*                             | *RHC swap* | *RHC nonswap* | *FHC tau*                             | *Cosmics*                       |
15 59 Christopher Backhouse
| *artdaq* | prod_daq_FA14-10-03_fd_genie_fhc_fluxswap  | prod_daq_FA14-10-03_fd_genie_fhc_nonswap  |=. -        |=. -           | prod_daq_FA14-10-03_fd_genie_fhc_tau  | prod_daq_FA14-10-03_fd_cry_all  |
16 59 Christopher Backhouse
| *reco*   | prod_reco_FA14-10-28_fd_genie_fhc_fluxswap | prod_reco_FA14-10-28_fd_genie_fhc_nonswap |=. -        |=. -           | prod_reco_FA14-10-28_fd_genie_fhc_tau | prod_reco_FA14-10-28_fd_cry_all |
17 59 Christopher Backhouse
| *pid*    | prod_pid_FA14-10-28_fd_genie_fhc_fluxswap  | prod_pid_FA14-10-28_fd_genie_fhc_nonswap  |=. -        |=. -           | prod_pid_FA14-10-28_fd_genie_fhc_tau  | prod_pid_FA14-10-28_fd_cry_all  |
18 59 Christopher Backhouse
| *caf*    | prod_caf_FA14-10-28_fd_genie_fhc_fluxswap  | prod_caf_FA14-10-28_fd_genie_fhc_nonswap  |=. -        |=. -           | prod_caf_FA14-10-28_fd_genie_fhc_tau  | prod_caf_FA14-10-28_fd_cry_all  |
19 54 Gavin Davies
20 57 Gavin Davies
h1. Latest datasets for ideal conditions (14db) MC
21 57 Gavin Davies
22 59 Christopher Backhouse
| *FarDet* | *FHC swap*                                      | *FHC nonswap*                                  | *RHC swap* | *RHC nonswap* | *FHC tau*                                  | *Cosmics* |
23 59 Christopher Backhouse
| *artdaq* | prod_daq_FA14-10-03_fd_genie_fhc_fluxswap_14db  | prod_daq_FA14-10-03_fd_genie_fhc_nonswap_14db  |=. -        |=. -           | prod_daq_FA14-10-03_fd_genie_fhc_tau_14db  |=. -       |
24 59 Christopher Backhouse
| *reco*   | prod_reco_FA14-10-28_fd_genie_fhc_fluxswap_14db | prod_reco_FA14-10-28_fd_genie_fhc_nonswap_14db |=. -        |=. -           | prod_reco_FA14-10-28_fd_genie_fhc_tau_14db |=. -       |
25 59 Christopher Backhouse
| *pid*    | prod_pid_FA14-10-28_fd_genie_fhc_fluxswap_14db  | prod_pid_FA14-10-28_fd_genie_fhc_nonswap_14db  |=. -        |=. -           | prod_pid_FA14-10-28_fd_genie_fhc_tau_14db  |=. -       |
26 59 Christopher Backhouse
| *caf*    | prod_caf_FA14-10-28_fd_genie_fhc_fluxswap_14db  | prod_caf_FA14-10-28_fd_genie_fhc_nonswap_14db  |=. -        |=. -           | prod_caf_FA14-10-28_fd_genie_fhc_tau_14db  |=. -       |
27 57 Gavin Davies
28 58 Gavin Davies
h1. Latest datasets for detector-like conditions, geojittered, MC
29 58 Gavin Davies
30 59 Christopher Backhouse
| *FarDet* | *FHC swap*                                             | *FHC nonswap*                                         | *RHC swap*     | *RHC nonswap*     | *FHC tau*                                         | *Cosmics* |
31 59 Christopher Backhouse
| *artdaq* | prod_daq_FA14-10-03_fd_genie_fhc_fluxswap_geojittered  | prod_daq_FA14-10-03_fd_genie_fhc_nonswap_geojittered  |=. -            |=. -               | prod_daq_FA14-10-03_fd_genie_fhc_tau_geojittered  |=. -       |
32 59 Christopher Backhouse
| *reco*   | prod_reco_FA14-10-28_fd_genie_fhc_fluxswap_geojittered | prod_reco_FA14-10-28_fd_genie_fhc_nonswap_geojittered |=. -            |=. -               | prod_reco_FA14-10-28_fd_genie_fhc_tau_geojittered |=. -       |
33 59 Christopher Backhouse
| *pid*    | prod_pid_FA14-10-28_fd_genie_fhc_fluxswap_geojittered  | prod_pid_FA14-10-28_fd_genie_fhc_nonswap_geojittered  |=. -            |=. -               | prod_pid_FA14-10-28_fd_genie_fhc_tau_geojittered  |=. -       |
34 59 Christopher Backhouse
| *caf*    | prod_caf_FA14-10-28_fd_genie_fhc_fluxswap_geojittered  | prod_caf_FA14-10-28_fd_genie_fhc_nonswap_geojittered  |=. -            |=. -               | prod_caf_FA14-10-28_fd_genie_fhc_tau_geojittered  |=. -       |
35 58 Gavin Davies
36 40 Christopher Backhouse
h1. Latest datasets for regular configurations
37 40 Christopher Backhouse
38 59 Christopher Backhouse
| *FarDet* | *FHC swap*                                  | *FHC nonswap*                              | *RHC swap*                              | *RHC nonswap*                              | *Cosmics*                  |
39 59 Christopher Backhouse
| *artdaq* | prod_artdaq_S14-03-25_fd_genie_fhc_swap     | prod_artdaq_S14-03-25_fd_genie_fhc_nonswap | prod_artdaq_S14-03-25_fd_genie_rhc_swap | prod_artdaq_S14-03-25_fd_genie_rhc_nonswap | prodartdaq_S14-02-05_fdcry |
40 59 Christopher Backhouse
| *reco*   | prodreco_S14-03-25_FDGENIE_fhc_swap         | prodreco_S14-03-25_FDGENIE_fhc_nonswap     | prodreco_S14-03-25_FDGENIE_rhc_swap     | prodreco_S14-03-25_FDGENIE_rhc_nonswap     | prodreco_S14-03-25_FDCRY   |
41 59 Christopher Backhouse
| *pid*    |\2=. prod_pid_S14-05-12_fd_genie_neutrino2014                                             |=. -                                     |=. -                                        |=. -                        |
42 59 Christopher Backhouse
| *caf*    |\2=. prod_caf_S14-07-11_fd_genie_neutrino2014                                             |=. -                                     |=. -                                        |=. -                        |
43 40 Christopher Backhouse
44 40 Christopher Backhouse
45 40 Christopher Backhouse
| *NearDet* | *FHC*                            | *RHC* | *Cosmics*                  |
46 59 Christopher Backhouse
| *artdaq*  | prodartdaq_S14-05-12_ndgenie_fix |=. -   | prodartdaq_S14-05-12_ndcry |
47 59 Christopher Backhouse
| *reco*    | prodreco_S14-08-01_ndgenie_fix   |=. -   |=. -                        |
48 59 Christopher Backhouse
| *pid*     | prodpid_S14-08-19_ndgenie_fix    |=. -   |=. -                        |
49 59 Christopher Backhouse
| *caf*     | prodcaf_S14-08-19_ndgenie_fix    |=. -   |=. -                        |
50 40 Christopher Backhouse
51 18 Gavin Davies
h1. GENIE
52 1 Gavin Davies
53 17 Gavin Davies
h2. ARTDAQ
54 17 Gavin Davies
55 4 Gavin Davies
h3. FD
56 4 Gavin Davies
57 54 Gavin Davies
Real detector-like conditions MC
58 54 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_fluxswap*
59 54 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_nonswap*
60 54 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_tau*
61 54 Gavin Davies
62 57 Gavin Davies
Ideal conditions 14db MC
63 57 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_fluxswap_14db*
64 57 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_nonswap_14db*
65 57 Gavin Davies
*prod_daq_FA14-10-03_fd_genie_fhc_tau_14db*
66 57 Gavin Davies
67 54 Gavin Davies
Nominal
68 35 Gavin Davies
FHC SWAP/NONSWAP
69 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_fhc_swap* (709)
70 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_fhc_nonswap* (709)
71 1 Gavin Davies
72 35 Gavin Davies
RHC SWAP/NONSWAP
73 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_rhc_swap* (709)
74 35 Gavin Davies
*prod_artdaq_S14-03-25_fd_genie_rhc_nonswap* (709)
75 35 Gavin Davies
76 4 Gavin Davies
h3. ND
77 13 Gavin Davies
78 23 Gavin Davies
Fixed version of overlay files
79 26 Gavin Davies
*prodartdaq_S14-05-12_ndgenie_fix* (4359)
80 23 Gavin Davies
81 23 Gavin Davies
-*prodartdaq_S14-05-12_ndgenie* (20087)-
82 4 Gavin Davies
83 24 Gavin Davies
h3. Special
84 24 Gavin Davies
85 36 Gavin Davies
Nominal geometry
86 36 Gavin Davies
*prod_artdaq_S14-08-19_fd_genie_fhc_nonswap* (34)
87 36 Gavin Davies
*prod_artdaq_S14-08-19_fd_genie_fhc_swap* (34)
88 36 Gavin Davies
89 24 Gavin Davies
Jittered geometry
90 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_nonswap_geojittered* (37)
91 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_swap_geojittered* (39)
92 24 Gavin Davies
93 24 Gavin Davies
CRY+GENIE
94 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_nonswap_crygenie* (510)
95 39 Matthew Tamsett
*prod_artdaq_S14-08-19_fd_fhc_swap_crygenie* (511)
96 24 Gavin Davies
97 17 Gavin Davies
h2. RECO
98 8 Gavin Davies
99 1 Gavin Davies
Official production datasets containing all reconstructed files
100 1 Gavin Davies
101 1 Gavin Davies
h3. FD 
102 1 Gavin Davies
103 54 Gavin Davies
Real detector-like conditions MC
104 54 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_fluxswap*
105 54 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_nonswap*
106 54 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_tau*
107 54 Gavin Davies
108 57 Gavin Davies
Ideal conditions 14db MC
109 57 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_fluxswap_14db*
110 57 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_nonswap_14db*
111 57 Gavin Davies
*prod_reco_FA14-10-28_fd_genie_fhc_tau_14db*
112 57 Gavin Davies
113 54 Gavin Davies
Nominal
114 1 Gavin Davies
ALL FD GENIE RECO:          
115 1 Gavin Davies
*prodreco_S14-03-25_FDGENIE* (2807 files)
116 1 Gavin Davies
117 35 Gavin Davies
FHC SWAP/NONSWAP: 
118 35 Gavin Davies
*prodreco_S14-03-25_FDGENIE_fhc_swap* (703)
119 1 Gavin Davies
*prodreco_S14-03-25_FDGENIE_fhc_nonswap* (703)
120 1 Gavin Davies
121 35 Gavin Davies
RHC SWAP/NONSWAP
122 1 Gavin Davies
*prodreco_S14-03-25_FDGENIE_rhc_swap* (698)
123 35 Gavin Davies
*prodreco_S14-03-25_FDGENIE_rhc_nonswap* (703)
124 4 Gavin Davies
125 5 Gavin Davies
h3. ND
126 4 Gavin Davies
127 1 Gavin Davies
ND (FHC) GENIE (rock+detector) OVERLAY RECO
128 25 Gavin Davies
*prodreco_S14-08-01_ndgenie_fix* (4295)
129 1 Gavin Davies
130 24 Gavin Davies
-*prodreco_S14-07-03_ndgenie* (20057 and increasing)-
131 1 Gavin Davies
132 1 Gavin Davies
h3. Special
133 1 Gavin Davies
134 36 Gavin Davies
Nominal geometry
135 36 Gavin Davies
*prod_reco_S14-08-01_fd_genie_fhc_nonswap* (34)
136 36 Gavin Davies
*prod_reco_S14-08-01_fd_genie_fhc_swap* (34)
137 1 Gavin Davies
138 36 Gavin Davies
Jittered geometry
139 36 Gavin Davies
Simulated with jitter and reco+ with standard geom
140 38 Matthew Tamsett
*prod_reco_S14-08-01_fd_fhc_nonswap_geojittered_v5* (37)
141 38 Matthew Tamsett
*prod_reco_S14-08-01_fd_fhc_swap_geojittered_v5* (39)
142 36 Gavin Davies
143 36 Gavin Davies
All tiers with geojittered geometry
144 36 Gavin Davies
-*prod_reco_S14-08-01_fd_fhc_nonswap_geojittered_v1* (34)-
145 36 Gavin Davies
-*prod_reco_S14-08-01_fd_fhc_swap_geojittered_v1* (34)-
146 36 Gavin Davies
147 24 Gavin Davies
CRY+GENIE
148 30 Gavin Davies
*prod_reco_S14-08-01_fd_fhc_nonswap_crygenie* (510)
149 30 Gavin Davies
*prod_reco_S14-08-01_fd_fhc_swap_crygenie* (511)
150 16 Gavin Davies
151 53 Gavin Davies
NO MASK
152 53 Gavin Davies
These files have bad channels turned off.
153 53 Gavin Davies
*prod_reco_S14-10-15_genie_nonswap_nomask*
154 53 Gavin Davies
Note, these files have the POT counting error that propagates from the generation stage so correctly scaling POT is required, i.e. divide by 2 totalpot.
155 53 Gavin Davies
156 53 Gavin Davies
157 17 Gavin Davies
h2. PID
158 34 Gavin Davies
159 32 Satish Desai
h3. FD
160 32 Satish Desai
161 54 Gavin Davies
Real detector-like conditions MC
162 54 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_fluxswap*
163 54 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_nonswap*
164 54 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_tau*
165 54 Gavin Davies
166 57 Gavin Davies
Ideal conditions 14db MC
167 57 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_fluxswap_14db*
168 57 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_nonswap_14db*
169 57 Gavin Davies
*prod_pid_FA14-10-28_fd_genie_fhc_tau_14db*
170 57 Gavin Davies
171 54 Gavin Davies
OLD
172 16 Gavin Davies
*prod_pid_S14-05-12_fd_genie_neutrino2014*
173 16 Gavin Davies
174 1 Gavin Davies
h3. ND
175 16 Gavin Davies
176 1 Gavin Davies
ND (FHC) GENIE (rock+detector) OVERLAY reco
177 1 Gavin Davies
178 1 Gavin Davies
*prodpid_S14-08-19_ndgenie_fix* (4072)
179 1 Gavin Davies
180 30 Gavin Davies
-*prodpid_S14-08-01_ndgenie* (2715, will grow)-
181 1 Gavin Davies
182 1 Gavin Davies
h3. Special
183 1 Gavin Davies
184 36 Gavin Davies
Nominal
185 36 Gavin Davies
*prod_pid_S14-08-19_fd_genie_fhc_nonswap* (34)
186 36 Gavin Davies
*prod_pid_S14-08-19_fd_genie_fhc_swap* (34)
187 36 Gavin Davies
188 1 Gavin Davies
Jittered geometry
189 36 Gavin Davies
Simulated with jitter and reco+ with standard geom
190 36 Gavin Davies
*prod_pid_S14-08-19_fd_fhc_nonswap_geojittered_v5* (37)
191 36 Gavin Davies
*prod_pid_S14-08-19_fd_fhc_swap_geojittered_v5* (39)
192 30 Gavin Davies
193 36 Gavin Davies
All tiers with geojittered geometry
194 36 Gavin Davies
-*prod_pid_S14-08-19_fd_fhc_nonswap_geojittered_v1* (34)-
195 36 Gavin Davies
-*prod_pid_S14-08-19_fd_fhc_swap_geojittered_v1* (34)-
196 36 Gavin Davies
197 19 Gavin Davies
CRY+GENIE
198 1 Gavin Davies
*prod_pid_S14-08-19_fd_fhc_nonswap_crygenie* (486)
199 33 Satish Desai
*prod_pid_S14-08-19_fd_fhc_swap_crygenie* (492)
200 34 Gavin Davies
201 53 Gavin Davies
NO MASK
202 53 Gavin Davies
These files have bad channels turned off.
203 53 Gavin Davies
*prod_pid_S14-10-28_nd_genie_nonswap_nomask*
204 53 Gavin Davies
Note, these files have the POT counting error that propagates from the generation stage so correctly scaling POT is required, i.e. divide by 2 totalpot.
205 53 Gavin Davies
The module "nuecosrej" is empty in the PID files. It is filled at the CAF stage for this set however.
206 53 Gavin Davies
207 33 Satish Desai
h2. CAF
208 19 Gavin Davies
209 33 Satish Desai
h3. FD
210 29 Gavin Davies
211 54 Gavin Davies
Real detector-like conditions MC
212 54 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_fluxswap*
213 54 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_nonswap*
214 54 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_tau*
215 54 Gavin Davies
216 54 Gavin Davies
Bluearc: /nova/prod/mc/FA14-10-28/genie/fd/caf/000XXX/XXXYY/ 
217 54 Gavin Davies
where XXX are the first three digits of the run number and YY are the last two.
218 54 Gavin Davies
You'll need to use appropriate wildcard flags.
219 57 Gavin Davies
220 57 Gavin Davies
Ideal conditions 14db MC
221 57 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_fluxswap_14db*
222 57 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_nonswap_14db*
223 57 Gavin Davies
*prod_caf_FA14-10-28_fd_genie_fhc_tau_14db*
224 57 Gavin Davies
225 57 Gavin Davies
Bluearc: /nova/prod/mc/FA14-10-28/genie/fd/caf/010000/100000X
226 57 Gavin Davies
where X is an integer from 0-5.
227 54 Gavin Davies
228 54 Gavin Davies
OLD
229 29 Gavin Davies
*prod_caf_S14-07-11_fd_genie_neutrino2014*
230 29 Gavin Davies
231 28 Gavin Davies
h3. ND
232 19 Gavin Davies
233 28 Gavin Davies
SAM: *prodcaf_S14-08-19_ndgenie_fix* (4072)
234 1 Gavin Davies
235 1 Gavin Davies
Bluearc: */nova/prod/mc/S14-08-19/genie/nd/caf* (4072)
236 1 Gavin Davies
237 1 Gavin Davies
First pass post-pid:
238 1 Gavin Davies
-*/nova/prod/mc/S14-08-15/genie/nd/caf/* (2441 files)-
239 30 Gavin Davies
(find . -name "neardet*")
240 30 Gavin Davies
CAFMaker Floating point exception for all failures.
241 1 Gavin Davies
242 1 Gavin Davies
Caveat: Two significant issues have been found in this sample in the last day or two.  An old version of PhotonTransport was used in the overlay production, making the light levels low by a factor of two, and also the rock overlay scheme re-used rock events at a much higher rate than intended.  Both of these issues are fixed and replacements for these ND MC CAFs will tentatively be ready in a week we hope. We'll keep you posted. 
243 1 Gavin Davies
The current CAFs should be useful for code development and certain physics studies in the meantime.
244 1 Gavin Davies
245 1 Gavin Davies
h3. Special
246 1 Gavin Davies
247 36 Gavin Davies
Nominal
248 37 Matthew Tamsett
*prod_caf_S14-08-19_fd_genie_fhc_nonswap* (34)
249 37 Matthew Tamsett
*prod_caf_S14-08-19_fd_genie_fhc_swap* (34)
250 36 Gavin Davies
251 1 Gavin Davies
Jittered geometry
252 36 Gavin Davies
Simulated with jitter and reco+ with standard geom
253 36 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_nonswap_geojittered_v5* (37)
254 36 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_swap_geojittered_v5* (39)
255 31 Gavin Davies
256 36 Gavin Davies
All tiers with geojittered geometry
257 36 Gavin Davies
-*prod_caf_S14-08-19_fd_fhc_nonswap_geojittered_v1* (32)-
258 36 Gavin Davies
-*prod_caf_S14-08-19_fd_fhc_swap_geojittered_v1* (33)-
259 36 Gavin Davies
260 30 Gavin Davies
CRY+GENIE
261 30 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_nonswap_crygenie* (484)
262 30 Gavin Davies
*prod_caf_S14-08-19_fd_fhc_swap_crygenie* (490)
263 30 Gavin Davies
264 30 Gavin Davies
Bluearc:
265 19 Gavin Davies
*/nova/prod/mc/S14-08-19/genie/fd/caf/* 
266 36 Gavin Davies
(need to grab *fhc_nonswap* or *fhc_swap* plus either *crygenie* or *geojittered*v5*)
267 1 Gavin Davies
268 53 Gavin Davies
NO MASK
269 53 Gavin Davies
These files have bad channels turned off.
270 53 Gavin Davies
*/nova/ana/nu_e_ana/S14-10-28/nd_nomask/mc*
271 53 Gavin Davies
Note, these files have the POT counting error that propagates from the generation stage so correctly scaling POT is required, i.e. divide by 2 totalpot.
272 53 Gavin Davies
These CAFs have "nuecosrej" filled.
273 53 Gavin Davies
274 17 Gavin Davies
h1. CRY
275 17 Gavin Davies
276 6 Gavin Davies
h2. ARTDAQ
277 1 Gavin Davies
278 54 Gavin Davies
Real detector-like conditions MC
279 54 Gavin Davies
*prod_daq_FA14-10-03_fd_cry_all*
280 54 Gavin Davies
281 54 Gavin Davies
Nominal
282 9 Gavin Davies
ND CRY COSMICS:
283 9 Gavin Davies
*prodartdaq_S14-05-12_ndcry*
284 6 Gavin Davies
285 1 Gavin Davies
FD CRY COSMICS:
286 17 Gavin Davies
*prodartdaq_S14-02-05_fdcry*
287 1 Gavin Davies
288 2 Gavin Davies
h2. RECO
289 1 Gavin Davies
290 54 Gavin Davies
Real detector-like conditions MC
291 54 Gavin Davies
*prod_reco_FA14-10-28_fd_cry_all*
292 54 Gavin Davies
293 54 Gavin Davies
Nominal
294 2 Gavin Davies
FD CRY COSMICS: 
295 17 Gavin Davies
*prodreco_S14-03-25_FDCRY* (10069)
296 3 Gavin Davies
297 2 Gavin Davies
h2. CALIBRATION (pchitlists)
298 2 Gavin Davies
299 2 Gavin Davies
ND CRY COSMICS:
300 2 Gavin Davies
*prodcalib_S14-05-12_ndcry_pclist*
301 2 Gavin Davies
*prodcalib_S14-05-12_ndcry_pcliststop*
302 2 Gavin Davies
303 1 Gavin Davies
FD CRY COSMICS:
304 11 Dominick Rocco
*prodcalib_S14-03-05_FDCry_pclist*
305 12 Gavin Davies
*prodcalib_S14-03-05_FDCry_pcliststop*
306 54 Gavin Davies
307 54 Gavin Davies
h2. PID
308 54 Gavin Davies
309 54 Gavin Davies
Real detector-like conditions MC
310 54 Gavin Davies
*prod_pid_FA14-10-28_fd_cry_all*
311 54 Gavin Davies
312 54 Gavin Davies
h2. CAF
313 54 Gavin Davies
314 54 Gavin Davies
Real detector-like conditions MC
315 54 Gavin Davies
*prod_caf_FA14-10-28_fd_cry_all*
316 54 Gavin Davies
317 54 Gavin Davies
Bluearc: /nova/prod/mc/FA14-10-28/cry/fd/caf/000XXX/XXXYY/ 
318 54 Gavin Davies
where XXX are the first three digits of the run number and YY are the last two.
319 54 Gavin Davies
You'll need to use appropriate wildcard flags.
320 1 Gavin Davies
321 15 Dominick Rocco
h1. DATA
322 1 Gavin Davies
323 50 Dominick Rocco
h2.  First-Analysis -- First Pass FD Processing (FA14-10-28)
324 50 Dominick Rocco
325 50 Dominick Rocco
In advance of the final calibration intended for first-analysis, a first pass with old calibration constants will be produced.  The input to these samples is the official first-analysis run lists generated by Ryan Patterson and stored in this directory: 
326 50 Dominick Rocco
<pre>
327 50 Dominick Rocco
  /nova/app/users/rbpatter/runlists/
328 50 Dominick Rocco
</pre>
329 50 Dominick Rocco
330 50 Dominick Rocco
Those lists have been adapted into very specific datasets.  
331 52 Dominick Rocco
|*Data Tier*|*Cosmic Trigger*| *NuMI Trigger*| 
332 52 Dominick Rocco
|artdaq|@prod_artdaq_fd_cosmic_fa_goodruns@|@prod_artdaq_fd_numi_fa_goodruns @|
333 52 Dominick Rocco
|reco|@prod_reco_FA14-10-28_fd_cosmic_fa_goodruns@|@prod_reco_FA14-10-28_fd_numi_fa_goodruns@|
334 50 Dominick Rocco
335 46 Dominick Rocco
h2. S14-09-29 Keep-up Reconstruction 
336 46 Dominick Rocco
337 46 Dominick Rocco
Most of the same caveats apply as did for the S14-09-09 sample, but will be repeated below for completeness.  The big change in the S14-09-29 is the addition of new information to facilitate basic neutrino searches.  There is a new sel.containment branch in the CAFs and the numu CosRej has been included for the FD stream.  
338 46 Dominick Rocco
339 46 Dominick Rocco
Keep-up reconstuction provides reconstructed art root files and CAFs.  For quick testing the last three files from each of the below datasets is stored on bluearc and updated nightly. They can be found here:
340 46 Dominick Rocco
341 46 Dominick Rocco
/nova/prod/data/keepup/samples/ 
342 46 Dominick Rocco
343 49 Dominick Rocco
h3. ND with MC Calibration 
344 1 Gavin Davies
345 49 Dominick Rocco
In lieu of official ND calibration, the old MC calibration can be applied.  The output of any module which relies on calibration should be taken with a heavy grain of salt, but these files will contain non-zero values for calibrated energies rather than zeroes.  
346 49 Dominick Rocco
347 49 Dominick Rocco
The database has now been populated with bad channel masks, which have been applied in this round of processing.  
348 49 Dominick Rocco
349 49 Dominick Rocco
The following SAM datasets are available.   
350 49 Dominick Rocco
Reco art rootfiles: _prod_reco_S14-09-29_neardet_numi_keepup_mccalib_
351 49 Dominick Rocco
CAF:  _prod_caf_S14-09-29_neardet_numi_keepup_mccalib_
352 49 Dominick Rocco
353 49 Dominick Rocco
The CAFs can also be found on bluearc:
354 49 Dominick Rocco
/nova/prod/data/keepup/S14-09-29/numi/nd/000XXX/XXXYY/ 
355 49 Dominick Rocco
where XXX are the first three digits of the run number and YY are the last two.  Note, the MC calibrated files have "mccalib" in their name.  The standard ones do not.  
356 49 Dominick Rocco
357 49 Dominick Rocco
As of October 16, there is an FTS issue keeping these files from being transferred to bluearc.  The CD experts have been notified and are working on a solution.  
358 49 Dominick Rocco
359 49 Dominick Rocco
h3.  ND (no calibration)
360 49 Dominick Rocco
361 46 Dominick Rocco
Near detector reconstruction is currently lacking calibration, which will affect the output of any module depends on it.  The most notable example is FuzzyKVertex, but the MichelE filters could also be affected.  Slicer, CosmicTrack and KalmanTrack produce output independent of reconstruction.  
362 46 Dominick Rocco
363 46 Dominick Rocco
Near detector reconstruction is also currently lacking channel masks and data quality information.  
364 46 Dominick Rocco
365 46 Dominick Rocco
The following SAM datasets are available.   
366 46 Dominick Rocco
Reco art rootfiles: _prod_reco_S14-09-29_neardet_numi_keepup_
367 46 Dominick Rocco
CAF:  _prod_caf_S14-09-29_neardet_numi_keepup_
368 1 Gavin Davies
369 49 Dominick Rocco
370 1 Gavin Davies
The CAFs can also be found on bluearc:
371 48 Dominick Rocco
/nova/prod/data/keepup/S14-09-29/numi/nd/000XXX/XXXYY/ 
372 49 Dominick Rocco
where XXX are the first three digits of the run number and YY are the last two.  Note, the MC calibrated files mentioned above have "mccalib" in their name.  The standard ones do not.  
373 46 Dominick Rocco
374 46 Dominick Rocco
h3.  FD 
375 46 Dominick Rocco
376 46 Dominick Rocco
The initial target for this processing is all of the data before the shutdown and after the end of the neutrino hunt.  Unless problems are found, back-processing will extend the sample to before the neutrino hunt.  
377 48 Dominick Rocco
378 46 Dominick Rocco
FD calibration constants are currently only available through diblock 7, but averaged constants are used beyond that point.  
379 46 Dominick Rocco
380 46 Dominick Rocco
*NB: The datasets listed below are very large.*  Using SAM projects which include the entire dataset is discouraged.  For assistance in breaking up the sample, reference the [[Sam Web Cookbook]] or email nova_sam@fnal.gov.
381 46 Dominick Rocco
382 46 Dominick Rocco
The following SAM datasets are available: 
383 46 Dominick Rocco
Reco art rootfiles: _prod_reco_S14-09-29_fardet_numi_keepup_ 
384 46 Dominick Rocco
CAF, blinded information removed:  _prod_caf_S14-09-29_fardet_numi_keepup_
385 1 Gavin Davies
386 46 Dominick Rocco
The CAFs can be found here:
387 46 Dominick Rocco
/nova/prod/data/keepup/S14-09-29/numi/fd/000XXX/XXXYY/ 
388 49 Dominick Rocco
where XXX are the first three digits of the run number and YY are the last two.  
389 46 Dominick Rocco
390 46 Dominick Rocco
h2. S14-09-09 Keep-up Reconstruction 
391 41 Dominick Rocco
392 43 Matthew Tamsett
Keep-up reconstuction provides reconstructed art root files and CAFs.  For quick testing the last three files from each of the below datasets is stored on bluearc and updated nightly. They can be found here:
393 1 Gavin Davies
394 43 Matthew Tamsett
/nova/prod/data/keepup/samples/ 
395 43 Matthew Tamsett
396 41 Dominick Rocco
h3.  ND 
397 41 Dominick Rocco
398 41 Dominick Rocco
Near detector reconstruction is currently lacking calibration, which will affect the output of any module depends on it.  The most notable example is FuzzyKVertex, but the MichelE filters could also be affected.  Slicer, CosmicTrack and KalmanTrack produce output independent of reconstruction.  
399 41 Dominick Rocco
400 41 Dominick Rocco
Near detector reconstruction is also currently lacking channel masks and data quality information.  
401 41 Dominick Rocco
402 41 Dominick Rocco
The following SAM datasets are available.   
403 41 Dominick Rocco
Reco art rootfiles: _prod_reco_keepup_S14-09-09_neardet_numi_preshutdown_fullgain_cold_
404 41 Dominick Rocco
CAF:  _prod_caf_keepup_S14-09-09_neardet_numi_preshutdown_fullgain_cold_
405 41 Dominick Rocco
406 41 Dominick Rocco
The CAFs can also be found on bluearc:
407 41 Dominick Rocco
/nova/prod/data/keepup/S14-09-09/numi/nd/000XXX/YYYYY/ 
408 41 Dominick Rocco
where XXX are the first three digits of the run number and YYYYY is the complete run number.  
409 41 Dominick Rocco
410 41 Dominick Rocco
h3.  FD 
411 41 Dominick Rocco
412 41 Dominick Rocco
Far detector keep-up processing is still underway.  When this effort is complete, the goal is to have processed all of the data after the cease of the neutrino hunt, but before the shutdown.  Since the processing is still underway, these datasets will grow.
413 41 Dominick Rocco
414 41 Dominick Rocco
FD calibration constants are currently only available through diblock 7, but averaged constants are used beyond that point.  
415 41 Dominick Rocco
416 41 Dominick Rocco
The following SAM datasets are available: 
417 41 Dominick Rocco
Reco art rootfiles: _prod_reco_keepup_S14-09-09_fardet_numi_preshutdown_posthunt_ 
418 41 Dominick Rocco
CAF, blinded information removed:  _prod_caf_keepup_S14-09-09_fardet_numi_preshutdown_posthunt_
419 1 Gavin Davies
420 41 Dominick Rocco
The CAFs can be found here:
421 41 Dominick Rocco
/nova/prod/data/keepup/S14-09-09/numi/fd/000XXX/YYYYY/ 
422 43 Matthew Tamsett
where XXX are the first three digits of the run number and YYYYY is the complete run number.
423 53 Gavin Davies
424 53 Gavin Davies
425 53 Gavin Davies
h2. Special
426 53 Gavin Davies
427 53 Gavin Davies
h3. No Mask ND
428 53 Gavin Davies
429 53 Gavin Davies
ND datasets with bad channel masks turned off. Runs included from the full gain, pre-shutdown era (runs 10377 -> 10407)
430 53 Gavin Davies
431 53 Gavin Davies
RECO: *prod_reco_S14-10-15_neardet_numi_fullgain_cold_preshutdown_mccalib-nomask*
432 53 Gavin Davies
PID:  *prod_pid_S14-10-28_neardet_numi_fullgain_cold_preshutdown_mccalib-nomask*
433 53 Gavin Davies
CAF:  /nova/ana/nu_e_ana/S14-10-28/nd_nomask/data (Bluearc location only)
434 53 Gavin Davies
Only the CAF files contain filled "nuecosrej" variables.
435 41 Dominick Rocco
436 47 Dominick Rocco
h2.  FD Cosmic Trigger, Summer 2014, Post-Neutrino
437 1 Gavin Davies
438 15 Dominick Rocco
h3. Datasets
439 1 Gavin Davies
440 15 Dominick Rocco
The datasets for these files can be found in SAM.  For PID, there is also a small sample living on Bluearc.  For CAFs, the entire sample lives on Bluearc.  All of the official datasets specify the run range for the the 4db and 7db configurations based on the Stable Partition Milestones wiki page.  The datasets also require subruns (files) to pass the data quality cuts.   
441 1 Gavin Davies
442 15 Dominick Rocco
The SAM datasets and Bluearc locations are as follows:
443 15 Dominick Rocco
444 15 Dominick Rocco
PID - 4db: 
445 1 Gavin Davies
prod_pid_S14-05-12_fardet_cosmics_p1_4db_good
446 15 Dominick Rocco
/nova/prod/data/S14-05-12/fd/pid/   (Run numbers less than 14702)
447 15 Dominick Rocco
448 15 Dominick Rocco
PID - 7db
449 15 Dominick Rocco
prod_pid_S14-05-12_fardet_cosmics_p1_7db_good
450 15 Dominick Rocco
/nova/prod/data/S14-05-12/fd/pid/ (Run numbers greater than or equal to 14702)
451 15 Dominick Rocco
452 15 Dominick Rocco
CAF - 4db: 
453 15 Dominick Rocco
prod_caf_S14-07-11_fardet_cosmics_p1_4db_good
454 47 Dominick Rocco
/nova/prod/data/S14-07-11/cosmic/fd/caf/  (Run numbers less than 14702, excluding runs 14563-14594 which were 9 diblock stress tests.)
455 15 Dominick Rocco
456 15 Dominick Rocco
CAF - 7db
457 15 Dominick Rocco
prod_caf_S14-07-11_fardet_cosmics_p1_7db_good
458 15 Dominick Rocco
/nova/prod/data/S14-07-11/cosmic/fd/caf/ (Run numbers greater than or equal to 14702)
459 15 Dominick Rocco
460 15 Dominick Rocco
The underlying reco and pidpart(sans LEM) datasets exist only in SAM:
461 15 Dominick Rocco
pidpart - 4db:
462 15 Dominick Rocco
prod_pidpart_S14-05-12_fardet_cosmics_p1_4db_good
463 15 Dominick Rocco
464 15 Dominick Rocco
pidpart - 7db:
465 15 Dominick Rocco
prod_pidpart_S14-05-08_fardet_cosmics_p1_7db_good
466 15 Dominick Rocco
467 15 Dominick Rocco
reco - 4db:
468 15 Dominick Rocco
prod_reco_S14-05-08_fardet_cosmics_p1_4db_good
469 15 Dominick Rocco
470 15 Dominick Rocco
reco - 7db:
471 15 Dominick Rocco
prod_reco_S14-05-08_fardet_cosmics_p1_7db_good
472 15 Dominick Rocco
473 15 Dominick Rocco
h3. Comments on Livetime
474 15 Dominick Rocco
475 15 Dominick Rocco
In terms of livetime, the 4db sample is much larger than the 7db sample.  The 4db PID sample is roughly ten times larger than that used for Neutrino 2014.  The four diblock CAF sample is currently twice the size of the Neutrino sample, although it's growing.  The CAFMaking process has been tedious due to CAFMaker crashes*, and the sample will never be as large as the PID sample as a result.  The 7db sample, in terms of livetime, is roughly the same size as the Neutrino 2014 sample.  However, that detector configuration has 75 percent more detector mass.  The same caveat applies to the size of the CAF sample.  
476 15 Dominick Rocco
477 15 Dominick Rocco
h4.  Processing history
478 15 Dominick Rocco
479 15 Dominick Rocco
The processing history for these files is as follows:
480 15 Dominick Rocco
Reco:  S14-05-08 - Notably, this tag resolves the KalmanTrack association bug 
481 1 Gavin Davies
PID: S14-05-12 - Loose nue preselection 
482 39 Matthew Tamsett
CAF: S14-07-11 - Uses LiveGeometry, but gets the CAF metadata right.