Project

General

Profile

Novaart » History » Version 338

Erika Catano Mur, 08/07/2020 01:39 PM

1 229 Dominick Rocco
{{>toc}}
2 1 Brian Rebel
3 1 Brian Rebel
h1. NOvA on ART Wiki
4 1 Brian Rebel
5 110 Arthur Kreymer
This is the wiki page for NOvA Computing.
6 1 Brian Rebel
7 1 Brian Rebel
The NOvASoft software is written in C++ and built on the "ROOT":http://root.cern.ch data analysis software. 
8 110 Arthur Kreymer
We use the Fermilab 'Art' framework.
9 1 Brian Rebel
10 158 Brian Rebel
*+To obtain permission to use this site and the repository:+*
11 157 Brian Rebel
12 158 Brian Rebel
*1) Log onto redmine with your Services Account*
13 219 Jonathan Davies
*2) You will be added as a developer*
14 1 Brian Rebel
15 228 Dominick Rocco
"*Search all NOvA subprojects*":https://cdcvs.fnal.gov/redmine/projects/nova-cvs/search?utf8=%E2%9C%93&q=&scope=subprojects&all_words=&all_words=1&titles_only=&issues=1&news=1&documents=1&changesets=1&wiki_pages=1&messages=1&commit=Submit
16 228 Dominick Rocco
17 306 Gavin Davies
h1. [[Collaboration Bulletin Board]]
18 306 Gavin Davies
19 285 Justin Vasel
h1. A Newcomer's Guide to Getting Started
20 285 Justin Vasel
21 285 Justin Vasel
*Welcome to the NOvA Collaboration!* If you're new here, it can be hard to know where to start. Follow the steps below to get up and running quickly.
22 285 Justin Vasel
23 324 Justin Vasel
# Get set up with [[Fermilab Computing Access]]
24 324 Justin Vasel
# Confirm you can access resources by [[Using NOvASoft on the GPVM nodes]]
25 324 Justin Vasel
# [[Get Started with Slack]]
26 324 Justin Vasel
# Subscribe to relevant [[Mailing Lists]]
27 335 Teresa Lackey
# If you're a grad student or postdoc, join "Young NOvA":https://nova-exp.fnal.gov/governance/young-nova.html
28 324 Justin Vasel
# Familiarize yourself with NOvA's [[Policies]] (These include details regarding shifting, authorship, and the proper use of data)
29 285 Justin Vasel
30 115 Arthur Kreymer
h1. NOvA Computing Resources
31 1 Brian Rebel
32 324 Justin Vasel
* [[Fermilab Computing Access]]
33 324 Justin Vasel
** "FIFE":https://cdcvs.fnal.gov/redmine/projects/fife/wiki/
34 324 Justin Vasel
* [[Fermilab VPN access]]
35 324 Justin Vasel
* [[Authentication]]
36 324 Justin Vasel
* [[Disks]]
37 324 Justin Vasel
* [[Maintenance|Computing Maintenance]] _Usually the Third Thursday of each month_
38 324 Justin Vasel
* [[Using NOvASoft on the GPVM nodes]]
39 324 Justin Vasel
* [[Installing a local copy of NOvASoft and the external products]]
40 324 Justin Vasel
* [[Installing a local copy of a tagged release]]
41 324 Justin Vasel
* [[Using Condor and Running on Grid from IF Cluster Machines|Running on the Grid]]
42 324 Justin Vasel
* [[NOvA Computing Do's and Don'ts]]
43 324 Justin Vasel
* [[Devs SVN access|Devs SVN Repository Access]]
44 324 Justin Vasel
* [[Using CernVM-FS  (CVMFS)]]
45 324 Justin Vasel
* [[Using Docker with NOvA Software]]
46 324 Justin Vasel
* [[All Things macOS]]
47 256 Alexander Himmel
48 40 Mayly Sanchez
h1. How to Use and Write NOvASoft code
49 1 Brian Rebel
50 324 Justin Vasel
* [[The NOvA Offline Workbook]]
51 324 Justin Vasel
* [[Documentation FOR BEGINNERS]]
52 333 Christopher Backhouse
** "Tutorial and Workshop Videos":https://nusoft.fnal.gov/nova/tutorials/tutorials.php
53 324 Justin Vasel
** [[NOvA Vocabulary and Jargon]]
54 324 Justin Vasel
** [[SRT and SVN (Minimal Guide)]]
55 324 Justin Vasel
* [[Using the Framework]]
56 324 Justin Vasel
* "ART Workbook":http://art.fnal.gov/art-workbook/
57 324 Justin Vasel
* [[Editing Code]]
58 324 Justin Vasel
* [[Editing Code with CMake and buildtool|Editing Code with CMake and mrb]]
59 324 Justin Vasel
* [[Using artmod]]
60 324 Justin Vasel
* [[Adding a package to NOvASoft]]
61 324 Justin Vasel
* [[Running Jobs|Running Jobs (including how to use fhicl)]]
62 324 Justin Vasel
** "Submitting NOvA ART jobs to the grid":https://cdcvs.fnal.gov/redmine/projects/novaart/wiki/Submitting_NOvA_ART_Jobs
63 324 Justin Vasel
   Additional ART documentation 
64 324 Justin Vasel
  (via the mu2e experiment, until the ART developers can write/distribute their own)
65 324 Justin Vasel
  (_Don't complain to mu2e or Rob Kutschke if it doesn't apply to NOvA_)
66 324 Justin Vasel
** Using FHICL "quick start guide and formal spec":https://cdcvs.fnal.gov/redmine/projects/fhicl/wiki  "mu2e notes":http://mu2e.fnal.gov/public/hep/computing/runtimeconfig.shtml
67 324 Justin Vasel
** "Using Paths":http://mu2e.fnal.gov/public/hep/computing/Paths.shtml
68 324 Justin Vasel
** "Using ART Services":http://mu2e.fnal.gov/public/hep/computing/Services.shtml
69 324 Justin Vasel
** "Native ART Services":http://mu2e.fnal.gov/public/hep/computing/artNativeServices.shtml
70 324 Justin Vasel
** "Possibly others under the art section here":http://mu2e.fnal.gov/public/hep/computing/gettingstarted.shtml
71 324 Justin Vasel
** Need to know what values were used from fhicl files to fill a @fhicl::ParameterSet@  passed to a job module?
72 324 Justin Vasel
     @% config_dumper@ _art_framework_event_file.root_
73 68 Robert Hatcher
74 324 Justin Vasel
* [[Running the EventDisplay]]
75 334 Erica Smith
* [[Using VNC Connections on the novagpvms]]
76 324 Justin Vasel
* "Use the RandomNumberGenerator Service":http://mu2e.fnal.gov/public/hep/computing/Random.shtml (*NB* the code examples are from the older fw implementation)
77 324 Justin Vasel
* [[Using Associations]]
78 324 Justin Vasel
* [[CAF ROOT Macros and PyROOT]]
79 324 Justin Vasel
* [[CAF Tree Structure and Variable Listing]]
80 324 Justin Vasel
* [[Running event mixer ]]
81 324 Justin Vasel
* [[Tech Notes and Other Important Documents]]
82 324 Justin Vasel
* [[How Stuff Works]]
83 324 Justin Vasel
* [[Third analysis todo list]]
84 324 Justin Vasel
* [[nova_ci:|Continuous Integration]]
85 170 Gavin Davies
86 170 Gavin Davies
h1. Troubleshooting
87 170 Gavin Davies
88 324 Justin Vasel
* [[Trouble Shooting and Gotchas]]
89 324 Justin Vasel
* [[art2 Changes]]
90 188 Dominick Rocco
91 188 Dominick Rocco
h1. Documents and Other Materials 
92 188 Dominick Rocco
93 324 Justin Vasel
* [[Tech Notes and Other Important Documents]]
94 324 Justin Vasel
* "Blessed Plots and Figures Gallery":http://nusoft.fnal.gov/nova/blessedplots/
95 324 Justin Vasel
* [[Blessed Plots Instructions]]
96 324 Justin Vasel
* [[Detector Specifications]]
97 188 Dominick Rocco
98 138 Christopher Backhouse
h1. NOvA Groups
99 138 Christopher Backhouse
100 138 Christopher Backhouse
h2. Data Quality
101 138 Christopher Backhouse
102 324 Justin Vasel
 * "Redmine":https://cdcvs.fnal.gov/redmine/projects/datacheck/wiki
103 138 Christopher Backhouse
104 138 Christopher Backhouse
h2. Watchdogs
105 138 Christopher Backhouse
106 324 Justin Vasel
 * "Redmine":https://cdcvs.fnal.gov/redmine/projects/novawatchdog/wiki
107 138 Christopher Backhouse
108 138 Christopher Backhouse
h2. Beam
109 138 Christopher Backhouse
110 324 Justin Vasel
* [[Running NOvA Beam Simulations]]
111 324 Justin Vasel
* "Dk2Nu Format Flux Files":https://cdcvs.fnal.gov/redmine/projects/dk2nu/wiki
112 324 Justin Vasel
* "FluxReader Wiki":https://cdcvs.fnal.gov/redmine/projects/fluxreader/wiki
113 324 Justin Vasel
* "PPFX, Package to Predict the FluX":https://cdcvs.fnal.gov/redmine/projects/ppfx/wiki/PPFX
114 138 Christopher Backhouse
115 138 Christopher Backhouse
116 1 Brian Rebel
h2. SAM
117 138 Christopher Backhouse
118 324 Justin Vasel
* "Documentation and HowTo's (Redmine)":https://cdcvs.fnal.gov/redmine/projects/nova_sam/wiki
119 324 Justin Vasel
* "Issue Tracker":https://cdcvs.fnal.gov/redmine/projects/nova_sam/issues
120 324 Justin Vasel
* "New Issue":https://cdcvs.fnal.gov/redmine/projects/nova_sam/issues/new
121 153 Gavin Davies
122 138 Christopher Backhouse
h2. Production
123 138 Christopher Backhouse
124 138 Christopher Backhouse
Links for general users. 
125 254 Alexander Himmel
126 324 Justin Vasel
* "Official datasets":http://nusoft.fnal.gov/nova/production/datasets/overview.html
127 324 Justin Vasel
* "Production testing":http://nusoft.fnal.gov/nova/production/testing/index.html
128 324 Justin Vasel
* [[Period and Epoch Naming]]
129 324 Justin Vasel
* [[Disk Usage]]
130 324 Justin Vasel
* [[So You Want to Make Some Monte Carlo (A Qwik Start Guide for non-Productioners)]]
131 324 Justin Vasel
* "Flux File Handling":https://cdcvs.fnal.gov/redmine/projects/nusoftart/wiki/Flux_File_Handling
132 324 Justin Vasel
* [[2016 Miniproduction]]
133 324 Justin Vasel
* [[2019 Miniproduction]]
134 326 Evan Niner
* [[Production FCLs and module configuration]]
135 319 Alexander Himmel
136 254 Alexander Himmel
For the production group:
137 254 Alexander Himmel
138 324 Justin Vasel
* "Production Wiki":https://cdcvs.fnal.gov/redmine/projects/nova-production/wiki
139 1 Brian Rebel
140 138 Christopher Backhouse
h2. Reconstruction
141 138 Christopher Backhouse
142 324 Justin Vasel
* "Reconstruction Redmine":https://cdcvs.fnal.gov/redmine/projects/nova_reconstruction
143 1 Brian Rebel
* "CVN":https://cdcvs.fnal.gov/redmine/projects/nova_reconstruction/wiki/CVN
144 1 Brian Rebel
* [[List of reconstruction changes since the prod2calib branch]]
145 1 Brian Rebel
* [[New CAFs (feature_caf_size) notes]]
146 1 Brian Rebel
* "Reconstruction in production 4 campaign":https://cdcvs.fnal.gov/redmine/projects/nova_reconstruction/wiki/Prod4_tag
147 1 Brian Rebel
* [[Production 5]]
148 1 Brian Rebel
*  "Reconstruction in production 5 campaign":https://cdcvs.fnal.gov/redmine/projects/nova_reconstruction/wiki/Prod5_tag
149 1 Brian Rebel
* "HDF5 at NOvA":https://cdcvs.fnal.gov/redmine/projects/nova_reconstruction/wiki/HDF5
150 1 Brian Rebel
151 336 Erika Catano Mur
h2. Detector systematics
152 336 Erika Catano Mur
153 338 Erika Catano Mur
* [[DetSysts_BulletinBoard | DetSysts Bulletin board]]
154 336 Erika Catano Mur
* [[Relative_calibration| Relative calibration]]
155 1 Brian Rebel
* [[Absolute_calibration| Absolute calibration]]
156 337 Erika Catano Mur
157 336 Erika Catano Mur
158 336 Erika Catano Mur
h2. Simulation (historical)
159 336 Erika Catano Mur
160 336 Erika Catano Mur
* [[Running_NOvA_Simulations|Running Detector Simulations]]
161 336 Erika Catano Mur
* [[Running MC Validation]]
162 336 Erika Catano Mur
* [[Known limitations of the simulation]]
163 336 Erika Catano Mur
* [[Flat Neutrino Event Spectra Generation]]
164 336 Erika Catano Mur
* [[Central value weights]]
165 336 Erika Catano Mur
* [[Production 5]]
166 336 Erika Catano Mur
167 336 Erika Catano Mur
h2. Calibration (historical)
168 138 Christopher Backhouse
169 324 Justin Vasel
* [[Which Calibration Tag Should I Use?]]
170 324 Justin Vasel
* [[Calibration tags]]
171 324 Justin Vasel
* [[Calibration-tagging]]
172 324 Justin Vasel
* [[Production 5]]
173 138 Christopher Backhouse
174 322 Jeremy Wolcott
h2. Three-flavor (joint numu+nue) analysis
175 1 Brian Rebel
176 322 Jeremy Wolcott
* [[Reproducing the 2019 joint analysis]]
177 330 Erika Catano Mur
* [[Reproducing the 2020 joint analysis]]
178 322 Jeremy Wolcott
* [[numu details]]
179 322 Jeremy Wolcott
* [[nue details]]
180 323 Jeremy Wolcott
* [[Convergence and modernization punch list]]
181 331 Nitish Nayak
* "Making Concats":https://cdcvs.fnal.gov/redmine/projects/novaart/wiki/Making_Concats
182 322 Jeremy Wolcott
183 322 Jeremy Wolcott
h2. numu analysis (historical)
184 322 Jeremy Wolcott
185 245 Kirk Bays
* [[General numu analysis details]]
186 245 Kirk Bays
* [[Reproducing numu First Analysis results]]
187 286 Erika Catano Mur
* [[Reproducing numu Second Analysis results]]
188 293 Diana Patricia Mendez
* [[Reproducing numu 2017 Analysis results]]
189 184 Keith Matera
* [[Reproducing numu 2018 Analysis results]]
190 313 Michael Baird
* [[Far/Near energy spectrum extrapolation]]
191 1 Brian Rebel
* [[Notes for 2019/2020 Analyses]]
192 184 Keith Matera
193 322 Jeremy Wolcott
h2. nue analysis (historical)
194 169 Gavin Davies
195 265 Erika Catano Mur
196 265 Erika Catano Mur
* [[General nue analysis details]]
197 210 Christopher Backhouse
* [[Reproducing the nue First Analysis results]]
198 243 Christopher Backhouse
* [[Reproducing the nue Second Analysis results]]
199 282 Christopher Backhouse
* [[Reproducing the nue 2017 Analysis results]]
200 311 Christopher Backhouse
* [[Reproducing the nue 2018 Analysis|Reproducing the nue 2018 Analysis results]]
201 314 Ashley Back
202 314 Ashley Back
* [[Ideas for the next nue analysis]]
203 318 Michael Baird
* [[nue datasets|nue SA-era datasets]]
204 318 Michael Baird
* [[LEM processing using the dropbox]]
205 318 Michael Baird
* [[reach|Future sensitivities]]
206 318 Michael Baird
207 318 Michael Baird
* [[What we know about the E/hit discrepancy]]
208 318 Michael Baird
209 318 Michael Baird
* [[Systematics strategy]]
210 318 Michael Baird
211 318 Michael Baird
212 261 Siva Kasetti
h2. nus analysis
213 242 Gavin Davies
214 261 Siva Kasetti
* [[nus Overview]]
215 261 Siva Kasetti
* [[nus datasets]]
216 242 Gavin Davies
217 262 Siva Kasetti
h2. SBL Joint Analysis
218 262 Siva Kasetti
219 262 Siva Kasetti
* [[SBL Overview]]
220 262 Siva Kasetti
* [[SBL Datasets]]
221 262 Siva Kasetti
222 244 Kanika Sachdev
h2. ND analyses
223 244 Kanika Sachdev
224 244 Kanika Sachdev
* [[Extracting flux from gsimple files]]
225 247 Christopher Backhouse
* [[CAFAna-for-cross-sections workshop, 2016]]
226 274 Daniel Pershey
* [[Reproducing the CCPi02017 Analysis]]
227 244 Kanika Sachdev
228 169 Gavin Davies
h2. Exotics analysis
229 169 Gavin Davies
230 324 Justin Vasel
* [[Generating a multipoint lookup table]]
231 324 Justin Vasel
* [[Generating a GENIE flux file using WimpSim]]
232 324 Justin Vasel
* [[LDM and HNL]]
233 324 Justin Vasel
* [[Neutron-Antineutron Oscillation Analysis]]
234 225 Keith Matera
235 324 Justin Vasel
236 232 Christopher Backhouse
h2. CAFAna
237 233 Christopher Backhouse
238 232 Christopher Backhouse
* [[CAFAna resources]]
239 238 Christopher Backhouse
* [[CAFAna overview]]
240 234 Christopher Backhouse
* [[ModularExtrap]]
241 235 Christopher Backhouse
* [[CAFAna systematics]]
242 278 Christopher Backhouse
* [[CAFAna on the grid]]
243 321 Erika Catano Mur
* [[Adjusting your macro to SRProxy]]
244 320 Jeremy Wolcott
* [[Adjusting your macro after the Stan Bayesian MCMC merge]]
245 232 Christopher Backhouse
* [[Using Stan Bayesian MCMC for fitting]]
246 225 Keith Matera
247 225 Keith Matera
h2. FNEX
248 225 Keith Matera
249 225 Keith Matera
* [[FNEX Analysis Framework]]
250 303 Kirk Bays
251 303 Kirk Bays
h2. Cross-section tuning
252 304 Kirk Bays
253 304 Kirk Bays
* [[Relevant x-sec literature]]
254 160 Robert Mina
* [[Current x-sec to-dos]]
255 64 Andrew Norman
256 56 Robert Hatcher
h1. Data and Monte Carlo Files
257 59 Robert Hatcher
 
258 324 Justin Vasel
* [[Data]]
259 324 Justin Vasel
* [[SamDataSets | Defining and Using Datasets]]
260 324 Justin Vasel
* [[Finding_Monte_Carlo_files_at_FNAL|Monte Carlo]]  (old location "Monte Carlo":https://cdcvs.fnal.gov/redmine/projects/nova-cvs/wiki/Finding_Monte_Carlo_files_at_FNAL)
261 324 Justin Vasel
* [[GSimpleNtpFlux|NOvA GSimpleNtpFlux files]]
262 324 Justin Vasel
* [[What is in a file?]]
263 324 Justin Vasel
* [[Trimming Files|Removing Objects from Art Files]]
264 133 Andrew Norman
   
265 133 Andrew Norman
h1. The NuMI Beam
266 133 Andrew Norman
267 324 Justin Vasel
* "NuMI Beam Monitoring":http://dbweb0.fnal.gov/ifbeam/numimon/Display
268 324 Justin Vasel
* "NuMI Beam Devices Monitoring (Nova Standard)":http://dbweb0.fnal.gov/ifbeam/vmon/index?list=nova_standard
269 324 Justin Vasel
* "NuMI Spill Monitoring (Big Green Button)":http://dbweb0.fnal.gov/ifbeam/app/a9_monitor
270 324 Justin Vasel
* "Accessing the NuMI Beam Data":https://cdcvs.fnal.gov/redmine/projects/ifdhc/wiki/BeamFolders
271 215 Alexander Himmel
272 215 Alexander Himmel
h1. Releases
273 220 Alexander Himmel
274 324 Justin Vasel
* [[NOvA Snapshot and Release Policy|Snapshots, Releases, and Feature Branches]]
275 324 Justin Vasel
* [[History of Tagged Releases]]
276 12 Brian Rebel
277 6 Brian Rebel
h1. Package, Release listings and other tools
278 125 Ryan Patterson
 
279 324 Justin Vasel
* [[Complete list of NOvASoft packages]]
280 324 Justin Vasel
* [[novasoft externals]]
281 324 Justin Vasel
* [[Code Review Information]]
282 324 Justin Vasel
* "cppcheck static analysis results":http://nusoft.fnal.gov/nova/cppcheck/
283 324 Justin Vasel
* [[Performance Checking]] (using google-perftools)
284 324 Justin Vasel
* "NOvA-ART doxygen source code browser":http://nusoft.fnal.gov/nova/novasoft/doxygen/html/index.html
285 324 Justin Vasel
* "NOvA-ART CVS repository browser":http://cdcvs.fnal.gov/cgi-bin/fnal-only/cvsweb-oss.cgi/?cvsroot=novaart
286 324 Justin Vasel
* "NOvA-ART CVS repository browser. LXR version":http://cdcvs.fnal.gov/lxr/novaart/
287 324 Justin Vasel
* [[NOvA Software in CVMFS]]
288 324 Justin Vasel
* [[Setting up NOvA Software on your Laptop]]
289 324 Justin Vasel
* [[About ccache]]
290 324 Justin Vasel
* [[Job and Grid Monitoring Tools]]
291 324 Justin Vasel
* [[Production Infrastructure and Scripts]]
292 324 Justin Vasel
* [[novacompadmin|Administration]]
293 324 Justin Vasel
* [[Archives of Former Nova Users]]
294 324 Justin Vasel
* [[_SAM_Jobsub_and_Data_Handling_Quick_Links|Offline Quick Links (Jobs Monitoring, SAM, Data Handling)]]
295 1 Brian Rebel
296 1 Brian Rebel
h1. ART code repositories, mailing lists, issue reporting
297 77 Brian Rebel
298 77 Brian Rebel
* "ART":https://cdcvs.fnal.gov/redmine/projects/art/repository
299 77 Brian Rebel
* "CETLIB":https://cdcvs.fnal.gov/redmine/projects/cetlib/repository
300 77 Brian Rebel
* "Message Facility":https://cdcvs.fnal.gov/redmine/projects/messagefacility/repository
301 78 Christopher Backhouse
* "FHICL":https://cdcvs.fnal.gov/redmine/projects/fhicl-cpp/repository
302 78 Christopher Backhouse
* LXR code browsers
303 78 Christopher Backhouse
> * "ART":http://cdcvs.fnal.gov/lxr/art/
304 78 Christopher Backhouse
> * "CETLIB":http://cdcvs.fnal.gov/lxr/cetlib/
305 78 Christopher Backhouse
> * "CPP0X":http://cdcvs.fnal.gov/lxr/cpp0x/
306 77 Brian Rebel
> * "FHICL":http://cdcvs.fnal.gov/lxr/fhiclcpp/
307 135 Brian Rebel
> * "Message Facility":http://cdcvs.fnal.gov/lxr/messagefacility/     
308 77 Brian Rebel
* "Issue Tracker":https://cdcvs.fnal.gov/redmine/projects/art/issues/new Please report issues to the ART developers using the ART Redmine project. Reporting issues in this matter keeps you in the loop with respect to work on the issue.
309 159 Dominick Rocco
* "ART Workbook":https://web.fnal.gov/project/artdoc/sitepages/home.aspx ART Documentation aimed at multiple levels.
310 1 Brian Rebel
* art-users@fnal.gov - an open-post, open membership list with archive for community questions about ART, user announcements, etc.
311 114 Arthur Kreymer
* artists@fnal.gov - an open-post, closed-membership list with private archive for directed questions to experts and private discussions among developers.
312 1 Brian Rebel
313 1 Brian Rebel
314 1 Brian Rebel
h1. Database
315 1 Brian Rebel
 
316 324 Justin Vasel
* [[DatabaseDocumentation|Documentation]]
317 324 Justin Vasel
* [[Database#RunHistory | The Run History Interface]]
318 49 Mark Messier
319 49 Mark Messier
h1. Getting Help
320 49 Mark Messier
321 324 Justin Vasel
* [[General Computing]]
322 324 Justin Vasel
* [[Grid Computing]]
323 324 Justin Vasel
* [[Art Framework]]
324 33 Jonathan Paley
325 107 Jan Zirnstein
h1. Fermilab NOvASoft Build Logs
326 107 Jan Zirnstein
327 212 Jonathan Davies
The nightly build is split into three parts:
328 212 Jonathan Davies
329 212 Jonathan Davies
# *Jenkins Build Status* -- the actual build on the Jenkins build management system
330 212 Jonathan Davies
# *Jenkins Nightly / Release Download Log* -- Automatic downloading of any successful build to temporary location (the build machine)
331 212 Jonathan Davies
# *Nightly Build cronjob Logs* -- Cronjobs that update the GPVM nodes (update setup_nova, copy last build of development into place from the build machine)
332 212 Jonathan Davies
333 212 Jonathan Davies
There is a check in the process trying to prevent broken builds being copied into place.
334 212 Jonathan Davies
335 212 Jonathan Davies
* If the Actual Build is a success -> Copying of the build to temporary location proceeds overwriting the last build stored in the temporary location
336 212 Jonathan Davies
337 212 Jonathan Davies
It is possible to obtain a tarball of any recent release built on the Jenkins Build system / the last week's worth of nightly builds from the links in this section:
338 212 Jonathan Davies
339 212 Jonathan Davies
* Jenkins Build - Last Succesful Build Artifacts
340 212 Jonathan Davies
341 1 Brian Rebel
h2. Jenkins (Nightly) Build Status
342 1 Brian Rebel
343 327 Justin Vasel
There is one build for each operating system (OS) currently supported - SLF6. All nodes at Fermilab are SLF6. 
344 327 Justin Vasel
Each of the OS builds has a "debug" and "maxopt" version of the build. 
345 324 Justin Vasel
346 327 Justin Vasel
* "Jenkins nightly build SLF6":https://buildmaster.fnal.gov/buildmaster/view/Nova/job/nova_SRT_slf6_nightly_build/
347 208 Jonathan Davies
348 208 Jonathan Davies
h2. Jenkins Nightly / Release Download Log
349 1 Brian Rebel
350 212 Jonathan Davies
A cronjob runs every 10 minutes checking for new builds on the Jenkins build system. If a build is detected it is checked to see if it was successful. If it is successful the build is downloaded to the novabuild01 machine. These logs have a line per release downloaded. The downloaded / logging is split by operating system (SLF5/SLF6) and by build type (nightly==development / release).
351 208 Jonathan Davies
352 208 Jonathan Davies
http://nusoft.fnal.gov/nova/novasoft/jenkins_logs/
353 208 Jonathan Davies
354 208 Jonathan Davies
* "Jenkins nightly build SLF5 download log":http://nusoft.fnal.gov/nova/novasoft/jenkins_logs/slf5/build_record_nightly
355 208 Jonathan Davies
* "Jenkins release build SLF5 download log":http://nusoft.fnal.gov/nova/novasoft/jenkins_logs/slf5/build_record_release
356 208 Jonathan Davies
357 208 Jonathan Davies
* "Jenkins nightly build SLF6 download log":http://nusoft.fnal.gov/nova/novasoft/jenkins_logs/slf6/build_record_nightly
358 208 Jonathan Davies
* "Jenkins release build SLF6 download log":http://nusoft.fnal.gov/nova/novasoft/jenkins_logs/slf6/build_record_release
359 208 Jonathan Davies
360 208 Jonathan Davies
361 1 Brian Rebel
h2. Nightly Build cronjob Logs
362 208 Jonathan Davies
363 212 Jonathan Davies
These cronjobs do things like - update the setup on the GPVM nodes, *copy in to place the nightly builds* from the novabuild01 machine to the GPVM nodes, run the datagrams, automatically detect and download all Jenkins builds of NOvA offline software releases and nightly builds (See above for minimal logging).
364 208 Jonathan Davies
365 208 Jonathan Davies
If things go awry with the nightly build this is a good place to look for problems. The logs are rotate once per day (using logrotate), with the last 5 days of logs kept. The links are to the most recent versions of each log file.
366 208 Jonathan Davies
367 208 Jonathan Davies
http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/ 
368 208 Jonathan Davies
369 208 Jonathan Davies
* "Get release from Jenkins SLF5":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/get_release_from_jenkins.slf5.release.log
370 208 Jonathan Davies
* "Get nightly build from Jenkins SLF5":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/get_release_from_jenkins.slf5.development.log
371 208 Jonathan Davies
372 208 Jonathan Davies
* "Get release from Jenkins SLF6":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/get_release_from_jenkins.slf6.release.log
373 208 Jonathan Davies
* "Get nightly build from Jenkins SLF6":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/get_release_from_jenkins.slf6.development.log
374 208 Jonathan Davies
375 208 Jonathan Davies
* "Move nightly build to GPVM nodes SLF5":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/move_novabuild.slf5.log
376 208 Jonathan Davies
* "Move nightly build to GPVM nodes SLF6":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/move_novabuild.slf6.log
377 208 Jonathan Davies
378 208 Jonathan Davies
* "Run Datagram":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/run_datagram.log
379 208 Jonathan Davies
380 208 Jonathan Davies
* "Update setup SLF5":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/update_setup.slf5.log
381 208 Jonathan Davies
* "Update setup SLF6":http://nusoft.fnal.gov/nova/novasoft/cronjob_logs/update_setup.slf6.log
382 208 Jonathan Davies
383 208 Jonathan Davies
384 1 Brian Rebel
385 1 Brian Rebel
h2. Jenkins Build - Last Succesful Build Artifacts
386 212 Jonathan Davies
387 212 Jonathan Davies
You can use these links to download the actual nightly / release build output (libraries, binaries, etc...). These links are for the most recent. You can navigate from them to older releases / nightly builds.
388 192 Jonathan Davies
389 324 Justin Vasel
* "Jenkins nightly build SLF5 tarballs":https://buildmaster.fnal.gov/view/Nova/job/nova_SRT_slf5_nightly_build_output/lastSuccessfulBuild/artifact/buildout/
390 324 Justin Vasel
* "Jenkins nightly build SLF6 tarballs":https://buildmaster.fnal.gov/view/Nova/job/nova_SRT_slf6_nightly_build_output/lastSuccessfulBuild/artifact/buildout/
391 204 Jonathan Davies
392 324 Justin Vasel
* "Jenkins release build SLF5 tarballs":https://buildmaster.fnal.gov/view/Nova/job/nova_SRT_slf5_release_build_output/lastSuccessfulBuild/artifact/buildout/
393 324 Justin Vasel
* "Jenkins release build SLF6 tarballs":https://buildmaster.fnal.gov/view/Nova/job/nova_SRT_slf6_release_build_output/lastSuccessfulBuild/artifact/buildout/
394 162 Kanika Sachdev
395 258 Pengfei Ding
h2. CI tests 
396 258 Pengfei Ding
397 324 Justin Vasel
* "NOvA CI web monitoring page":http://dbweb6.fnal.gov:8080/NovaCI/app/view_builds//index
398 324 Justin Vasel
* "Jenkins NOvA CI test project":https://buildmaster.fnal.gov/job/nova_ci/
399 324 Justin Vasel
* [[NOvA CI test user guide]]
400 258 Pengfei Ding
401 122 Dominick Rocco
402 1 Brian Rebel
h1. Other Resources
403 1 Brian Rebel
404 324 Justin Vasel
* [[Where_to_Find_Graphics_for_NOvA_Public_Presentations| Where to Find Graphics for NOvA Public Presentations]] 
405 324 Justin Vasel
* "c++.com":http://www.cplusplus.com/ - useful information on c++ programming with examples for how to use various stl objects, etc
406 324 Justin Vasel
* "ROOT: User's Gude":http://root.cern.ch/drupal/content/users-guide - the ROOT User's Guide documentation
407 324 Justin Vasel
* "Good c++ practices in ART":https://cdcvs.fnal.gov/redmine/documents/534 - some good c++ code practices in the ART framework, in particular introducing c++2011 features. Document provided by Marc Paterno.