Project

General

Profile

Legacy Validation » History » Version 7

Tomasz Golan, 06/02/2016 11:28 AM

1 1 Tomasz Golan
h1. Legacy Validation
2 1 Tomasz Golan
3 1 Tomasz Golan
Legacy validation (src/scripts/production/batch) was translated to python and jobsub. At this moment, the code lives here: https://github.com/TomaszGolan/legacyValidation or here: /grid/fermiapp/genie/legacyValidation/
4 1 Tomasz Golan
5 2 Tomasz Golan
General comments on running GENIE on OSG can be found here: https://cdcvs.fnal.gov/redmine/projects/genie/wiki/Running_GENIE_on_grid
6 2 Tomasz Golan
7 2 Tomasz Golan
General instruction to legacy validation can be found on github.
8 2 Tomasz Golan
9 4 Tomasz Golan
h2. Step by step
10 3 Tomasz Golan
11 3 Tomasz Golan
h3. Builds
12 3 Tomasz Golan
13 3 Tomasz Golan
* go to https://buildmaster.fnal.gov/view/GENIE/job/jenkinsTest/ 
14 3 Tomasz Golan
* choose Build with Parameters
15 5 Tomasz Golan
* choose the branch, e.g. @branches/R-2_10_6@ or @trunk@
16 1 Tomasz Golan
* every time build is called, svn repository is checked out, chosen branch is compiled and artifact is created
17 5 Tomasz Golan
* artifact name convention: @genie_[branch]_buildmaster_YYYY-MM-DD.tgz@
18 5 Tomasz Golan
* note, that name convention and link to jenkins is hard-coded in @legacyValidation/jenkins.py@
19 5 Tomasz Golan
20 5 Tomasz Golan
h3. Run legacy validation:
21 5 Tomasz Golan
22 5 Tomasz Golan
* go to @/grid/fermiapp/genie/legacyValidation/@
23 5 Tomasz Golan
* run @runLegacyValidation.py@, e.g.
24 5 Tomasz Golan
25 5 Tomasz Golan
<pre>
26 5 Tomasz Golan
./runLegacyValidation.py --genie_tag trunk --run_path /grid/fermiapp/genie/legacyValidation/runGENIE.sh --builds /grid/fermiapp/genie/builds/ --output /pnfs/genie/scratch/users/goran/legacyValidation
27 5 Tomasz Golan
</pre>
28 6 Tomasz Golan
29 6 Tomasz Golan
* first the script will grab the last artifact for @--genie_tag@ (note, you can specified build date by hand using @--build_date@ flag)
30 6 Tomasz Golan
* it will be saved / extracted in @--builds@ folder (note, this step is skipped if the build already exists in the folder)
31 6 Tomasz Golan
* @--run_path@ is required; it gives the path to @runGENIE.sh@ script which is used to run every GENIE job at grid (it handles copying input files, running GENIE command and copying output to pnfs)
32 6 Tomasz Golan
* the results will be saved in @--output@ folder under @[branch]/[build date]@ with the following structure
33 6 Tomasz Golan
34 6 Tomasz Golan
<pre>
35 6 Tomasz Golan
├── events                                           # ROOT files with event trees
36 6 Tomasz Golan
│   ├── hadronization                                # used for hadronitzation test
37 6 Tomasz Golan
│   ├── mctest                                       # used for "sanity" test
38 6 Tomasz Golan
│   ├── repeatability                                # used for repeatability test
39 6 Tomasz Golan
│   └── xsec_validation                              # used for xsec validation
40 6 Tomasz Golan
├── legacyValidation-[branch]-[build date].dag       # this is a jobsub dag file which will be submitted
41 6 Tomasz Golan
├── reports                                          # final results
42 6 Tomasz Golan
│   ├── hadronization_test                           
43 6 Tomasz Golan
│   │   └── file_list-[branch]-[build date].xml      # this is filelist xml file genrated automatically to be used for hadronization test jobs
44 6 Tomasz Golan
│   ├── repeatability_test
45 6 Tomasz Golan
│   ├── sanity_mctest
46 6 Tomasz Golan
│   └── xsec_validation
47 6 Tomasz Golan
│       ├── file_list-[branch]-[build date].xml      # this is filelist xml file genrated automatically to be used for xsec test jobs
48 6 Tomasz Golan
│       └── single_comparisons_with_errors           # script generated one set with all plots; in this folder there are plot per test but with MC errors included
49 6 Tomasz Golan
└── xsec                                             # xsec splines
50 6 Tomasz Golan
    ├── nuA                                          # for nuclei
51 6 Tomasz Golan
    └── nuN                                          # for nucleons
52 6 Tomasz Golan
</pre>
53 7 Tomasz Golan
54 7 Tomasz Golan
h3. Run branches comparison