Automated Validation » History » Version 10
Julia Yarba, 02/08/2019 01:09 PM
1 | 7 | Julia Yarba | h1. GENIE AVS CI - Automated Validation |
---|---|---|---|
2 | 1 | Gabriel Perdue | |
3 | 3 | Julia Yarba | h2. General Information |
4 | 3 | Julia Yarba | |
5 | 3 | Julia Yarba | GENIE AVS CI is GENIE Automated Validation Suite combined with the "Continuous Integration (CI) services":https://cdcvs.fnal.gov/redmine/projects/ci. |
6 | 3 | Julia Yarba | |
7 | 3 | Julia Yarba | The procedure can be subdivided into 2 categories: |
8 | 3 | Julia Yarba | * GENIE CI build(s) "on commit" |
9 | 3 | Julia Yarba | ** Triggered every time when new code is committed (to GitHib) to either Generator, Reweighs, or Comparisons package (given 20min wait time, to allow consolidation of multiple commits within a short time frame) |
10 | 3 | Julia Yarba | ** Includes the followjng steps: |
11 | 3 | Julia Yarba | *** Checkout from GitHub |
12 | 3 | Julia Yarba | *** Build of all 3 packages |
13 | 3 | Julia Yarba | *** Execution of Unit Tests |
14 | 8 | Julia Yarba | *** "Operational" test which includes |
15 | 8 | Julia Yarba | a) generation of minimalistic cross section splines for the CCQE process |
16 | 9 | Julia Yarba | b) generation of 5 CCQE events using splines generated in a) |
17 | 8 | Julia Yarba | both are done for the Default tune |
18 | 3 | Julia Yarba | * GENIE Validation workflow is triggered weekly (on Friday's) |
19 | 3 | Julia Yarba | ** GENIE build, Unit Tests, and "operational" test, as described above |
20 | 7 | Julia Yarba | ** Benchmark of GENIE generated predictions vs a variety of experimental datasets; the list of benchmarks can be found "here":https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki/grid_phase |
21 | 3 | Julia Yarba | |
22 | 5 | Julia Yarba | Results are reported to the dedicated "GENIEMC Slack channel":https://geniemc.slack.com/messages/C50RB57JS/convo/GA63C15T7-1539263877.000100/ (password may be needed) |
23 | 1 | Gabriel Perdue | Each report includes link(s) to the CI dashboard for further details (log files, plot books, etc.) |
24 | 5 | Julia Yarba | |
25 | 5 | Julia Yarba | Various technical details can also be found in the presentation at the GENIE meetings; see the next section. |
26 | 3 | Julia Yarba | |
27 | 3 | Julia Yarba | h2. Presentations on GENIE AVS CI |
28 | 3 | Julia Yarba | |
29 | 6 | Julia Yarba | * "GENIE AVS CO Overview at the STWG meeting on 6/13/2018":https://cdcvs.fnal.gov/redmine/attachments/52114/GENIE-AVS-CI-Status-June2018.pdf |
30 | 3 | Julia Yarba | NOTE: A few details may be slightly out of date as a result of updates implemented since June 2018 |
31 | 3 | Julia Yarba | |
32 | 10 | Julia Yarba | h2. How to Launch GENIE AVS CI |
33 | 3 | Julia Yarba | |
34 | 3 | Julia Yarba | GENIE "on commit" and/or weekly AVS CI are triggered automatically. |
35 | 3 | Julia Yarba | |
36 | 3 | Julia Yarba | However, the procedure can be triggered at any given moment, if needs be. |
37 | 3 | Julia Yarba | |
38 | 3 | Julia Yarba | Any authorized GENIE developer can trigger one or another workflow, following "these instructions": https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki |
39 | 1 | Gabriel Perdue | |
40 | 2 | Julia Yarba | h2. Legacy Information |
41 | 2 | Julia Yarba | |
42 | 2 | Julia Yarba | * Meetings |
43 | 2 | Julia Yarba | *** [[AVS - April 2, 2015]] |