Project

General

Profile

Automated Validation » History » Version 6

Julia Yarba, 02/08/2019 01:06 PM

1 3 Julia Yarba
h1. GENIE AVS CI - Automated Validation 
2 1 Gabriel Perdue
3 3 Julia Yarba
h2. General Information
4 3 Julia Yarba
5 3 Julia Yarba
GENIE AVS CI is GENIE Automated Validation Suite combined with the "Continuous Integration (CI) services":https://cdcvs.fnal.gov/redmine/projects/ci.
6 3 Julia Yarba
7 3 Julia Yarba
The procedure can be subdivided into 2 categories:
8 3 Julia Yarba
* GENIE CI build(s) "on commit"
9 3 Julia Yarba
** Triggered every time when new code is committed (to GitHib) to either Generator, Reweighs, or Comparisons package (given 20min wait time, to allow consolidation of multiple commits within a short time frame)
10 3 Julia Yarba
** Includes the followjng steps:
11 3 Julia Yarba
*** Checkout from GitHub
12 3 Julia Yarba
*** Build of all 3 packages
13 3 Julia Yarba
*** Execution of Unit Tests
14 3 Julia Yarba
*** "Operational" test which includes a) generation of minimalistic cross section splines for the CCQE process and b) generation of 5 CCQE events using splines generated in a); both are done for the Default tune   
15 3 Julia Yarba
* GENIE Validation workflow is triggered weekly (on Friday's)
16 3 Julia Yarba
** GENIE build, Unit Tests, and "operational" test,  as described above
17 5 Julia Yarba
** Benchmark of GENIE generated predictions vs a variety of experimental datasets; several more details can be found "here":https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki/grid_phase
18 3 Julia Yarba
19 5 Julia Yarba
Results are reported to the dedicated "GENIEMC Slack channel":https://geniemc.slack.com/messages/C50RB57JS/convo/GA63C15T7-1539263877.000100/ (password may be needed)
20 1 Gabriel Perdue
Each report includes link(s) to the CI dashboard for further details (log files, plot books, etc.)
21 5 Julia Yarba
22 5 Julia Yarba
Various technical details can also be found in the presentation at the GENIE meetings; see the next section.
23 3 Julia Yarba
24 3 Julia Yarba
h2. Presentations on GENIE AVS CI
25 3 Julia Yarba
26 6 Julia Yarba
* "GENIE AVS CO Overview at the STWG meeting on 6/13/2018":https://cdcvs.fnal.gov/redmine/attachments/52114/GENIE-AVS-CI-Status-June2018.pdf
27 3 Julia Yarba
NOTE: A few details may be slightly out of date as a result of updates implemented since June 2018
28 3 Julia Yarba
29 3 Julia Yarba
h2. Instructions on launching GENIE AVS CI
30 3 Julia Yarba
31 3 Julia Yarba
GENIE "on commit" and/or weekly AVS CI are triggered automatically.
32 3 Julia Yarba
33 3 Julia Yarba
However, the procedure can be triggered at any given moment, if needs be.
34 3 Julia Yarba
35 3 Julia Yarba
Any authorized GENIE developer can trigger one or another workflow, following "these instructions": https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki
36 1 Gabriel Perdue
37 2 Julia Yarba
h2. Legacy Information 
38 2 Julia Yarba
39 2 Julia Yarba
* Meetings
40 2 Julia Yarba
*** [[AVS - April 2, 2015]]