Project

General

Profile

Automated Validation » History » Version 13

Julia Yarba, 02/08/2019 03:14 PM

1 7 Julia Yarba
h1. GENIE AVS CI - Automated Validation
2 1 Gabriel Perdue
3 3 Julia Yarba
h2. General Information
4 3 Julia Yarba
5 3 Julia Yarba
GENIE AVS CI is GENIE Automated Validation Suite combined with the "Continuous Integration (CI) services":https://cdcvs.fnal.gov/redmine/projects/ci.
6 3 Julia Yarba
7 3 Julia Yarba
The procedure can be subdivided into 2 categories:
8 3 Julia Yarba
* GENIE CI build(s) "on commit"
9 3 Julia Yarba
** Triggered every time when new code is committed (to GitHib) to either Generator, Reweighs, or Comparisons package (given 20min wait time, to allow consolidation of multiple commits within a short time frame)
10 3 Julia Yarba
** Includes the followjng steps:
11 3 Julia Yarba
*** Checkout from GitHub
12 3 Julia Yarba
*** Build of all 3 packages
13 3 Julia Yarba
*** Execution of Unit Tests
14 8 Julia Yarba
*** "Operational" test which includes 
15 8 Julia Yarba
a) generation of minimalistic cross section splines for the CCQE process 
16 9 Julia Yarba
b) generation of 5 CCQE events using splines generated in a) 
17 8 Julia Yarba
both are done for the Default tune   
18 3 Julia Yarba
* GENIE Validation workflow is triggered weekly (on Friday's)
19 3 Julia Yarba
** GENIE build, Unit Tests, and "operational" test,  as described above
20 7 Julia Yarba
** Benchmark of GENIE generated predictions vs a variety of experimental datasets; the list of benchmarks can be found "here":https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki/grid_phase
21 3 Julia Yarba
22 5 Julia Yarba
Results are reported to the dedicated "GENIEMC Slack channel":https://geniemc.slack.com/messages/C50RB57JS/convo/GA63C15T7-1539263877.000100/ (password may be needed)
23 12 Julia Yarba
Each report includes link(s) to the "GENIE CI dashboard":http://genie-ci-history.fnal.gov/GenieCI/app/view_builds/index for further details (log files, plot books, etc.)
24 5 Julia Yarba
25 13 Julia Yarba
Various technical details can also be found in the presentation at the GENIE meetings; see later in this document.
26 3 Julia Yarba
27 3 Julia Yarba
h2. Presentations on GENIE AVS CI
28 3 Julia Yarba
29 6 Julia Yarba
* "GENIE AVS CO Overview at the STWG meeting on 6/13/2018":https://cdcvs.fnal.gov/redmine/attachments/52114/GENIE-AVS-CI-Status-June2018.pdf
30 3 Julia Yarba
NOTE: A few details may be slightly out of date as a result of updates implemented since June 2018
31 3 Julia Yarba
32 10 Julia Yarba
h2. How to Launch GENIE AVS CI
33 3 Julia Yarba
34 3 Julia Yarba
GENIE "on commit" and/or weekly AVS CI are triggered automatically.
35 3 Julia Yarba
36 3 Julia Yarba
However, the procedure can be triggered at any given moment, if needs be.
37 3 Julia Yarba
38 3 Julia Yarba
Any authorized GENIE developer can trigger one or another workflow, following "these instructions": https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki
39 1 Gabriel Perdue
40 2 Julia Yarba
h2. Legacy Information 
41 2 Julia Yarba
42 2 Julia Yarba
* Meetings
43 2 Julia Yarba
*** [[AVS - April 2, 2015]]