Project

General

Profile

Automated Validation » History » Version 3

« Previous - Version 3/25 (diff) - Next » - Current version
Julia Yarba, 02/08/2019 12:56 PM


GENIE AVS CI - Automated Validation

General Information

GENIE AVS CI is GENIE Automated Validation Suite combined with the Continuous Integration (CI) services.

The procedure can be subdivided into 2 categories:
  • GENIE CI build(s) "on commit"
    • Triggered every time when new code is committed (to GitHib) to either Generator, Reweighs, or Comparisons package (given 20min wait time, to allow consolidation of multiple commits within a short time frame)
    • Includes the followjng steps:
      • Checkout from GitHub
      • Build of all 3 packages
      • Execution of Unit Tests
      • "Operational" test which includes a) generation of minimalistic cross section splines for the CCQE process and b) generation of 5 CCQE events using splines generated in a); both are done for the Default tune
  • GENIE Validation workflow is triggered weekly (on Friday's)
    • GENIE build, Unit Tests, and "operational" test, as described above
    • Benchmark of GENIE generated predictions vs a variety of experimental datasets

Results are reported to the dedicated GENIEMC Slack channel https://geniemc.slack.com/messages/C50RB57JS/convo/GA63C15T7-1539263877.000100/
Each report includes link(s) to the CI dashboard for further details (log files, plot books, etc.)

Presentations on GENIE AVS CI

  • GENIE AVS CO Overview at the STWG on 6/13/2018
    NOTE: A few details may be slightly out of date as a result of updates implemented since June 2018

Instructions on launching GENIE AVS CI

GENIE "on commit" and/or weekly AVS CI are triggered automatically.

However, the procedure can be triggered at any given moment, if needs be.

Any authorized GENIE developer can trigger one or another workflow, following "these instructions": https://cdcvs.fnal.gov/redmine/projects/genie_ci/wiki

Legacy Information