Continuous Integration (CI) » lar_ci

When setting tests in a sequence, so that, e.g.

• tests depend one on the other: B depends on A, C depends on B, ... if Fermilab Redmine were not broken, this would show the relations:
  Error executing the graphviz macro (No such file or directory - /usr/bin/dot)
• the test suite includes all the tests in the sequence: A B C

and a upstream test fail (e.g. A), the depending tests are skipped. The bug is in the report of the failure: if a test depends on another test that was skipped, that skipped test appears to generate another report. In this example, A failure would be reported once as expected, failure of B, due to failure of prerequisite A, would be reported twice (when trying to run B and C), while C failure would be reported only once.
An example of actual output:

The current parallel limit is: 5
Test Suite:  seq_test_sbndcode
Expanded:  ci_reco_basic_regression_seq_test_sbndcode ci_gen_regression_seq_test_sbndcode ci_detsim_regression_seq_test_sbndcode ci_g4_regression_seq_test_sbndcode
      Start  1: ci_gen_regression_seq_test_sbndcode
ERROR: Expected Output file 'hist-sbnd_ci_sbndcode_seq_single_gen-current.root' does not exist.
ERROR: Expected Output file 'hist-sbnd_ci_sbndcode_seq_single_gen-current.root' is not a root file.
 1/ 4 Test  #1: ci_gen_regression_seq_test_sbndcode ..   Failed
copy_out_results check point None false None None False
      Skip   2: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed
 2/ 4 Test  #2: ci_g4_regression_seq_test_sbndcode ..   Skipped
      Skip   2: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed a
 3/ 4 Test  #3: ci_g4_regression_seq_test_sbndcode ..   Skipped
      Skip   3: ci_detsim_regression_seq_test_sbndcode -- prereq ci_g4_regression_seq_test_sbndcode failed
 4/ 4 Test  #4: ci_detsim_regression_seq_test_sbndcode ..   Skipped
      Skip   3: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed a
 5/ 4 Test  #5: ci_g4_regression_seq_test_sbndcode ..   Skipped
      Skip   3: ci_detsim_regression_seq_test_sbndcode -- prereq ci_g4_regression_seq_test_sbndcode failed a
 6/ 4 Test  #6: ci_detsim_regression_seq_test_sbndcode ..   Skipped
      Skip   4: ci_reco_basic_regression_seq_test_sbndcode -- prereq ci_detsim_regression_seq_test_sbndcode failed
 7/ 4 Test  #7: ci_reco_basic_regression_seq_test_sbndcode ..   Skipped

0 tests passed (0%), 1 tests failed, 0 tests with warnings, 6 tests skipped, out of 7
Not updating any reference files

where the sequence of tests is ci_gen_regression_seq_test_sbndcode ci_g4_regression_seq_test_sbndcode ci_detsim_regression_seq_test_sbndcode ci_reco_basic_regression_seq_test_sbndcode.