Bug #18172
Confusing error report for tests with failing dependences
Start date:
11/09/2017
Due date:
% Done:
0%
Estimated time:
Description
When setting tests in a sequence, so that, e.g.
- tests depend one on the other:
B
depends onA
,C
depends onB
, ... if Fermilab Redmine were not broken, this would show the relations:Error executing the graphviz macro (No such file or directory - /usr/bin/dot) - the test suite includes all the tests in the sequence:
A
B
C
and a upstream test fail (e.g. A
), the depending tests are skipped. The bug is in the report of the failure: if a test depends on another test that was skipped, that skipped test appears to generate another report. In this example, A
failure would be reported once as expected, failure of B
, due to failure of prerequisite A
, would be reported twice (when trying to run B
and C
), while C
failure would be reported only once.
An example of actual output:
The current parallel limit is: 5 Test Suite: seq_test_sbndcode Expanded: ci_reco_basic_regression_seq_test_sbndcode ci_gen_regression_seq_test_sbndcode ci_detsim_regression_seq_test_sbndcode ci_g4_regression_seq_test_sbndcode Start 1: ci_gen_regression_seq_test_sbndcode ERROR: Expected Output file 'hist-sbnd_ci_sbndcode_seq_single_gen-current.root' does not exist. ERROR: Expected Output file 'hist-sbnd_ci_sbndcode_seq_single_gen-current.root' is not a root file. 1/ 4 Test #1: ci_gen_regression_seq_test_sbndcode .. Failed copy_out_results check point None false None None False Skip 2: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed 2/ 4 Test #2: ci_g4_regression_seq_test_sbndcode .. Skipped Skip 2: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed a 3/ 4 Test #3: ci_g4_regression_seq_test_sbndcode .. Skipped Skip 3: ci_detsim_regression_seq_test_sbndcode -- prereq ci_g4_regression_seq_test_sbndcode failed 4/ 4 Test #4: ci_detsim_regression_seq_test_sbndcode .. Skipped Skip 3: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed a 5/ 4 Test #5: ci_g4_regression_seq_test_sbndcode .. Skipped Skip 3: ci_detsim_regression_seq_test_sbndcode -- prereq ci_g4_regression_seq_test_sbndcode failed a 6/ 4 Test #6: ci_detsim_regression_seq_test_sbndcode .. Skipped Skip 4: ci_reco_basic_regression_seq_test_sbndcode -- prereq ci_detsim_regression_seq_test_sbndcode failed 7/ 4 Test #7: ci_reco_basic_regression_seq_test_sbndcode .. Skipped 0 tests passed (0%), 1 tests failed, 0 tests with warnings, 6 tests skipped, out of 7 Not updating any reference fileswhere the sequence of tests is
ci_gen_regression_seq_test_sbndcode
ci_g4_regression_seq_test_sbndcode
ci_detsim_regression_seq_test_sbndcode
ci_reco_basic_regression_seq_test_sbndcode
.
History
#1 Updated by Vito Di Benedetto about 3 years ago
- Project changed from LAr-Continuous-Integration to lar_ci
#2 Updated by Vito Di Benedetto about 3 years ago
- Status changed from New to Assigned
- Assignee set to Bruno Coimbra
- Priority changed from Normal to Low