Project

General

Profile

Bug #18172

Confusing error report for tests with failing dependences

Added by Gianluca Petrillo almost 2 years ago. Updated almost 2 years ago.

Status:
Assigned
Priority:
Low
Assignee:
Target version:
-
Start date:
11/09/2017
Due date:
% Done:

0%

Estimated time:
Duration:

Description

When setting tests in a sequence, so that, e.g.
  • tests depend one on the other: B depends on A, C depends on B, ... if Fermilab Redmine were not broken, this would show the relations:
    Error executing the graphviz macro (Error applying external filter: stdout is , stderr is )
  • the test suite includes all the tests in the sequence: A B C

and a upstream test fail (e.g. A), the depending tests are skipped. The bug is in the report of the failure: if a test depends on another test that was skipped, that skipped test appears to generate another report. In this example, A failure would be reported once as expected, failure of B, due to failure of prerequisite A, would be reported twice (when trying to run B and C), while C failure would be reported only once.
An example of actual output:

The current parallel limit is: 5
Test Suite:  seq_test_sbndcode
Expanded:  ci_reco_basic_regression_seq_test_sbndcode ci_gen_regression_seq_test_sbndcode ci_detsim_regression_seq_test_sbndcode ci_g4_regression_seq_test_sbndcode
      Start  1: ci_gen_regression_seq_test_sbndcode
ERROR: Expected Output file 'hist-sbnd_ci_sbndcode_seq_single_gen-current.root' does not exist.
ERROR: Expected Output file 'hist-sbnd_ci_sbndcode_seq_single_gen-current.root' is not a root file.
 1/ 4 Test  #1: ci_gen_regression_seq_test_sbndcode ..   Failed
copy_out_results check point None false None None False
      Skip   2: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed
 2/ 4 Test  #2: ci_g4_regression_seq_test_sbndcode ..   Skipped
      Skip   2: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed a
 3/ 4 Test  #3: ci_g4_regression_seq_test_sbndcode ..   Skipped
      Skip   3: ci_detsim_regression_seq_test_sbndcode -- prereq ci_g4_regression_seq_test_sbndcode failed
 4/ 4 Test  #4: ci_detsim_regression_seq_test_sbndcode ..   Skipped
      Skip   3: ci_g4_regression_seq_test_sbndcode -- prereq ci_gen_regression_seq_test_sbndcode failed a
 5/ 4 Test  #5: ci_g4_regression_seq_test_sbndcode ..   Skipped
      Skip   3: ci_detsim_regression_seq_test_sbndcode -- prereq ci_g4_regression_seq_test_sbndcode failed a
 6/ 4 Test  #6: ci_detsim_regression_seq_test_sbndcode ..   Skipped
      Skip   4: ci_reco_basic_regression_seq_test_sbndcode -- prereq ci_detsim_regression_seq_test_sbndcode failed
 7/ 4 Test  #7: ci_reco_basic_regression_seq_test_sbndcode ..   Skipped

0 tests passed (0%), 1 tests failed, 0 tests with warnings, 6 tests skipped, out of 7
Not updating any reference files
where the sequence of tests is ci_gen_regression_seq_test_sbndcode ci_g4_regression_seq_test_sbndcode ci_detsim_regression_seq_test_sbndcode ci_reco_basic_regression_seq_test_sbndcode.

History

#1 Updated by Vito Di Benedetto almost 2 years ago

  • Project changed from LAr-Continuous-Integration to lar_ci

#2 Updated by Vito Di Benedetto almost 2 years ago

  • Status changed from New to Assigned
  • Assignee set to Bruno Coimbra
  • Priority changed from Normal to Low


Also available in: Atom PDF