Project

General

Profile

Feature #21224

Request change in numbering and ordering of unit tests

Added by Vito Di Benedetto about 1 year ago. Updated 9 months ago.

Status:
Closed
Priority:
Normal
Category:
-
Target version:
Start date:
10/24/2018
Due date:
% Done:

100%

Estimated time:
12.00 h
Spent time:
Experiment:
-
Stakeholders:
Duration:

Description

Art opened the SNOW ticket RITM0741181 with this request.


Can I ask that the individual tests in the report for a particular CI run (e.g. (e.g. at http://dbweb5.fnal.gov:8080/ArtCI/app/build_detail/phase_details?build_id=art_ci/3165&platform=Linux%202.6.32-754.2.1.el6.x86_64&phase=unit_test&buildtype=slf6%20e19:debug%20develop) are:

Have the CMake-assigned test number (if present) shown for each test.
Partitioned according to pass / fail (as now); and
Sorted within a partition according to completion order from The CMake log (preferable) or at least the start order (CMake test number)?

This will:

Allow the faster diagnosis of certain kinds of failure;
Make it easier to correlate information between the CI log and (e.g.) the CMake test log.

Thanks,
Chris.


An example of CMake test log is: http://dbweb6.fnal.gov:8080/ArtCI/app/storage/docs/2018/10/24/unit_test__T4rkXew.log

[...]
         Start 725: ES_w02
   1/847 Test #665: test_tiered_input_01a_runs_t .......................   Passed    3.45 sec
[...]

In this snippet the index after Start is the CMake-assigned test number, this index is known as soon the unit test starts.
In the second raw 1 is the index related to the completion order from The CMake log, 847 is the total number of unit tests and #665 is the CMake-assigned test number. Here the index related to the completion order from The CMake log is known only when the unit test is completed.

Associated revisions

Revision a1087fd5 (diff)
Added by Vito Di Benedetto 10 months ago

added support for #21224 about change in numbering and ordering of unit tests

History

#1 Updated by Vito Di Benedetto 11 months ago

  • Target version changed from v1_9_0_RC to v1_8_0_RC

#2 Updated by Vladimir Podstavkov 10 months ago

  • Estimated time set to 12.00 h
  • % Done changed from 0 to 30
  • Status changed from Assigned to Work in progress

#3 Updated by Vladimir Podstavkov 10 months ago

  • % Done changed from 30 to 90

#4 Updated by Vladimir Podstavkov 9 months ago

  • % Done changed from 90 to 100
  • Status changed from Work in progress to Resolved

#5 Updated by Vito Di Benedetto 9 months ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF