Feature #21224
Request change in numbering and ordering of unit tests
Description
Art opened the SNOW ticket RITM0741181 with this request.
Can I ask that the individual tests in the report for a particular CI run (e.g. (e.g. at http://dbweb5.fnal.gov:8080/ArtCI/app/build_detail/phase_details?build_id=art_ci/3165&platform=Linux%202.6.32-754.2.1.el6.x86_64&phase=unit_test&buildtype=slf6%20e19:debug%20develop) are:
Have the CMake-assigned test number (if present) shown for each test.
Partitioned according to pass / fail (as now); and
Sorted within a partition according to completion order from The CMake log (preferable) or at least the start order (CMake test number)?
This will:
Allow the faster diagnosis of certain kinds of failure;
Make it easier to correlate information between the CI log and (e.g.) the CMake test log.
Thanks,
Chris.
An example of CMake test log is: http://dbweb6.fnal.gov:8080/ArtCI/app/storage/docs/2018/10/24/unit_test__T4rkXew.log
[...] Start 725: ES_w02 1/847 Test #665: test_tiered_input_01a_runs_t ....................... Passed 3.45 sec [...]
In this snippet the index after Start
is the CMake-assigned
test number, this index is known as soon the unit test starts.
In the second raw 1
is the index related to the completion order from The CMake log
, 847
is the total number of unit tests and #665
is the CMake-assigned
test number. Here the index related to the completion order from The CMake log
is known only when the unit test is completed.
Associated revisions
History
#1 Updated by Vito Di Benedetto about 2 years ago
- Target version changed from v1_9_0_RC to v1_8_0_RC
#2 Updated by Vladimir Podstavkov almost 2 years ago
- Estimated time set to 12.00 h
- % Done changed from 0 to 30
- Status changed from Assigned to Work in progress
#3 Updated by Vladimir Podstavkov almost 2 years ago
- % Done changed from 30 to 90
#4 Updated by Vladimir Podstavkov almost 2 years ago
- % Done changed from 90 to 100
- Status changed from Work in progress to Resolved
#5 Updated by Vito Di Benedetto almost 2 years ago
- Status changed from Resolved to Closed
added support for #21224 about change in numbering and ordering of unit tests