Project

General

Profile

ReleaseTestingMatrix 3 7 1 rc8

Summary

  • Test Type:
    • I: Interoperability (install if needed, submit jobs, wait for completion)
    • D: Downgrade and reconfig, submit jobs
    • U: Upgrade and reconfig, submit jobs
TEST ID TEST TYPE FACTORY version -Condor Version FRONTEND version - Condor version Result
1 I v3.6.4 - 8.8.10 v3.6.4 - 8.8.10 OK
2 U v3.6.4 - 8.8.10 v3.7.1.rc8 - 8.9.8 OK
3 U v3.7.1.rc8 - 8.9.8 v3.7.1.rc8 - 8.9.8 OK
4 D v3.6.4 - 8.8.10 v3.7.1.rc8 - 8.9.8 OK
5 D v3.6.2 - 8.8.8 v3.7.1.rc8 - 8.9.8 OK
6 D v3.6.2 - 8.8.8 v3.6.4 - 8.8.10 OK
7 D v3.6.2 - 8.8.8 v3.6.2 - 8.8.8 OK
8 U v3.7.1.rc8 - 8.9.9 v3.6.2 - 8.8.8 OK
9 U v3.7.1.rc8 - 8.9.9 v3.6.5 - 8.8.10 OK

Frontend, Factory used for a series of tests performed by dbox on 8/25/20

Host Role OS OSG
fermicloud151 Factory SL7 OSG35
fermicloud158 VOFrontend SL7 OSG35

CEs used for tests

Host OS, OSG htcondor_ce condor
fermicloud072 SL6 OSG34 3.4.0 8.8.8
fermicloud378 SL7 OSG34 3.4.0 8.8.10
fermicloud128 SL7 OSG35 4.4.1 8.9.8

Test Results Matrix

TEST ID TEST TYPE FACTORY version -Condor Version FRONTEND version - Condor version Result
1 I v3.6.4 - 8.8.10 v3.6.4 - 8.8.10 OK
2 U v3.6.4 - 8.8.10 v3.7.1.rc8 - 8.9.8 OK
3 U v3.7.1.rc8 - 8.9.8 v3.7.1.rc8 - 8.9.8 OK
4 D v3.6.4 - 8.8.10 v3.7.1.rc8 - 8.9.8 OK
5 D v3.6.2 - 8.8.8 v3.7.1.rc8 - 8.9.8 OK
6 D v3.6.2 - 8.8.8 v3.6.4 - 8.8.10 OK
7 D v3.6.2 - 8.8.8 v3.6.2 - 8.8.8 OK
  • additional tests performed by dbox on same machines for completeness on 10/7/20
TEST ID TEST TYPE FACTORY version -Condor Version FRONTEND version - Condor version Result
8 U v3.7.1.rc8 - 8.9.9 v3.6.2 - 8.8.8 OK
9 U v3.7.1.rc8 - 8.9.9 v3.6.5 - 8.8.10 OK

Test Details

  • Test 1, install and test interoperability, was performed via a 'smoke test' script.
  • The remaining tests were performed manually as the 'smoke test' does not handle errors in upgrades and downgrades gracefully.
    • The remaining tests were automated with Ansible, it seems to work well on fermicloud

Expanded Details by Test Number

  1. Install on SL7, OSG35 smoke test by Dennis Box on 9/25/20
    • Factory, v3.6.4 install, SL7, fermicloud151
    • Frontend, v3.6.4 install, SL7, fermicloud158
    • Details
      • Smoke tests ran jobs to completion on all CEs
      • Condor and GWMS logs showed no unusual errors, warnings, or python exceptions
  2. Upgrade frontend to 3.7.1, submit jobs
    • Condor had to be restarted several times for the factory and frontend to actually work together
    • all jobs ran to completion
  3. Upgrade factory to 3.7.1.rc8, submit jobs
    • no unusual log activity, all jobs ran to completion
  4. Downgrade Factory to 3.6.4, submit jobs
    • no unusual log activity, all jobs ran to completion
  5. Downgrade Factory to 3.6.2, submit jobs
    • no unusual log activity, all jobs ran to completion
  6. Downgrade Frontend to 3.6.4, submit jobs
    • no unusual log activity, all jobs ran to completion
  7. Downgrade Frontend to 3.6.2, submit jobs
    • no unusual log activity, all jobs ran to completion
  8. Upgrade Factory to 3.7.1.rc8, submit jobs
    • no unusual log activity, all jobs ran to completion
  9. Upgrade Frontend to 3.6.5, submit jobs
    • 3.6.4 replaced by 3.6.5 in osg repo at time this test was run
    • no unusual log activity, all jobs ran to completion