Project

General

Profile

ReleaseTestingMatrix 3 6 3 rc3

Summary

Summary of the automatic and manual tests

TEST ID FRONTEND version FACTORY version
1 release release
2 previous release
3 release previous
4 release subsequent(if proceed)
5 subsequent(if proceed) release

Automatic tests

Manual tests

Frontend, Factory used for a series of tests performed by dbox on 7/29/20

Host Role OS OSG
fermicloud189 Factory SL7 OSG35
fermicloud190 VOFrontend SL7 OSG35

Test Results Summary

  • Test Type:
    • I: Interoperability (install if needed, submit jobs, wait for completion)
    • D: Downgrade and reconfig
    • U: Upgrade and reconfig
TEST ID TEST TYPE FRONTEND version FACTORY version Result
1 I v3.6.3.rc3 v3.6.3.rc3 OK
2 D v3.6.3.rc3 v3.6.2 OK
3 I v3.6.3.rc3 v3.6.2 OK
4 U v3.6.3.rc3 v3.6.3.rc3 OK
5 D v3.6.2 v3.6.3.rc3 OK
6 I v3.6.2 v3.6.3.rc3 OK
7 U v3.6.3.rc3 v3.6.3.rc3 OK

Test Details

  • Test 1, install and test interoperability, was performed via a 'smoke test' script.
  • The remaining tests were performed manually as the 'smoke test' does not handle errors in upgrades and downgrades gracefully.
    • The remaining tests may be automated with Ansible, it seems to work well on fermicloud
  • CEs used for tests performed by dbox on 7/29/20
Host OS, OSG htcondor_ce condor
fermicloud072 SL6 OSG34 3.4.0 8.8.8
fermicloud337 SL7 OSG34 4.4.1 8.8.8
fermicloud036 SL7 OSG35 4.4.1 8.8.9

Expanded Details by Test Number

  1. Install on SL7, OSG35 smoke test by Dennis Box on 7/29/20
    • Factory, v3.6.3.rc3 install, SL7, fermicloud189
    • Frontend, v3.6.3.rc3 install, SL7, fermicloud190
    • Details
      • Smoke tests ran jobs to completion on all CEs
      • Condor and GWMS logs showed no unusual errors, warnings, or python exceptions
  2. Test of downgrading factory v3.6.3.rc3 to v3.6.2
    • factory on fermicloud189 was downgraded with the following commands:
      • yum --enablerepo osg downgrade python2-condor condor-classads condor-procd condor glideinwms-common-tools glideinwms-libs glideinwms-glidecondor-tools glideinwms-factory-condor glideinwms-condor-common-config glideinwms-factory
      • systemctl restart condor
      • systemctl stop gwms-factory
      • gwms-factory upgrade
      • systemctl start gwms-factory
    • condor_status and systemctl status gwms-factory reported no problems after downgrade of factory
  3. Test of interoperability between v3.6.2 Factory and v3.6.3.rc3 VOFrontend
    • After downgrading of factory described previously, jobs were submitted on VOFrontend fermicloud190
    • submissions ran to completions on all CEs
    • no unexpected errors in condor or gwms logs
  4. Test of upgrading factory v3.6.2 to v3.6.3.rc3
    • factory on fermicloud189 upgraded with following commands:
      • yum --enablerepo osg-development upgrade glideinwms-factory
      • yum --enablerepo osg-development upgrade condor
      • systemctl restart condor
      • systemctl stop gwms-factory
      • gwms-factory upgrade
      • systemctl start gwms-factory
    • after upgrade condor_status and systemctl status gwms-factory indicated success
  5. Test of downgrading VOFrontend v3.6.3.rc3 to v3.6.2
    • following commands used to perform downgrade
      • yum --enablerepo osg downgrade glideinwms-vofrontend-standalone glideinwms-usercollector glideinwms-userschedd glideinwms-condor-common-config glideinwms-minimal-condor glideinwms-libs glideinwms-glidecondor-tools glideinwms-common-tools glideinwms-vofrontend
      • systemctl restart condor
      • systemctl stop gwms-frontend
      • gwms-frontend upgrade
      • systemctl start gwms-frontend
    • condor_status and systemctl gwms-frontend indicated success
  6. Test of Factory v3.6.3.rc3 VOFrontend v3.6.2 interoperability
    • jobs were submitted from fermicloud190 after its downgrade to recently upgraded factory on fermicloud189
    • submissions ran to completions on all CEs
    • no unexpected errors in condor or gwms logs
  7. Upgrade frontend to v3.6.3
    • following commands used to perform upgrade:
      • yum --enablerepo osg-development upgrade glideinwms-vofrontend
      • systemctl stop gwms-frontend
      • gwms-frontend upgrade
      • systemctl start gwms-frontend
    • after upgrade condor_status and systemctl status gwms-factory indicated success