Project

General

Profile

ReleaseTestingMatrix 3 6 1 rc1 » History » Version 15

« Previous - Version 15/16 (diff) - Next » - Current version
Marco Mascheroni, 12/03/2019 07:03 AM


ReleaseTestingMatrix 3 6 1 rc1

Summary

Summary of the automatic and manual tests

TEST ID FRONTEND version FACTORY version
1 3.6.1 3.6.1
2 3.4.6 3.6.1
3 3.6.1 3.4.6

Automatic test results OSG 3.4, SL6 and SL7

TEST ID FRONTEND version FACTORY version SL6 SL7
1 3.6.1 3.6.1 PASSED PASSED
2 3.4.6 3.6.1 PASSED PASSED
3 3.6.1 3.4.6

Machines used in automated tests - OSG 3.4

Test ID FRONTEND SL7 FACTORY SL7 FRONTEND SL6 FACTORY SL6
1 3.6.1->3.6.1 fermicloud158 fermicloud159 fermicloud157 fermicloud151
*Details for automated tests
  • test1 performed by dbox on 11/13/19 Frontend:3.6.1 Factory:3.6.1

Machines used in automated tests - OSG 3.5

Test ID FRONTEND SL7 FACTORY SL7
1 3.6.1->3.6.1 fermicloud110 fermicloud053
*Details for automated tests
  • test1 performed by dbox on 11/13/19 Frontend:3.6.1 Factory:3.6.1
    • there is no SL6 version for OSG 3.5

Manual tests

Follows a list of the manual tests performed for this.3.6.1.rc1:

  1. Upgrade/upgrade on SL7, OSG3.4, smoke test by Lorena Lobato
    • Frontend, v3.6.1.rc1 upgrade from v3.4.6, SL7, fermicloud364
    • Factory,v3.6.1.rc1 upgrade from v3.4.6, SL7, fermicloud137
    • Some details
      • Regular smoke test OK
    • Issues
    • Notes
      • Tried different configurations in the factory side, keeping in mind the tickets released for this version
  2. Upgrade/install on SL7, OSG3.4, smoke test by Lorena Lobato
    • Frontend, v3.6.1.rc1 upgrade from v3.5.1.rc1, SL7, fermicloud374
    • Factory, v3.5.1 SL7, fermicloud137
    • Some details
      • Regular smoke test OK
    • Issues
    • Notes
  3. Install/upgrade on SL6, OSG3.4, smoke test by Marco Mambelli
    • Factory, v3.5.1 install, SL6, fermicloud320
    • Frontend, v3.6.1.rc1 upgrade from v3.5.1, SL6, fermicloud316
    • Some details
      • Regular smoke test OK
      • Submitted also singularity jobs w/ all debug enabled, OK (Singularity 3.x)
    • Issues
    • Notes
  4. Upgrade/upgrade on SL6, OSG3.4, smoke test by Marco Mambelli
    • Factory, v3.6.1.rc1 upgrade from v3.5.1, SL6, fermicloud320
    • Frontend, v3.6.1.rc1 upgrade from v3.5.1, SL6, fermicloud316
    • Some details
      • Regular smoke test OK
      • Submitted also singularity jobs w/ all debug enabled, OK (Singularity 3.x)
    • Issues
    • Notes
      • Fixed CVMFS on fermicloud025
      • Singularity is privileged on 025, unprivileged on 378, both reported correctly
      • GLIDEIN_PROVIDES has an extra comma (",singularity/privileged"). Causes no problems but could be fixed
  5. Install on SL6, smoke test by Bruno Coimbra
    • Factory, v3.6.1 install, SL7, fermicloud180
    • Frontend, v3.4.6 install, SL7, fermicloud086
    • Details:
      • Regular smoke test OK
    • Issues:
      • I found a KeyError exception while starting the frontend. I couldn't reproduce the problem. More details on Bug #23636.
    • Notes
  1. Install on SL6, ITB dev test by Marco Mascheroni
    • Factory, v3.6.1 install from v3.6.0, SL6, vocms0202.cern.ch
    • Factory, v3.6.1 install from v3.4.6, SL7, vocms0203.cern.ch
    • Frontend, v3.6.1 install from v3.4.2, SL7, vocms0801.cern.ch
    • Details:
      • Verified both upgrade from previous minor version (on SLC6) and previous major version on (on SLC7). Run the fact_chown script without switching off condor and verified issues were detected and factory did not start (owner of jobs not changed). systemctl tells you where to look for info, and error messages tells to run fact_chown, which in turn tells you jobs owner is not what it is expected. Run again fact_chown with condor switched off and fixed the issue.
    • Issues:
      • Add here problems that need to be addressed. Open a ticket and write the number here
    • Notes
      • Add here general note
        Checked and jobs requested from both ligo (v3.4.6) and CMS frontend (v3.6.1). They were both running user jobs on different entries ok.
  2. Install ITB, test by Marco Mascheroni
    • Factory, v3.6.1 install from v.3.4.6, SL7, gfactory-itb-1.opensciencegrid.org
    • Factory, v3.6.1 install from v.3.4.6, SL6, vocms0204.cern.ch
    • Frontend, v3.4.5 and then v.3.6.1 install, SL7, vocms802.cern.ch
    • Details:
      • run fach_chown, basic validation
    • Issues:
      • Found an issue with the custom format of condor_q. Due to a small size of the clusterid field, wrong id were printed. See #23675
    • Notes
      • Add here general note
  3. Install on SL6, smoke test by Developer
    • Factory, v3.4.6 install, SL6, fermicloudAAA
    • Frontend, v3.4.6 install, SL6, fermicloudBBB
    • Details:
      • More details about the test, what was done, ...
    • Issues:
      • Add here problems that need to be addressed. Open a ticket and write the number here
    • Notes
      • Add here general note
  4. Install/upgrade on SL6, smoke test by Developer
    • Factory ...