Project

General

Profile

ReleaseTestingMatrix 3 6 1 rc1 » History » Version 15

Marco Mascheroni, 12/03/2019 07:03 AM

1 1 Marco Mambelli
h1. ReleaseTestingMatrix 3 6 1 rc1
2 1 Marco Mambelli
3 1 Marco Mambelli
h2. Summary
4 1 Marco Mambelli
5 1 Marco Mambelli
Summary of the automatic and manual tests
6 1 Marco Mambelli
7 1 Marco Mambelli
|{background:#ddd}.TEST ID|{background:#ddd}.FRONTEND version|{background:#ddd}.FACTORY version|
8 1 Marco Mambelli
|{background:#ddd}.1|=.3.6.1|=.3.6.1|
9 2 Dennis Box
|{background:#ddd}.2|=.3.4.6|=.3.6.1|
10 2 Dennis Box
|{background:#ddd}.3|=.3.6.1|=.3.4.6|
11 1 Marco Mambelli
12 1 Marco Mambelli
13 12 Bruno Coimbra
h2. Automatic test results OSG 3.4, SL6 and SL7
14 1 Marco Mambelli
15 1 Marco Mambelli
|{background:#ddd}.TEST ID|{background:#ddd}.FRONTEND version|{background:#ddd}.FACTORY version|{background:#ddd}.SL6|{background:#ddd}.SL7|
16 1 Marco Mambelli
|{background:#ddd}.1|=.3.6.1|=.3.6.1|PASSED|PASSED|
17 12 Bruno Coimbra
|{background:#ddd}.2|=.3.4.6|=.3.6.1|PASSED|PASSED|
18 2 Dennis Box
|{background:#ddd}.3|=.3.6.1|=.3.4.6| | |
19 1 Marco Mambelli
|
20 1 Marco Mambelli
21 1 Marco Mambelli
h3. Machines used in automated tests - OSG 3.4
22 1 Marco Mambelli
23 1 Marco Mambelli
|{background:#ddd}.Test ID|{background:#ddd}.FRONTEND SL7|{background:#ddd}.FACTORY SL7|{background:#ddd}.FRONTEND SL6|{background:#ddd}.FACTORY SL6|
24 1 Marco Mambelli
|{background:#ddd}.1 *3.6.1->3.6.1*|fermicloud158|fermicloud159|fermicloud157|fermicloud151|
25 1 Marco Mambelli
26 1 Marco Mambelli
*Details for automated tests
27 1 Marco Mambelli
** test1 performed by dbox on 11/13/19 Frontend:3.6.1 Factory:3.6.1
28 1 Marco Mambelli
29 1 Marco Mambelli
h3. Machines used in automated tests - OSG 3.5
30 1 Marco Mambelli
31 1 Marco Mambelli
|{background:#ddd}.Test ID|{background:#ddd}.FRONTEND SL7|{background:#ddd}.FACTORY SL7|
32 1 Marco Mambelli
|{background:#ddd}.1 *3.6.1->3.6.1*|fermicloud110|fermicloud053|
33 1 Marco Mambelli
34 1 Marco Mambelli
*Details for automated tests
35 1 Marco Mambelli
** test1 performed by dbox on 11/13/19 Frontend:3.6.1 Factory:3.6.1
36 1 Marco Mambelli
*** there is no SL6 version for OSG 3.5
37 3 Dennis Box
38 3 Dennis Box
39 1 Marco Mambelli
h2. Manual tests
40 1 Marco Mambelli
41 4 Marco Mambelli
Follows a list of the manual tests performed for this.3.6.1.rc1:
42 1 Marco Mambelli
43 8 Lorena Lobato Pardavila
# Upgrade/upgrade on SL7, OSG3.4, smoke test by Lorena Lobato
44 9 Lorena Lobato Pardavila
** Frontend, v3.6.1.rc1 upgrade from v3.4.6, SL7, fermicloud364
45 9 Lorena Lobato Pardavila
** Factory,v3.6.1.rc1 upgrade from v3.4.6, SL7, fermicloud137
46 6 Lorena Lobato Pardavila
** Some details
47 6 Lorena Lobato Pardavila
*** Regular smoke test OK
48 6 Lorena Lobato Pardavila
** Issues
49 6 Lorena Lobato Pardavila
** Notes
50 10 Lorena Lobato Pardavila
*** Tried different configurations in the factory side, keeping in mind the tickets released for this version
51 8 Lorena Lobato Pardavila
# Upgrade/install on SL7, OSG3.4, smoke test by Lorena Lobato
52 6 Lorena Lobato Pardavila
** Frontend, v3.6.1.rc1 upgrade from v3.5.1.rc1, SL7, fermicloud374
53 9 Lorena Lobato Pardavila
** Factory, v3.5.1  SL7, fermicloud137
54 6 Lorena Lobato Pardavila
** Some details
55 6 Lorena Lobato Pardavila
*** Regular smoke test OK
56 6 Lorena Lobato Pardavila
** Issues
57 6 Lorena Lobato Pardavila
** Notes
58 5 Marco Mambelli
#  Install/upgrade on SL6, OSG3.4, smoke test by Marco Mambelli
59 4 Marco Mambelli
** Factory, v3.5.1 install, SL6, fermicloud320
60 4 Marco Mambelli
** Frontend, v3.6.1.rc1 upgrade from v3.5.1, SL6, fermicloud316
61 4 Marco Mambelli
** Some details
62 4 Marco Mambelli
*** Regular smoke test OK
63 5 Marco Mambelli
*** Submitted also singularity jobs w/ all debug enabled, OK (Singularity 3.x)
64 1 Marco Mambelli
** Issues
65 1 Marco Mambelli
** Notes
66 5 Marco Mambelli
*** 
67 5 Marco Mambelli
#  Upgrade/upgrade on SL6, OSG3.4, smoke test by Marco Mambelli
68 5 Marco Mambelli
** Factory, v3.6.1.rc1 upgrade from v3.5.1, SL6, fermicloud320
69 5 Marco Mambelli
** Frontend, v3.6.1.rc1 upgrade from v3.5.1, SL6, fermicloud316
70 5 Marco Mambelli
** Some details
71 5 Marco Mambelli
*** Regular smoke test OK
72 5 Marco Mambelli
*** Submitted also singularity jobs w/ all debug enabled, OK (Singularity 3.x)
73 5 Marco Mambelli
** Issues
74 5 Marco Mambelli
** Notes
75 5 Marco Mambelli
*** Fixed CVMFS on fermicloud025
76 5 Marco Mambelli
*** Singularity is privileged on 025, unprivileged on 378, both reported correctly
77 5 Marco Mambelli
*** GLIDEIN_PROVIDES has an extra comma (",singularity/privileged"). Causes no problems but could be fixed
78 13 Bruno Coimbra
# Install on SL6, smoke test by Bruno Coimbra
79 13 Bruno Coimbra
** Factory, v3.6.1 install, SL7, fermicloud180
80 13 Bruno Coimbra
** Frontend, v3.4.6 install, SL7, fermicloud086
81 13 Bruno Coimbra
** Details:
82 13 Bruno Coimbra
*** Regular smoke test OK
83 13 Bruno Coimbra
** Issues:
84 13 Bruno Coimbra
*** I found a KeyError exception while starting the frontend. I couldn't reproduce the problem. More details on Bug #23636.
85 13 Bruno Coimbra
** Notes
86 14 Marco Mascheroni
87 14 Marco Mascheroni
88 14 Marco Mascheroni
# Install on SL6, ITB dev test by Marco Mascheroni
89 14 Marco Mascheroni
** Factory, v3.6.1 install from v3.6.0, SL6, vocms0202.cern.ch
90 14 Marco Mascheroni
** Factory, v3.6.1 install from v3.4.6, SL7, vocms0203.cern.ch
91 14 Marco Mascheroni
** Frontend, v3.6.1 install from v3.4.2, SL7, vocms0801.cern.ch
92 14 Marco Mascheroni
** Details:
93 14 Marco Mascheroni
*** Verified both upgrade from previous minor version (on SLC6) and previous major version on (on SLC7). Run the fact_chown script without switching off condor and verified issues were detected and factory did not start (owner of jobs not changed). systemctl tells you where to look for info, and error messages tells to run fact_chown, which in turn tells you jobs owner is not what it is expected. Run again fact_chown with condor switched off and fixed the issue.
94 14 Marco Mascheroni
** Issues:
95 14 Marco Mascheroni
*** Add here problems that need to be addressed. Open a ticket and write the number here
96 14 Marco Mascheroni
** Notes
97 14 Marco Mascheroni
*** Add here general note
98 14 Marco Mascheroni
Checked and jobs requested from both ligo (v3.4.6) and CMS frontend (v3.6.1). They were both running user jobs on different entries ok.
99 15 Marco Mascheroni
# Install ITB, test by Marco Mascheroni
100 15 Marco Mascheroni
** Factory, v3.6.1 install from v.3.4.6, SL7, gfactory-itb-1.opensciencegrid.org
101 15 Marco Mascheroni
** Factory, v3.6.1 install from v.3.4.6, SL6, vocms0204.cern.ch
102 15 Marco Mascheroni
** Frontend, v3.4.5 and then v.3.6.1 install, SL7, vocms802.cern.ch
103 15 Marco Mascheroni
** Details:
104 15 Marco Mascheroni
*** run fach_chown, basic validation
105 15 Marco Mascheroni
** Issues:
106 15 Marco Mascheroni
*** Found an issue with the custom format of condor_q. Due to a small size of the clusterid field, wrong id were printed. See #23675
107 15 Marco Mascheroni
** Notes
108 15 Marco Mascheroni
*** Add here general note
109 1 Marco Mambelli
# Install on SL6, smoke test by Developer
110 1 Marco Mambelli
** Factory, v3.4.6 install, SL6, fermicloudAAA
111 1 Marco Mambelli
** Frontend, v3.4.6 install, SL6, fermicloudBBB
112 1 Marco Mambelli
** Details:
113 1 Marco Mambelli
*** More details about the test, what was done, ...
114 1 Marco Mambelli
** Issues:
115 1 Marco Mambelli
*** Add here problems that need to be addressed. Open a ticket and write the number here
116 1 Marco Mambelli
** Notes
117 1 Marco Mambelli
*** Add here general note
118 1 Marco Mambelli
# Install/upgrade on SL6, smoke test by Developer
119 1 Marco Mambelli
** Factory ...