Project

General

Profile

Bug #21527

The factory seems to ignore the configuration values in the files in the config.d directory w/ entry configurations

Added by Marco Mambelli 11 months ago. Updated 10 months ago.

Status:
Closed
Priority:
Urgent
Category:
Configuration Management
Target version:
Start date:
12/11/2018
Due date:
% Done:

0%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:

HEPCloud

Duration:

Description

The Factory seems to ignore the entry configuration values and return the default/global values.

Here the email from Steve Timm:

Factories cmssrv280 and fermifactory01 were recently upgraded to the latest glideinwms 3.4.1-1.  Both are set to have a default value of 

      <attr name="GLIDEIN_Max_Walltime" const="False" glidein_publish="False" job_publish="False" parameter="True" publish="True" type="int" value="2600000"/>

in the top level glideinwms.xml

However we override that value on most individual entries of the factory

            <attr name="GLIDEIN_Max_Walltime" const="True" glidein_publish="False" job_publish="False" parameter="True" publish="True" type="int" value="86400"/>

It seems that the override value is no longer being used.  The glideins 
are being submitted with the default (extra long) value for GLIDEIN_Max_Walltime.

Please investigate.

Steven Timm

glideinWMS.xml (9.06 KB) glideinWMS.xml Marco Mambelli, 01/13/2019 02:46 AM

Related issues

Related to GlideinWMS - Support #21537: Double-check functions that deal with boolean ClassAd facing possible misleading behaviorClosed12/12/2018

History

#1 Updated by Marco Mambelli 11 months ago

  • Target version changed from v3_5 to v3_4_3
  • Stakeholders updated (diff)

#2 Updated by Marco Mascheroni 11 months ago

  • Status changed from New to Feedback
  • Assignee changed from Marco Mascheroni to Lorena Lobato Pardavila

#3 Updated by Lorena Lobato Pardavila 11 months ago

  • Status changed from Feedback to Assigned
  • Assignee changed from Lorena Lobato Pardavila to Marco Mascheroni

#4 Updated by Lorena Lobato Pardavila 11 months ago

  • Status changed from Assigned to Resolved

#5 Updated by Lorena Lobato Pardavila 11 months ago

  • Status changed from Resolved to Assigned

#6 Updated by Lorena Lobato Pardavila 11 months ago

  • Status changed from Assigned to Resolved

#7 Updated by Marco Mascheroni 11 months ago

  • Status changed from Resolved to Feedback

#8 Updated by Marco Mascheroni 11 months ago

  • Assignee changed from Marco Mascheroni to Lorena Lobato Pardavila

#9 Updated by Lorena Lobato Pardavila 11 months ago

  • Status changed from Feedback to Resolved
  • Assignee changed from Lorena Lobato Pardavila to Marco Mascheroni

There were some CI errors related to unittests and futurize corrected in v34/21527_1. It should be fine now

Already merged into master.

#10 Updated by Marco Mambelli 10 months ago

I seem still to have a similar problem.
The variables GLIDEIN_REQUIRE_VOMS and GLIDEIN_REQUIRE_GLEXEC_USE
are controlled also by "require_voms_proxy" and "require_glidein_glexec_use"
I seem to be unable to set them to false in the constants file.

These are present in both variable and constant files, are inconsistent and I did not get any warning in reconfig/upgrade (at least in SL7):

# File: constants.j1bi13.cfg
#
GLEXEC_JOB      False
GLIDEIN_Site    ITB_FC_CE2
USE_CCB         True
GLIDEIN_Gatekeeper      fermicloud025.fnal.gov/jobmanager-condor
GLIDEIN_GridType        gt2
GLIDEIN_REQUIRE_VOMS    True
GLIDEIN_REQUIRE_GLEXEC_USE      True
GLIDEIN_TrustDomain     grid
GLIDEIN_SupportedAuthenticationMethod   grid_proxy
GLIDEIN_GlobusRSL       (queue=default)(jobtype=single)
GLIDEIN_SlotsLayout     fixed
GLIDEIN_WorkDir         OSG
GLIDEIN_Verbosity       std

and
# File: condor_vars.j1d2zd.lst
#
# VarName               Type    Default         CondorName                     Req.     Export  UserName
#                       S=Quote - = No Default  + = VarName                             Condor   - = Do not export
#                                                                                                + = Use VarName
#                                                                                                @ = Use CondorName
###################################################################################################################
GLIDEIN_Site    S       -               +       N       Y       +
USE_CCB         S       -               +       N       Y       -
GLIDEIN_REQUIRE_VOMS    I       True            +       N       Y       +
GLIDEIN_REQUIRE_GLEXEC_USE      I       False           +       N       Y       +

Attached is the glideinWMS.xml

#11 Updated by Marco Mambelli 10 months ago

And if I set the same variable as constant and not in the global section I get this error w/ reconfig or upgrade:

# /usr/sbin/gwms-factory reconfig
Using default factory config file: /etc/gwms-factory/glideinWMS.xml
Reconfiguring the factoryTraceback (most recent call last):
  File "/sbin/reconfig_glidein", line 227, in <module>
    conf = factoryXmlConfig.parse(xml)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/factoryXmlConfig.py", line 321, in parse
    conf.merge_defaults(conf_def)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/xmlConfig.py", line 170, in merge_defaults
    self.children[tag].merge_defaults(default.children[tag])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/xmlConfig.py", line 214, in merge_defaults
    child.merge_defaults(default.children[0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/xmlConfig.py", line 172, in merge_defaults
    self.validate()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/factoryXmlConfig.py", line 42, in validate
    self.check_overwrite_soundness()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/factoryXmlConfig.py", line 56, in check_overwrite_soundness
    entry = self.parent.parent.getName()
AttributeError: 'Config' object has no attribute 'getName'
                                                           [FAILED]

#12 Updated by Marco Mambelli 10 months ago

Some more info.
The problems I'm having w/ GLIDEIN_REQUIRE_VOMS and GLIDEIN_REQUIRE_GLEXEC_USE may be related to the <restrictions section in glideinWMS.xml
I did not find documentation for it but it seems to affect these configuration variables and don't know if it considers them constant o variables.
And it seems not to be handled correctly.

I found no way to set GLIDEIN_REQUIRE_VOMS to false.
And the configuration used to work and is not giving any warning during reconfig.

Here is also an upgrade execution w/ all the stack traces in case it is useful:

# /usr/sbin/gwms-factory reconfig
Using default factory config file: /etc/gwms-factory/glideinWMS.xml
Reconfiguring the factoryMMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1494, in load
    self.main_dicts.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 613, in load
    load_main_dicts(self.dicts)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 236, in load_main_dicts
    load_common_dicts(main_dicts, main_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 211, in load_common_dicts
    dicts['attrs'].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 855, in parse_val
    return self.add(key, eval(val))
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1494, in load
    self.main_dicts.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 613, in load
    load_main_dicts(self.dicts)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 236, in load_main_dicts
    load_common_dicts(main_dicts, main_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 217, in load_common_dicts
    dicts['consts'].load(fname=file_el[cWConsts.CONSTS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 299, in parse_val
    return self.add(key, val)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 211, in load_common_dicts
    dicts['attrs'].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 855, in parse_val
    return self.add(key, eval(val))
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 217, in load_common_dicts
    dicts['consts'].load(fname=file_el[cWConsts.CONSTS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 299, in parse_val
    return self.add(key, val)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE in variables (GLIDEIN_REQUIRE_GLEXEC_USE, ['I', 'False', '+', 'N', 'Y', '+'])
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, ['I', 'False', '+', 'N', 'Y', '+'])
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 218, in load_common_dicts
    dicts['vars'].load(fname=file_el[cWConsts.VARS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 989, in parse_val
    return self.add(key, arr[1:])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 933, in add
    return DictFile.add(self, key, val, allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 211, in load_common_dicts
    dicts['attrs'].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 855, in parse_val
    return self.add(key, eval(val))
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 217, in load_common_dicts
    dicts['consts'].load(fname=file_el[cWConsts.CONSTS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 299, in parse_val
    return self.add(key, val)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE in variables (GLIDEIN_REQUIRE_GLEXEC_USE, ['I', 'False', '+', 'N', 'Y', '+'])
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, ['I', 'False', '+', 'N', 'Y', '+'])
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 218, in load_common_dicts
    dicts['vars'].load(fname=file_el[cWConsts.VARS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 989, in parse_val
    return self.add(key, arr[1:])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 933, in add
    return DictFile.add(self, key, val, allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 211, in load_common_dicts
    dicts['attrs'].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 855, in parse_val
    return self.add(key, eval(val))
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, WasTru2dCTF)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 217, in load_common_dicts
    dicts['consts'].load(fname=file_el[cWConsts.CONSTS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 299, in parse_val
    return self.add(key, val)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE in variables (GLIDEIN_REQUIRE_GLEXEC_USE, ['I', 'False', '+', 'N', 'Y', '+'])
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, ['I', 'False', '+', 'N', 'Y', '+'])
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 93, in main
    old_glidein_dicts_obj.load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 1506, in load
    self.sub_dicts[sub_name].load()
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 444, in load
    cgWDictFile.glideinEntryDicts.load(self)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 659, in load
    load_entry_dicts(self.dicts, self.sub_name, self.summary_signature)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 248, in load_entry_dicts
    load_common_dicts(entry_dicts, entry_dicts['description'])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWDictFile.py", line 218, in load_common_dicts
    dicts['vars'].load(fname=file_el[cWConsts.VARS_FILE][0])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 208, in load
    self.load_from_fd(fd, erase_first, set_not_changed)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 235, in load_from_fd
    self.parse_val(line)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 989, in parse_val
    return self.add(key, arr[1:])
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 933, in add
    return DictFile.add(self, key, val, allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 590, in populate
    self.main_dicts.populate(other)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 258, in populate
    add_attr_unparsed(attr, self.dicts, "main")
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 751, in add_attr_unparsed
    add_attr_unparsed_real(attr, dicts)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 782, in add_attr_unparsed_real
    dicts['attrs'].add(attr_name, attr_val)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, False)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 590, in populate
    self.main_dicts.populate(other)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 258, in populate
    add_attr_unparsed(attr, self.dicts, "main")
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 751, in add_attr_unparsed
    add_attr_unparsed_real(attr, dicts)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 783, in add_attr_unparsed_real
    dicts['consts'].add(attr_name, attr_val)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 501, in populate
    self.dicts[dtype].add("GLIDEIN_REQUIRE_GLEXEC_USE", bool(restrictions[u'require_glidein_glexec_use']), allow_overwrite=True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 501, in populate
    self.dicts[dtype].add("GLIDEIN_REQUIRE_GLEXEC_USE", bool(restrictions[u'require_glidein_glexec_use']), allow_overwrite=True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE in variables (GLIDEIN_REQUIRE_GLEXEC_USE, ('I', u'False', '+', 'N', 'Y', '+'))
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, ('I', u'False', '+', 'N', 'Y', '+'))
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 515, in populate
    self.dicts['vars'].add_extended("GLIDEIN_REQUIRE_GLEXEC_USE", "boolean", restrictions[u'require_glidein_glexec_use'], None, False, True, True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 973, in add_extended
    self.add(key, (type_str, val_default, condor_name, req_str, export_condor_str, user_name), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 933, in add
    return DictFile.add(self, key, val, allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 501, in populate
    self.dicts[dtype].add("GLIDEIN_REQUIRE_GLEXEC_USE", bool(restrictions[u'require_glidein_glexec_use']), allow_overwrite=True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 501, in populate
    self.dicts[dtype].add("GLIDEIN_REQUIRE_GLEXEC_USE", bool(restrictions[u'require_glidein_glexec_use']), allow_overwrite=True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE in variables (GLIDEIN_REQUIRE_GLEXEC_USE, ('I', u'False', '+', 'N', 'Y', '+'))
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, ('I', u'False', '+', 'N', 'Y', '+'))
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 515, in populate
    self.dicts['vars'].add_extended("GLIDEIN_REQUIRE_GLEXEC_USE", "boolean", restrictions[u'require_glidein_glexec_use'], None, False, True, True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 973, in add_extended
    self.add(key, (type_str, val_default, condor_name, req_str, export_condor_str, user_name), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 933, in add
    return DictFile.add(self, key, val, allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 501, in populate
    self.dicts[dtype].add("GLIDEIN_REQUIRE_GLEXEC_USE", bool(restrictions[u'require_glidein_glexec_use']), allow_overwrite=True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, True)
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 501, in populate
    self.dicts[dtype].add("GLIDEIN_REQUIRE_GLEXEC_USE", bool(restrictions[u'require_glidein_glexec_use']), allow_overwrite=True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 872, in add
    DictFile.add(self, key, str(val), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE in variables (GLIDEIN_REQUIRE_GLEXEC_USE, ('I', u'False', '+', 'N', 'Y', '+'))
MMDB found set GLIDEIN_REQUIRE_GLEXEC_USE (GLIDEIN_REQUIRE_GLEXEC_USE, ('I', u'False', '+', 'N', 'Y', '+'))
  File "/sbin/reconfig_glidein", line 252, in <module>
    main(conf, update_scripts, update_def_cfg, comment=comment)
  File "/sbin/reconfig_glidein", line 96, in main
    glidein_dicts_obj.populate(old_glidein_dicts_obj)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 623, in populate
    self.sub_dicts[entry_name].populate(entry, schedd)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cgWParamDict.py", line 515, in populate
    self.dicts['vars'].add_extended("GLIDEIN_REQUIRE_GLEXEC_USE", "boolean", restrictions[u'require_glidein_glexec_use'], None, False, True, True)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 973, in add_extended
    self.add(key, (type_str, val_default, condor_name, req_str, export_condor_str, user_name), allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 933, in add
    return DictFile.add(self, key, val, allow_overwrite)
  File "/usr/lib/python2.7/site-packages/glideinwms/creation/lib/cWDictFile.py", line 84, in add
    traceback.print_stack()
...Reconfigured glidein 'gfactory_instance' is complete
...Active entries are:
     ITB_FC_CE3
     ITB_FC_CE2
...Verifying rrd schema
...Submit files are in /var/lib/gwms-factory/work-dir
                                                           [  OK  ]

#13 Updated by Marco Mambelli 10 months ago

A clarification about all my comments above.
There are 2 separate errors:
1. probably caused by the previous code in this ticket: the name is not defined outside of the entry/entryset sections, so the warning message is failing (causing the exception). The first stack trace refers to this
2. I seem unable to set to false the variables GLIDEIN_REQUIRE_VOMS and GLIDEIN_REQUIRE_GLEXEC_USE, the Factory configuration is ignoring what I set in the config file and set them to true (another case of the original problem reported in the ticket). All the other stack traces refer to this and were artificially caused by me by adding a traceback.print in the code to try to understand what the code was doing. The code was not crashing, simply setting the variables always to true

#14 Updated by Marco Mascheroni 10 months ago

1. I did not consider one could set the same attribute in the global section twice. I fixed this corner case
2. It was related to the changes in #21325 and the fact that

bool(u'False')=True

I created v34/21527_2 for 1.

#15 Updated by Marco Mascheroni 10 months ago

  • Status changed from Work in progress to Feedback
  • Assignee changed from Marco Mascheroni to Lorena Lobato Pardavila

#16 Updated by Lorena Lobato Pardavila 10 months ago

  • Status changed from Feedback to Resolved

Tested and merged into master. It should be fine now.

#17 Updated by Marco Mambelli 10 months ago

  • Status changed from Resolved to Closed

#18 Updated by Lorena Lobato Pardavila 9 months ago

  • Related to Support #21537: Double-check functions that deal with boolean ClassAd facing possible misleading behavior added


Also available in: Atom PDF