Add a jobsub.ini option so that we know which collectors to use
Right now, in the collector_host function, we run "condor_status -collector -af Machine" and pick a collector from that list (line 413, condor_commands.py). GCO requests that we instead read that in from the config. GCO added a couple of collectors that don't know about the jobsub schedds (gpccb01.fnal.gov, gpccb02.fnal.gov).
I think it's as easy as this:
def collector_host(): """ return the condor collector host name """ jcp = JobsubConfigParser.JobsubConfigParser() try: # NEW STUFF hosts = jcp.get('default', 'collector_hosts') host_list = hosts.split(',') # END NEW STUFF while '' in host_list: host_list.remove('') host = host_list[randint(0, len(host_list) - 1)] logger.log('choosing %s from %s' % (host, host_list)) return host except: tbk = traceback.format_exc() logger.log(tbk) logger.log(tbk, severity=logging.ERROR, logfile='condor_commands') logger.log(tbk, severity=logging.ERROR, logfile='error')
and then add in the jobsub.ini file, in the [default] section:
If this works, we'd like to push this out in a new jobsub_server release (188.8.131.52?) in the next day or two.
#1 Updated by Shreyas Bhat about 1 month ago
Correction: The ini entry would be this if we're comma-separated:
If we're not, like most of the rest of the file:
collector_hosts= 'gpcollector03.fnal.gov gpcollector04.fnal.gov'
Then the host_list definition line would be changed to:
host_list = hosts.split()