Project

General

Profile

Bug #12752

Improvements to Jobsub configuration parser

Added by Neha Sharma over 3 years ago. Updated 5 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
Start date:
05/23/2016
Due date:
% Done:

0%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:
Duration:

Description

- Jobsub configuration parser currently requires a host specific section
- This is bit tedious to maintain especially when multiple Jobsub servers have identical configuration
- Putting configuration under the 'default' section does not work ( due to paths being hard coded somewhere in the code ).

Testing this in ITB, I get

bject at 0x7f13a45c6910>, 'jobsub_args_base64': u'QC9uYXNob21lL24vbmVoYS9oZWxsb193b3JsZC5zaA==', 'role': 'Analysis', 'jobsub_client_version': u'1.2.0.4'}
[23/May/2016:11:23:01] [139722709161728:job.py:doPOST] jobsub_args: @/nashome/n/neha/hello_world.sh
[23/May/2016:11:23:01] [139722709161728:job.py:doPOST] job.py:doPost:jobsub_command <cherrypy._cpreqbody.Part object at 0x7f13a45c6910>
[23/May/2016:11:23:01] [139722709161728:job.py:doPOST] job.py:doPost:role Analysis
[23/May/2016:11:23:01] [139722709161728:job.py:index] Exception on AccountJobsResource.indexTraceback (most recent call last):
File "/opt/jobsub/server/webapp/job.py", line 192, in index
rc = self.doPOST(acctgroup, job_id, kwargs)
File "/opt/jobsub/server/webapp/job.py", line 105, in doPOST
util.mkdir_p(command_path_acctgroup)
File "/opt/jobsub/server/webapp/util.py", line 66, in mkdir_p
os.makedirs(path)
File "/usr/lib64/python2.6/os.py", line 150, in makedirs
makedirs(head, mode)
File "/usr/lib64/python2.6/os.py", line 157, in makedirs
mkdir(name, mode)
OSError: [Errno 13] Permission denied: '/opt/jobsub/uploads'

So, as you can see, it tries to use '/opt/jobsub/uploads' instead of what's in the configuration file

[root@fifebatchitbgpvm02 config.d]# grep uploads /opt/jobsub/server/conf/jobsub.ini
command_path_root = /fife/local/scratch/uploads
condor_tmp = /fife/local/scratch/uploads/${GROUP}/${LOGNAME}/${WORKDIR_ID}
condor_exec = /fife/local/scratch/uploads/${GROUP}/${LOGNAME}/${WORKDIR_ID}
[root@fifebatchitbgpvm02 config.d]#

Please allow support for having common config under the 'default' section and/or change section from [FQDN of server] to just [server]

thanks!
- Neha

History

#1 Updated by Dennis Box 5 months ago

  • Target version set to v1.4


Also available in: Atom PDF