Project

General

Profile

Bug #6572

jobsub_submit.py eats command line options that belong to batch script

Added by Herbert Greenlee about 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Low
Assignee:
Parag Mhashilkar
Category:
-
Target version:
Start date:
06/27/2014
Due date:
% Done:

100%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:
Duration:

Description

The jobsub_submit.py command parser only passes options to the batch script if they don't match jobsub_submit.py's own command line options. It does this even if the batch script options are properly at the end of the submission command.

History

#1 Updated by Parag Mhashilkar about 5 years ago

  • Assignee set to Dennis Box
  • Target version set to v0.4

#2 Updated by Dennis Box about 5 years ago

  • Target version changed from v0.4 to v1.0

#3 Updated by Parag Mhashilkar almost 5 years ago

  • Priority changed from Normal to Low

#4 Updated by Parag Mhashilkar almost 5 years ago

  • Target version changed from v1.0 to v1.1

#5 Updated by Parag Mhashilkar almost 5 years ago

  • Target version changed from v1.1 to v1.0.1

#6 Updated by Parag Mhashilkar almost 5 years ago

  • Target version changed from v1.0.1 to v1.0.2

#7 Updated by Dennis Box almost 5 years ago

  • Assignee changed from Dennis Box to Parag Mhashilkar

Re-assigning this one to Parag.

Here is an example: suppose I have a user program that needs to run an option, but there is a name collision with jobsub_submit's options:

[dbox@fermicloud326 ~]$ ./tstit.sh --group nova -g one two three
this is program tstit.sh
my argments are:--group nova -g one two three

i.e. my program needs the --group option as input.

If I want to run tstit.sh on the grid using jobsub_submit, the --group argument before tstit.sh should go to jobsub_client and the one after file://tstit.sh should go to tstit.sh but thats not what happens:

[dbox@fermicloud326 ~]$ jobsub_submit --group minerva --jobsub-server https://fifebatch-dev.fnal.gov:8443 file://tstit.sh --group nova -g one two three --debug
SERVER_ARGS: ['file://tstit.sh', '-g', 'one', 'two', 'three']
CLIENT_ARGS: {'dag': False, 'help': False, 'acctRole': None, 'debug': True, 'dropboxServer': None, 'acctGroup': 'nova', 'jobsubServer': 'https://fifebatch-dev.fnal.gov:8443'}
URL : https://fifebatch-dev.fnal.gov:8443/jobsub/acctgroups/nova/jobs/ QHRzdGl0LnNoIC1nIG9uZSB0d28gdGhyZWU=

CREDENTIALS : {'key': '/tmp/jobsub_x509up_u8531', 'env_key': '/tmp/jobsub_x509up_u8531', 'cert': '/tmp/jobsub_x509up_u8531', 'env_cert': '/tmp/jobsub_x509up_u8531'}

SUBMIT_URL : https://fifebatch-dev.fnal.gov:8443/jobsub/acctgroups/nova/jobs/

SERVER_ARGS_B64: @tstit.sh -g one two three

Using CA_DIR: /etc/grid-security/certificates
Server response code: 200
Response OUTPUT:
/scratch/uploads/nova/dbox/2014-10-09_134451.580402_8634

/_20141009_134451_5098_0_1.cmd

Report any problems to the service desk

submitting....

Submitting job(s).

1 job(s) submitted to cluster 1724.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.961988925934 sec

#8 Updated by Parag Mhashilkar almost 5 years ago

  • Target version changed from v1.0.2 to v1.1

#9 Updated by Parag Mhashilkar over 4 years ago

  • Target version changed from v1.1 to v1.0.4

#10 Updated by Parag Mhashilkar over 4 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

Tested and merged to master

#11 Updated by Parag Mhashilkar over 4 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF