Project

General

Profile

Bug #6806

jobsub_submit allows to use unexisting usage models

Added by Alessio Balsini over 6 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
JobSub Client
Target version:
Start date:
08/15/2014
Due date:
% Done:

100%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:
Duration:

Description

I've been able to submit jobs with strange (unexisting) --resource-provides=usage_model parameters, also with an empty value.

It looks like it lets you submit anything that resembles an authorized model, as if you where checking with a wildcard on the "usage model"... Just see the examples below:

<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model=CLOUD -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111321.421175_3191

/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111321.421175_3191/info.sh_20140815_111321_942_0_1.cmd

submitting....

Submitting job(s).

1 job(s) submitted to cluster 7978.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.426831007004 sec

<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model=_CLOUD -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111406.323758_5766

/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111406.323758_5766/info.sh_20140815_111406_5452_0_1.cmd

submitting....

Submitting job(s).

1 job(s) submitted to cluster 8007.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.454637050629 sec
<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model=D_CLOUD -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111414.042645_8593

/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111414.042645_8593/info.sh_20140815_111414_6359_0_1.cmd

submitting....

Submitting job(s).

1 job(s) submitted to cluster 8014.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.434882879257 sec
<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model=D\_CLOUD -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111425.380306_9258

/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_111425.380306_9258/info.sh_20140815_111425_7599_0_1.cmd

submitting....

Submitting job(s).

1 job(s) submitted to cluster 8023.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.442444086075 sec
<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model= -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_112017.268673_8936

/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_112017.268673_8936/info.sh_20140815_112017_15246_0_1.cmd

submitting....

Submitting job(s).

1 job(s) submitted to cluster 8271.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.466871976852 sec
<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model=ED -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_112711.766492_6110

/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_112711.766492_6110/info.sh_20140815_112712_1829_0_1.cmd

submitting....

Submitting job(s).

1 job(s) submitted to cluster 8566.

JobsubJobId of first job:

Use job id to retrieve output

Remote Submission Processing Time: 0.444574832916 sec
<uboonegpvm01.fnal.gov>

And now one that fails (one needs to find something that does not resemble an authorized one...):

<uboonegpvm01.fnal.gov> jobsub_submit --resource-provides=usage_model=failplease -G uboone file://$HOME/testPrograms/info.sh
Server response code: 200
Response OUTPUT:
/fife/local/scratch/uploads/uboone/abalsini/2014-08-15_112941.382973_9770/info.sh_20140815_112941_18069_0_1.cmd

Response ERROR:
Traceback (most recent call last):

File "/fnal/ups/prd/jobsub_tools/v1_3_1_2/Linux-2/bin/jobsub", line 102, in &lt;module&gt;
settings.makeCondorFiles()
File "/fnal/ups/prd/jobsub_tools/v1_3_1_2/Linux-2/pylib/groupsettings/JobSettings.py", line 697, in makeCondorFiles
self.makeCondorFiles2()
File "/fnal/ups/prd/jobsub_tools/v1_3_1_2/Linux-2/pylib/groupsettings/JobSettings.py", line 914, in makeCondorFiles2
self.makeCommandFile(job_iter)
File "/fnal/ups/prd/jobsub_tools/v1_3_1_2/Linux-2/pylib/groupsettings/JobSettings.py", line 930, in makeCommandFile
self.makeOtherCommandFile(job_iter)
File "/fnal/ups/prd/jobsub_tools/v1_3_1_2/Linux-2/pylib/groupsettings/JobSettings.py", line 1111, in makeOtherCommandFile
self.handleResourceProvides(f,job_iter)
File "/fnal/ups/prd/jobsub_tools/v1_3_1_2/Linux-2/pylib/groupsettings/JobSettings.py", line 994, in handleResourceProvides
raise InitializationError(err)

groupsettings.JobSettings.InitializationError: illegal --resource-provides value: failplease for option: usage_model is not supported on fifebatch1.fnal.gov according to your config file /opt/jobsub/server/conf/jobsub.ini. Legal values are:FERMICLOUD_PP,FERMICLOUD8G,FERMICLOUD,OFFSITE,PAID_CLOUD,DEDICATED,OPPORTUNISTIC,SLOTTEST

Remote Submission Processing Time: 0.394911050797 sec
<uboonegpvm01.fnal.gov>

Gerard's note: please improve the unit testing...

History

#1 Updated by Alessio Balsini over 6 years ago

Note, this is how I'm setting up the environment:

source /grid/fermiapp/products/common/etc/setups.sh
setup jobsub_client v0_4

#2 Updated by Parag Mhashilkar over 6 years ago

  • Assignee changed from Alessio Balsini to Dennis Box
  • Priority changed from Urgent to Normal
  • Target version set to v1.0

Dennis, Can you also change the client to not spit out stack trace unless debug flag is set?

#3 Updated by Dennis Box over 6 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

#4 Updated by Parag Mhashilkar over 6 years ago

  • Status changed from Resolved to Closed

Also available in: Atom PDF