Project

General

Profile

Feature #22021

Special use of UPLOADS env var for Analysis users

Added by Vito Di Benedetto over 1 year ago. Updated about 1 year ago.

Status:
Closed
Priority:
Normal
Assignee:
Target version:
Start date:
02/28/2019
Due date:
% Done:

100%

Estimated time:
Scope:
Internal
Experiment:
-
Stakeholders:
Duration:

Description

Some experiment workflow can have stages that require a wrapper FHiCL file.
The purpose of this wrapper FHiCL file will be to set/override some FHiCL parameters.
This mostly happen for the generation stage.

With the new Project-py we can create this wrapper FHiCL file and upload it in the "Uploaded Files" for analysis users.
The file is available from the submission node from the path provided by the env var $UPLOADS
Then we can use the jobsub_submit option -f dropbox://INPUT_FILE to ship the wrapper FHiCL file on the worker node.
For this I can use in the fife_launch cfg file something like:

submit.f = dropbox://$UPLOADS/my_wrapper.fcl

but, when the fife_launch cfg is parsed, the value for the "f" option is passed within single quotes
'dropbox://$UPLOADS/my_wrapper.fcl'

so the UPLOADS env var is not expanded and jobsub_submit is not able to find the file.
Is it possible to get a mechanism that allows the env var UPLOADS to be expanded properly when passed to jobsub?

History

#1 Updated by Stephen White over 1 year ago

  • Assignee set to Marc Mengel

#2 Updated by Marc Mengel over 1 year ago

  • % Done changed from 0 to 100
  • Status changed from New to Resolved

This is actually a fix in fife_utils revision
0096b863

should be out in fife_utils v3_2_8 Real Soon.

#3 Updated by Vito Di Benedetto over 1 year ago

I tested this feature with fife_utils v3_2_8 and it works!

#4 Updated by Stephen White about 1 year ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF