Bug #21615: CDF wrapper output copy back failing - JobSub - Fermilab Redmine

Bug #21615

CDF wrapper output copy back failing

Added by Kevin Retzke 3 months ago. Updated 2 months ago.

Status:

Resolved

Priority:

Normal

Assignee:

Dennis Box

Category:

JobSub Server RPM

Target version:

Start date:

01/02/2019

Due date:

% Done:

Estimated time:

First Occurred:

Occurs In:

v1.2.8.2

Stakeholders:

Duration:

Description

The output file copy in the CDF wrapper script is failing because it appears the output directory is actually getting created as a file. For example:

error: globus_ftp_client: the server responded with an error
550 Permission denied

Wed Jan  2 15:43:36 2019
 program: globus-url-copy -rst-retries 1 -gridftp2 -nodcau -restart -stall-timeout 14400  file:////storage/local/data1/condor/execute/dir_32376/no_xfer \
/work/jobsub_cdf_output.tgz gsiftp://stkendca14a.fnal.gov/pnfs/fnal.gov/usr/cdf/scratch/ptl/latest/out665-14493013.tgz/jobsub01.fnal.gov_665-14493013.tgz
exited status 1

fcdflnxgpvm01 11:30 AM ~ > ls -al /pnfs/cdf/scratch/ptl/latest/out665-14493013.tgz
-rw-r--r-- 1 ptl cdf 354641784 Jan  2 09:43 /pnfs/cdf/scratch/ptl/latest/out665-14493013.tgz

Ref: INC000001011559

History

#1 Updated by Dennis Box 2 months ago

Status changed from New to Assigned

This was happening because Patricks script had --outLocation=/pnfs/fnal.gov/usr/cdf/scratch/ptl/latest/out$.tgz (a file) instead of the documented --outLocation=/pnfs/fnal.gov/usr/cdf/scratch/ptl/latest/ (a directory).

Modified jobsub server to handle both cases correctly.