Project

General

Profile

Bug #6676

Milestone #5333: Incorporate functionality of cdfcaf into JobSub

Milestone #6689: Incorporate initial Run II Functionality for v0.4

dropbox location and submit location end up on different hosts in DNS round robin setup

Added by Dennis Box almost 5 years ago. Updated almost 5 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
07/25/2014
Due date:
07/30/2014
% Done:

100%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:
Duration: 6

Description

When dropbox://some_file is part of a jobsub_submit incantation, there are two phases: first upload some_file then call jobsub_tools to generate and submit JDF with some_file included in the transfer_input_files list. If the submit URL is a round robin DNS, some_file can end up on a different machine than where the jobsub_tools JDF generation and submission happens. This results in 'file not found' errors.

I can think of two fixes off the top of my head, 1) configure a web server on each backend server that can serve up dropbox locations for that machine, and transfer_input_files on the JDF generating server contains a URL to the dropbox file, or 2) allow jobsub_server to submit explicitly to the same server that the dropbox lives on, bypassing the DNS round robin server. Number 2) is currently forbidden by our SSL security settings.

There may be better fixes that haven't occurred to me yet

History

#1 Updated by Dennis Box almost 5 years ago

  • Status changed from New to Resolved

#2 Updated by Parag Mhashilkar almost 5 years ago

  • Parent task set to #6689

#3 Updated by Parag Mhashilkar almost 5 years ago

  • % Done changed from 0 to 100

#4 Updated by Parag Mhashilkar almost 5 years ago

  • Status changed from Resolved to Closed

#5 Updated by Parag Mhashilkar almost 5 years ago

  • Due date set to 07/30/2014


Also available in: Atom PDF