Project

General

Profile

Review Request #6142

Review Request #6135: Data Management Workflow Umbrella Task

Job Bookkeeping

Added by Gabriel Perdue over 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Start date:
05/02/2014
Due date:
09/02/2014
% Done:

100%

Estimated time:
Duration: 124

Description

Adopt the following procedures to manage production job bookkeeping:
a. Minerva should do “missing/failed job” bookkeeping using a system
that is not susceptible to the identified race condition in their existingproduction scripts. The SAM data handling system is immune to the
condition. It should be used where possible.
b. Remove the race condition that allows multiple jobs to process the
same file and produce output files that are not identical. [possibly
completed]
c. Prevent overwrite of files that get multiply processed
i. Rework the file locking system to use robust bookkeeping
patterns

History

#1 Updated by Daniel Ruterbories over 4 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

Done via sam.

#2 Updated by Daniel Ruterbories over 4 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF