Project

General

Profile

Support #5556

Processing: properly reduce network traffic for the 4 far nearline machines

Added by Michael Baird over 5 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Start date:
03/01/2014
Due date:
% Done:

0%

Estimated time:
40.00 h
Duration:

Description

This involves lots:

  • properly set up output disks on each nearline machine
  • properly set up novasoft releases on each machine (only install and build on one machine, then rsync over to the others)
  • set all machines up so that they are looking only at one of them for the DONE and LOCK files
  • properly copy raw files over to a local disk for processing (then delete local copies when done)
  • have each machine do its own rsyncing and cleanup


Also available in: Atom PDF