Project

General

Profile

Support #6118

Review Request #6135: Data Management Workflow Umbrella Task

Test Data Production into dCache Scratch

Added by Gabriel Perdue over 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Start date:
05/02/2014
Due date:
06/18/2014
% Done:

100%

Estimated time:
Duration: 48

Description

--dcacheout option created.


Related issues

Related to MINERvA Software Infrastructure - Support #6163: Can't check checksum in /pnfs/scratch, breaks some storage methodsClosed05/04/201405/19/2014

History

#1 Updated by Gabriel Perdue over 5 years ago

  • Due date set to 06/02/2014
  • Status changed from New to Closed

#2 Updated by Gabriel Perdue over 5 years ago

  • Parent task set to #6135

#3 Updated by Gabriel Perdue over 5 years ago

  • Status changed from Closed to New
  • % Done changed from 100 to 90

Getting files from dCache to FTS is not working.

#4 Updated by Heidi Schellman over 5 years ago

Currently done by hand running a script

Occasional issue with CRC errors in race condition

Updated script checks file size but not CRC

Need to automate as part of validation.

Ie, works but not production quality

#5 Updated by Heidi Schellman over 5 years ago

  • Assignee set to Jaewon Park

MC works but need to test chained Data processing. Jaewon is looking into this.

#6 Updated by Heidi Schellman over 5 years ago

  • Subject changed from Test Production into dCache Scratch to Test Data Production into dCache Scratch
  • % Done changed from 90 to 50

MC is done but still requires hand intervention to generate sam metadata

Jaewon working on Data

#7 Updated by Heidi Schellman over 5 years ago

  • Due date changed from 06/02/2014 to 06/18/2014

changed the due date to 6/18/2014 to reflect delay on final testing of the data part due to conferences.

#8 Updated by Daniel Ruterbories over 4 years ago

  • Status changed from New to Closed

Closed as we currently are placing big production files into dCache.

#9 Updated by Daniel Ruterbories over 4 years ago

  • % Done changed from 50 to 100


Also available in: Atom PDF