Project

General

Profile

Task #19923

BNL electronics data followup with shanshan gao

Added by Steven Timm over 1 year ago. Updated 12 months ago.

Status:
Work in progress
Priority:
Normal
Assignee:
Start date:
05/10/2018
Due date:
% Done:

60%

Estimated time:
Duration:

History

#1 Updated by Steven Timm over 1 year ago

  • Assignee set to Steven Timm

#2 Updated by Steven Timm about 1 year ago

  • Status changed from New to Work in progress
  • % Done changed from 0 to 10

copying data from nfs to EOS using interactive recursive xrdcp.

#3 Updated by Steven Timm about 1 year ago

  • % Done changed from 10 to 30

all is now to EOS, have to follow up with Shanshan and see if he wants it in this format or tarred up.

#4 Updated by Steven Timm about 1 year ago

  • % Done changed from 30 to 40

Shanshan says it is OK to tar up the low level dirs.
Need to do one more pass first to be sure we got everything, then we will do the tars and dump the tars into a dropbox.

#5 Updated by Steven Timm about 1 year ago

  • % Done changed from 40 to 60

Tar script is working in the background.. it will probably take most of a week to tar everything up, just in directory APA1 out of 1-6, about 75% done with that just from running overnight.

#6 Updated by Steven Timm 12 months ago

This has taken quite some time because every EOS tar fills up the disk space on protodune-fts2.cern.ch with the eos fuse log.. still working.
Checked to see if I could do the tarring on np04-srv-003 and friends, but no because shanshan has deleted some of the original files from the nfs area now so the eos copies are all we have.

#7 Updated by Steven Timm 12 months ago

New batch of 72000 files started today.. about 25% through so far.

#8 Updated by Steven Timm 12 months ago

New batch of files complete but need to check integrity, then start tarring.



Also available in: Atom PDF