Support #17962
archive v5data/0248 to 0252
Description
/pnfs/annie/persistent/raw/v5data/0248 to 0252 are owned by brichard
and are not archived to tape.
Probably written directly Jan 11-19 bypassing /pnfs/annie/persistent/raw.
They need to be chowned to annieraw, and moved up for archiving.
History
#1 Updated by Arthur Kreymer almost 3 years ago
I will test this fix on one file, then the rest.
But not today, there is a dCache downtime scheduled today 09:00-11:00.
#2 Updated by Arthur Kreymer almost 3 years ago
I will probably start with run 0252, then the rest.
Here are file counts :
for RUN in `seq 248 252` ; do
printf "${RUN} " ; ls /pnfs/annie/persistent/raw/v5data/0${RUN} | wc -l
done
248 607
249 706
250 786
251 979
252 330
#3 Updated by Arthur Kreymer almost 3 years ago
I verified that chowning and moving the unarchived files to /pnfs/annie/persistent/raw should be OK.
Tested this on one file.
As root@if-admin-annie,
PR=/pnfs/annie/persistent/raw/
PRD=/pnfs/annie/persistent/raw/v5data/0252
FILE=V5DataR252S0p01Sep_26_2043.root
ls -l ${PRD}/${FILE}
-rw-r--r-- 1 51115 9467 579160415 Jan 18 2017/pnfs/annie/persistent/raw/v5data/0252/V5DataR252S0p01Sep_26_2043.root
chown 51481 ${PRD}/${FILE}
mv ${PRD}/${FILE} ${PR}/${FILE}
date
Fri Oct 20 12:54:32 CDT 2017
Then archived this file as annieraw@anniegpvm02
set nohup ; ${HOME}/archiver/fts-ftp
tail archiver/fts-ftp.log
fts-ftp 20170724
LIMIT 9999
Fri Oct 20 12:56:20 CDT 2017 on anniegpvm02.fnal.gov
V6DataR835S9p4T2Jul_27_0736.root already there
1/2 FILES NEEDED
Fri Oct 20 12:56:21 CDT 2017 V5DataR252S0p01Sep_26_2043.root
Fri Oct 20 12:56:36 CDT 2017
I verified that V6DataR835S9p4T2Jul_27_0736.root is a duplicate, and removed the duplicate.
#4 Updated by Arthur Kreymer almost 3 years ago
I set up the rest of run 252 for archiving,
first fixing directory ownerships
root@if-admin-annie
PR=/pnfs/annie/persistent/raw
PRD=/pnfs/annie/persistent/raw/v5data/0252
for DIR in 0248 0249 0250 0251 0252 ; do
PRX=${PR}/v5data/${DIR}
ls -ld ${PRX}
chown 51481 ${PRX}
ls -ld ${PRX}
done
date
drwxrwxr-x 609 51115 9467 512 Jan 11 2017 /pnfs/annie/persistent/raw//v5data/0248
drwxrwxr-x 609 51481 9467 512 Jan 11 2017 /pnfs/annie/persistent/raw//v5data/0248
drwxrwxr-x 708 51115 9467 512 Jan 13 2017 /pnfs/annie/persistent/raw//v5data/0249
drwxrwxr-x 708 51481 9467 512 Jan 13 2017 /pnfs/annie/persistent/raw//v5data/0249
drwxrwxr-x 788 51115 9467 512 Jan 15 2017 /pnfs/annie/persistent/raw//v5data/0250
drwxrwxr-x 788 51481 9467 512 Jan 15 2017 /pnfs/annie/persistent/raw//v5data/0250
drwxrwxr-x 981 51115 9467 512 Jan 18 2017 /pnfs/annie/persistent/raw//v5data/0251
drwxrwxr-x 981 51481 9467 512 Jan 18 2017 /pnfs/annie/persistent/raw//v5data/0251
drwxrwxr-x 332 51115 9467 512 Oct 20 12:56 /pnfs/annie/persistent/raw//v5data/0252
drwxrwxr-x 332 51481 9467 512 Oct 20 12:56 /pnfs/annie/persistent/raw//v5data/0252
Sat Oct 21 09:43:15 CDT 2017
FILES=`find ${PRD} -type f -user 51115 -exec basename {} \;`
printf "${FILES}\n" | wc -l
329
for FILE in ${FILES} ; do
chown 51481 ${PRD}/${FILE}
mv ${PRD}/${FILE} ${PR}/${FILE}
done
date
Sat Oct 21 09:53:38 CDT 2017
annieraw@anniegpvm02
set nohup ; ${HOME}/archiver/fts-ftp &
tail archiver/fts-ftp.log
fts-ftp 20170724
LIMIT 9999
Sat Oct 21 09:57:00 CDT 2017 on anniegpvm02.fnal.gov
329/329 FILES NEEDED
Sat Oct 21 09:57:02 CDT 2017 V5DataR252S0p1001Sep_27_0343.root
TIME 47
Sat Oct 21 09:58:03 CDT 2017 V5DataR252S0p1011Sep_27_0347.root
Sat Oct 21 09:58:19 CDT 2017 V5DataR252S0p101Sep_26_2125.root
#5 Updated by Arthur Kreymer almost 3 years ago
- Subject changed from rchive v5data/0248 to 0252 to archive v5data/0248 to 0252
- % Done changed from 0 to 50
I have set up the remaining files, runs 248-251 for archiving.
Archival will run via cron after 01:08
root@if-admin-annie
PR=/pnfs/annie/persistent/raw
for DIR in 0248 0249 0250 0251 ; do
PRD=${PR}/v5data/${DIR}
echo ${PRD}
FILES=`find ${PRD} -type f -user 51115 -exec basename {} \;`
printf "${FILES}\n" | wc -l
for FILE in ${FILES} ; do
chown 51481 ${PRD}/${FILE}
mv ${PRD}/${FILE} ${PR}/${FILE}
usleep 100000
done
date
done
date
/pnfs/annie/persistent/raw/v5data/0248
607
Sat Oct 21 22:34:52 CDT 2017
/pnfs/annie/persistent/raw/v5data/0249
706
Sat Oct 21 22:36:23 CDT 2017
/pnfs/annie/persistent/raw/v5data/0250
786
Sat Oct 21 22:38:06 CDT 2017
/pnfs/annie/persistent/raw/v5data/0251
979
Sat Oct 21 22:40:17 CDT 2017
#6 Updated by Arthur Kreymer almost 3 years ago
- Status changed from New to Resolved
- % Done changed from 50 to 100
The v5data archive to tape is complete.
One file failed the first time, but recovered automatically.
From annieraw archiver/fts-ftp.log
fts-ftp 20170724
LIMIT 9999
Sun Oct 22 01:08:01 CDT 2017 on anniegpvm02.fnal.gov
3078/3078 FILES NEEDED
Sun Oct 22 01:08:47 CDT 2017 V5DataR248S0p01Sep_14_2032.root
Sun Oct 22 01:09:01 CDT 2017 V5DataR248S0p101Sep_14_2114.root
Sun Oct 22 01:09:14 CDT 2017 V5DataR248S0p111Sep_14_2118.root
...
Sun Oct 22 02:26:04 CDT 2017 V5DataR248S2p431Sep_15_0304.root
OOPS V5DataR248S2p431Sep_15_0304.root
-rw-r--r-- 1 annieraw annie 580029366 Jan 10 2017 /pnfs/annie/persistent/raw/V5DataR248S2p431Sep_15_0304.root
-rw-r--r-- 1 annieraw annie 580029366 Oct 22 02:26 /pnfs/annie/raw/v5data/0248/V5DataR248S2p431Sep_15_0304.root
persistent MD5 e1332e5f73c7d322c771b341c8521acb
enstore MD5 6c8a99161a5b7789892a927b9d6fa15c
Sun Oct 22 02:26:18 CDT 2017 V5DataR248S2p441Sep_15_0308.root
...
Sun Oct 22 14:14:54 CDT 2017 V5DataR251S7p91Sep_26_1624.root
Sun Oct 22 14:15:11 CDT 2017
fts-ftp 20170724
LIMIT 9999
Mon Oct 23 01:08:02 CDT 2017 on anniegpvm02.fnal.gov
1/1 FILES NEEDED
Mon Oct 23 01:08:02 CDT 2017 V5DataR248S2p431Sep_15_0304.root
TIME 41
Mon Oct 23 01:09:07 CDT 2017