Project

General

Profile

Support #25182

final /grid/data cleanup for Data Preservation

Added by Arthur Kreymer 5 months ago. Updated 5 months ago.

Status:
Resolved
Priority:
Normal
Start date:
11/09/2020
Due date:
11/30/2020
% Done:

100%

Estimated time:
3.00 h
Duration: 22

Description

This work is related to Data Preservation.

Minos data files were moved from /grid/data to /minos/data many years ago.

When checking file systems after recent SL7 updates to minos servers,
I found a few minos files remaning in /grid/data.

/grid/data/minos is all symlinks to /minos/data/grid-data or /minos/data.

/grid/data/e875/LOCK is a set of CPN log files.

I will have the /grid/data/minos/* links replaced
with a top level link to /minos/data/grid-data.

We have not needed CPN since Oct 2016
when /minos/data was unmounted from Fermigrid.
CPN seems to have last been used in April 2017.

I will archive the e875/LOCK files to /minos/data/grid/data/LOCK
and put in a symlink for compatibility.

All of this is transparent to the users.

History

#1 Updated by Arthur Kreymer 5 months ago

The /grid/data compatibility symlinks need to be consolidated for a couple of reasons.
Cleanliness - one symlink in /grid/data to /minos/data/grid/dzta would do the work of the present 19 links
Maintenance - the existing links are mostly owned by the root and rubin accounts.

#2 Updated by Arthur Kreymer 5 months ago

  • % Done changed from 20 to 50
  • Status changed from Assigned to Work in progress

I have moved the obsolete CPN LOCK files from /grid/data/e875/LOCK to /minos/data/grid-data/LOCK

This completed the cleanup of /grid/data/e875, leaving just /grid/data/minos links to be cleaned.

Details :

        mindata@minos-data

GDL=/grid/data/e875/LOCK

MDL=/minos/data/grid-data/LOCK

du -smc ${GDL}
2016    /grid/data/e875/LOCK
2016    total

ls -l ${MDL}
lrwxrwxrwx 1 minos gpcf 20 Sep 19  2015 /minos/data/grid-data/LOCK -> /grid/data/e875/LOCK

rm ${MDL}

cp -ax ${GDL}  ${MDL}

du -sm ${MDL}
2016    /minos/data/grid-data/LOCK

diff -r  ${GDL}  ${MDL}

find ${GDL} -type f | wc -l
281

find ${MDL} -type f | wc -l
281

date ; rm -r ${GDL}
Thu Nov 12 12:16:17 CST 2020

ln -s ${MDL} ${GDL}

ls -l ${GDL}
lrwxrwxrwx 1 mindata e875 26 Nov 12 12:16 /grid/data/e875/LOCK -> /minos/data/grid-data/LOCK

ls -l ${GDL}/
total 480
drwxrwxr-x 2 mindata e875 2048 Apr  8  2013 DO
-rwxr--r-- 1 mindata e875    3 Jun 28  2009 glimit
-rwxr--r-- 1 mindata e875    2 Nov 27  2012 limit
drwxrwxr-x 2 mindata e875 2048 Jan 15  2018 LOCKS
drwxrwxr-x 2 mindata e875 2048 Jan 15  2018 LOG
drwxr-xr-x 2 mindata e875 6144 Jan 15  2018 LOGS
-rw-r--r-- 1 mindata e875    2 Sep 25  2009 perf
-rw-r--r-- 1 mindata e875    3 Dec  4  2012 PERF
drwxrwxr-x 2 mindata e875 2048 Jan 15  2018 QUEUE
-rwxr--r-- 1 mindata e875    2 Dec  1  2012 rate
-rw-r--r-- 1 mindata e875    8 Aug 30  2010 small
-rw-r--r-- 1 mindata e875    2 Dec  6  2012 stale
drwxrwxr-x 4 mindata e875 2048 Aug 21  2009 STALE
-rw-r--r-- 1 mindata e875    2 Feb 19  2013 staleq
-rwxr--r-- 1 mindata e875    2 Aug 13  2009 wait

#3 Updated by Arthur Kreymer 5 months ago

  • % Done changed from 50 to 80

I issued RITM1042078 11/12 Link /grid/data/minos to /minos/data/grid-data

For Data Preservation, Minos is ready to replace 
/grid/data/minos with a symbolic link to 
/minos/data/grid-data

The /grid/data/minos area is owned by rubin ( deceaased ),
and the links under it are owned by various users.

Please remove the sybolic links under /grid/data/minos
and make /grid/data/minos a symbolic link to /minos/data/grid-data.

#4 Updated by Arthur Kreymer 5 months ago

  • % Done changed from 80 to 100
  • Status changed from Work in progress to Resolved

RITM1042078 has been completed.

It was not deemed appropriate to link /grid/data/minos to /minos/data/grid-data on a different file system.

Ownership of /grid/data/minos and its content was set to mindata, in the e875 group.
This gives us full control of these compatibility links.

I consider the /grid/data cleanup to be complete.

No files remain, and we can remove unneeded links in the future.

Also available in: Atom PDF