Project

General

Profile

Feature #7825

use archftp for archiving all data

Added by Arthur Kreymer almost 5 years ago. Updated about 4 years ago.

Status:
Resolved
Priority:
High
Start date:
02/10/2015
Due date:
05/15/2015
% Done:

100%

Estimated time:
3.00 h
Duration: 95

Description

I have deployed a new archftp script on minos-dcs0-nd
which could in principal be used for all nd/fd daq/dcs and beam.
Just a couple of files to put in the right place for security.
Will try with near_dcs, then far, then beam, then data.

History

#1 Updated by Arthur Kreymer over 4 years ago

  • Due date changed from 02/19/2015 to 02/26/2015
  • % Done changed from 20 to 30

Near notes from 02/10

Installing script

cd bin
ADM=/afs/fnal.gov/files/expwww/numi/html/computing/admin/archiver
scp :${ADM}/archftp archftp.20150210

ln -sf archftp.20150210 archftp

config files

cp -a /home/minos/kt/minoskt /dcsdata/archiver/kt
echo "" > /dcsdata/archiver/ktp

#2 Updated by Arthur Kreymer over 4 years ago

Moved beam archiver forward, did not restart on minos-nearline reboot.

cd bin
ADM=/afs/fnal.gov/files/expwww/numi/html/computing/admin/archiver
scp :${ADM}/archftp archftp.20150210

ln -s archftp.20150210 archftp
updated bin/init/archiver slightly, fill in details later.
run ${HOME}/bin/archftp
set DDIR based on directory existence

#3 Updated by Arthur Kreymer over 4 years ago

  • % Done changed from 30 to 70

Kerberized ftp has been installed on all DAQ systems
RITM0176669 03/02 Minos DAQ kftp

I have written to DCache on all archiver systems

minos-daq24-nd
minos-dcs00-nd
minos-daq24-fd
minos-dcs00-fd
minos-nearline ( mindata )

The test is

[ -x "/usr/kerberos/bin/kinit" ] && KINIT=/usr/kerberos/bin/kinit # RH 5
[ -x "/usr/bin/kinit"          ] && KINIT=/usr/bin/kinit          # RH 6
[ -x "/usr/krb5/bin/kinit"     ] && KINIT=/usr/krb5/bin/kinit     # FNAL

echo ${KINIT}

export KRB5CCNAME=FILE:/tmp/krb5cc_minos_archiver

for DD in /minos/app/BEAMDATA_CF/MBEAM /daqdata /dcsdata ; do
[ -d "${DD}" ] &&  DATADIR="${DD}" 
done

echo  ${DATADIR}
ls -l ${DATADIR} | less

FTPTO="fndca1.fnal.gov 24127" 
   KEYTAB="${DATADIR}/archiver/kt" 
PRINCIPAL=`cat ${DATADIR}/archiver/ktp`

echo ${KEYTAB}
echo ${PRINCIPAL}

    ${KINIT} -5 -A  -k -t ${KEYTAB} ${PRINCIPAL}

klist -f

ftp ${FTPTO}

minosraw
cd scratch/users/minosraw
put /etc/termcap TEST
ls
delete TEST
ls
quit

#4 Updated by Arthur Kreymer over 4 years ago

  • Due date changed from 02/26/2015 to 05/15/2015
  • % Done changed from 70 to 30

Notes from 02/19 setup on minos-daq24-fd in response to ftp problems.
Reverted to old scripts, due to lack of kerberized ftp then.
Could move ahead now.

minos@minos-daq24-fd

script
root@minos-daq24-fd

cd ~minos/bin
ADM=/afs/fnal.gov/files/expwww/numi/html/computing/admin/archiver
scp :${ADM}/archftp archftp.20150210

ln -sf archftp.20150210 archftp

config
minos@minos-daq24-fd

cp -a /daqdata/.krb5/minoskt /daqdata/archiver/kt
echo "" > /daqdata/archiver/ktp

#5 Updated by Arthur Kreymer about 4 years ago

  • Priority changed from Normal to High

Need to move ahead with this, due to recent system upgrades.

kreymer lacks root access to minos-daq24-nd and fd.

#6 Updated by William Badgett about 4 years ago

Added kreymer to root .k5login on minos-daq24-nd, -fd

#7 Updated by Arthur Kreymer about 4 years ago

Moved symlink to keytab on minos-nearline and minos-data .

cd /minos/app/BEAMDATA_CF/MBEAM/archiver
ln -sf /opt/mindata/kt kt # was /var/tmp/mindata/.krb5/kt

#8 Updated by Arthur Kreymer about 4 years ago

Per discussion with litvinse, for long term support,
we should change the ftp path from relative to absolute,

cd /pnfs/fnal.gov/usr/minos/...

#9 Updated by Arthur Kreymer about 4 years ago

  • % Done changed from 30 to 60

3 of the 5 streams use the new archftp archiver ( Beam, DCS's )

I will convert the Data streams today.

First will inventory what is running everywhere,
then move the Data systems to uniform init and archftp scripts.

The same init and archiver script should be used everywhere.

#10 Updated by Arthur Kreymer about 4 years ago

  • % Done changed from 60 to 90

Deployed uniform scripts to all systems, and restarted archivers
All seems to be well.

${HOME}/bin/archftp
${HOME}/bin/init/archive

On minos-daq24-* ${HOME}/bin symlinks to /opt/minos-online/bin

I will commit these early tomorrow to CVS admin/archiver

Also will post an executive summary here.

#11 Updated by Arthur Kreymer about 4 years ago

minos-daq01-fd is still running the old archiver scripts, as it lacks ftp.

#12 Updated by Arthur Kreymer about 4 years ago

Updated bin/init/archiver to correctly start and stop.
use ${user} to get path to bin/archftp
create pid file under su_minos

Updated bin/archftp to break out file loop on FTP error

Deployed Fri 2015 Oct 9, on minos-daq24-nd

#13 Updated by Arthur Kreymer about 4 years ago

I copied the latest scripts back from minos-daq24-nd to my cvs working area,
and from there all the other servers, restarting archivers everywhere.l

account system
root minos-daq24-fd
minos dcsdcp
minos minos-dcs02-nd
mindata minos-nearline

After a week or so of stability, it would be good to remove the symlinks.

Typical installation

    to minos-daq24-fd

AP=kreymer@minos-data:/afs/fnal.gov/files/expwww/numi/html/computing/admin/archiver

cd /opt/minos-online/bin

scp ${AP}/archftp.20151009             archftp.20151009
scp ${AP}/init-archiver.20151009 init/archiver.20151009

ln -sf  archftp.20151009 archftp  # was archftp.20150210
cd init
mv archiver archiver.20151007 # hard coded path
ln -sf archiver.20151009 archiver 

archiver start
tail /daqdata/archiver/archftp.log 
Thu Oct 15 15:18:25 CDT 2015 START version 20151009

#14 Updated by Arthur Kreymer about 4 years ago

  • Status changed from Assigned to Resolved
  • % Done changed from 90 to 100
Version archftp.20151026
  • full path to /usr/krb5/bin/ftp
    • This was an issue only for minos, not root, on DAQ systems
      • /sbin/service daq archiver start
  • corrected path to .stop
  • new steep function sleeps and polls for .stop every 10 seconds

The archiver archftp script was updated to the 20151026 version
at the following times

10:05 ND DAQ
10:54 ND DCS
11:15 FD DAQ
11:21 FD DCS
11:35 Beam data
steep()
{
    (( SIT = ${1} / 10 ))
    sleep ${1} &  # for diagnostic
    for ITER in `seq 1 ${SIT}` ; do
        if [ -r "${DATADIR}/archiver/.stop" ] ; then
            printf "`date` EXIT due to stop file \n" 
        exit 0
        fi
        sleep 10
    done
}


Also available in: Atom PDF