Project

General

Profile

Support #15800

Milestone #15057: Minos SLF5 retirement

Support #15792: Individual Minos SLF5 node shutdowns

minos53 retirement

Added by Arthur Kreymer over 3 years ago. Updated about 3 years ago.

Status:
Closed
Priority:
High
Start date:
03/08/2017
Due date:
03/31/2017
% Done:

100%

Estimated time:
10.00 h
Duration: 24

Description

Retire minos53 by 2017 Apr 01

History

#1 Updated by Arthur Kreymer over 3 years ago

  • Status changed from Accepted to Assigned

#2 Updated by Arthur Kreymer over 3 years ago

  • Status changed from Assigned to Work in progress
  • % Done changed from 0 to 10

#3 Updated by Arthur Kreymer over 3 years ago

  • % Done changed from 10 to 20

Summary

Task Completed Comment
Ganglia 03/27 mostly idle from 03/21, minimal jtodd2 and annah1
procsum 03/27 idle from 03/27
opt 03/20 nothing needed
home 03/20 nothing needed
scratch 03/21 non-root to /minos/data/users/mindata/localscratch

Ganglia averages last day
Idle 99.8 %
Load 1 37 m
Net in 870
Net out 3 k

Residual sessions
20170327_09:09:01_procs.gz
 1162 annah1    15   0  114m 9752 3824 T  0.0  0.1   0:00.18 emacs -nw ZflukWeight.cxx
 1926 willhf    15   0 70468 1860 1356 S  0.0  0.0   0:00.04 -bash
11289 wingmc    15   0 71012 2000 1172 S  0.0  0.0   0:00.06 -tcsh
11332 wingmc    15   0 70620 2016 1344 S  0.0  0.0   0:00.18 bash
25737 wingmc    15   0 71020 1996 1172 S  0.0  0.0   0:00.07 -tcsh
25780 wingmc    15   0 70652 2092 1348 S  0.0  0.0   0:00.65 bash
26391 wingmc    15   0  121m  11m 4816 S  0.0  0.1   0:01.53 emacs Far210_ExtrapHists.sh
27567 wingmc    15   0  121m  11m 4808 S  0.0  0.1   0:01.06 emacs Far214_ExtrapHists.sh
28069 wingmc    15   0  121m  11m 4816 S  0.0  0.1   0:01.19 emacs NearMC_ExtrapHists.sh
28140 wingmc    15   0  121m  11m 4820 S  0.0  0.1   0:01.15 emacs NDDNew_ExtrapHists.sh
31055 annah1    15   0 70624 2040 1380 S  0.0  0.0   0:00.11 -bash

#4 Updated by Arthur Kreymer over 3 years ago

  • % Done changed from 20 to 80

#5 Updated by Arthur Kreymer over 3 years ago

RITM0543025 03/24  remove minos53 stray processes

We will request shutdown of minos53 Monday 03/27.

Meanwhile, there are several stray processs running since 03/17.
Please remove these user processes for cleaner monitoring.

In /var/log/prochistory there are entries like

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND             
 4617 rchen2    16   0 81336 1444  616 S  0.0  0.0   0:00.02 SCREEN
 4618 rchen2    17   0 70612 1996 1352 S  0.0  0.0   0:00.08 /bin/bash
26185 wingmc    22   0 71012 2012 1172 S  0.0  0.0   0:00.06 -tcsh
26228 wingmc    15   0 70624 2004 1344 S  0.0  0.0   0:00.22 bash
29065 wingmc    15   0  122m  12m 4912 S  0.0  0.1   0:06.85 emacs NueAna/MultiBinAna/NueFit2D.cxx

I would remove them, but userkill does not seem to be set up on minos53

    kreymer@minos53

sudo userkill 4618 KILL
[sudo] password for kreymer: 

#6 Updated by Arthur Kreymer over 3 years ago

  • % Done changed from 80 to 90
RITM0543792 03/27 minos53 shutdown
09:36

At your convenience, please shut down the minos53 system.
This SLF5 system is being retired.

See preparation details in https://cdcvs.fnal.gov/redmine/issues/15800

Please hold the hardware for a month before disposal,
in case we overlooked something.

_________________________________________________________________
2017-03-27 09:55:22 CDT - Etta Burns (Additional comments)
The server has been shut down as requested.

#7 Updated by Arthur Kreymer over 3 years ago

  • Status changed from Work in progress to Resolved
  • % Done changed from 90 to 100

http://minos.fnal.gov/computing/dh/procsum/minos53/minos53-20170327

20170327_09:49:01_procs.gz
 1926 willhf    15   0 70468 1860 1356 S  0.0  0.0   0:00.04 -bash
11289 wingmc    15   0 71012 2000 1172 S  0.0  0.0   0:00.06 -tcsh
11332 wingmc    15   0 70620 2016 1344 S  0.0  0.0   0:00.18 bash
25737 wingmc    15   0 71020 1996 1172 S  0.0  0.0   0:00.07 -tcsh
25780 wingmc    15   0 70652 2092 1348 S  0.0  0.0   0:00.65 bash
26391 wingmc    15   0  121m  11m 4816 S  0.0  0.1   0:01.54 emacs Far210_ExtrapHists.sh
27567 wingmc    15   0  121m  11m 4808 S  0.0  0.1   0:01.07 emacs Far214_ExtrapHists.sh
28069 wingmc    15   0  121m  11m 4816 S  0.0  0.1   0:01.20 emacs NearMC_ExtrapHists.sh
28140 wingmc    15   0  121m  11m 4820 S  0.0  0.1   0:01.16 emacs NDDNew_ExtrapHists.sh

#8 Updated by Arthur Kreymer about 3 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF