YOUR SHIFT » History » Version 40
Maciej Pfutzner, 11/11/2014 08:21 AM
Link to OM guide was wrong
1 | 26 | Benton Pahlka | h1. YOUR SHIFT: Important notes for shifters: |
---|---|---|---|
2 | 1 | Benton Pahlka | |
3 | 21 | Benton Pahlka | h2. %{color:red}You should have a pair of shoes with you because you may need to go underground. Sandals, flip-flops, high heels, etc are not appropriate footwear for underground access.% |
4 | 19 | Benton Pahlka | |
5 | 23 | Benton Pahlka | ** %{color:red}Please check your own training at: "training status":http://minos-om.fnal.gov/cgi-bin/fluffy.cgi .% |
6 | 22 | Benton Pahlka | * Has it expired? Then renew it immediately. |
7 | 22 | Benton Pahlka | * Is it about to expire? Then renew it so it won't lapse. |
8 | 22 | Benton Pahlka | |
9 | 21 | Benton Pahlka | h2. You should have been here at least 15 minutes early to: |
10 | 20 | Benton Pahlka | |
11 | 20 | Benton Pahlka | * Talk to either the previous shift physicist or a crew member and discuss what happened during their shift |
12 | 20 | Benton Pahlka | * Note any new problems found or old ones fixed. |
13 | 20 | Benton Pahlka | * Inquire whether there were any hardware changes, special activities etc. |
14 | 20 | Benton Pahlka | * Inquire if anyone is underground. |
15 | 20 | Benton Pahlka | * Ask if there are any requests for special data taking and remind them to release DAQ control before they leave |
16 | 22 | Benton Pahlka | * Make sure the Minerva shifters are away of these, and explain what they should do if the problem arises. |
17 | 20 | Benton Pahlka | * Wish the previous shifter a safe drive home. |
18 | 20 | Benton Pahlka | |
19 | 12 | Benton Pahlka | h2. Where to go for help |
20 | 13 | Benton Pahlka | |
21 | 16 | Benton Pahlka | * "MINOS Shifter Guide Number 1":http://www-numi.fnal.gov/Minos/ControlRoom/ShiftersGuide.pdf |
22 | 14 | Benton Pahlka | |
23 | 16 | Benton Pahlka | * "MINOS Shifter Guide Number 2":http://www-numi.fnal.gov/doe_feb_05_review/McrGuide1_0.doc |
24 | 13 | Benton Pahlka | |
25 | 40 | Maciej Pfutzner | * "The Online Monitoring Manual":http://www-numi.fnal.gov/numinotes/restricted/pdf/numi0903/numi0903.pdf |
26 | 12 | Benton Pahlka | |
27 | 29 | Arthur Kreymer | * CRATE-MASTER-MINDER-CHANNEL map for ND |
28 | 1 | Benton Pahlka | |
29 | 29 | Arthur Kreymer | CRATE |
30 | 29 | Arthur Kreymer | | 0 | 1 | |
31 | 29 | Arthur Kreymer | | 2 | 3 | |
32 | 29 | Arthur Kreymer | | 4 | 5 | |
33 | 29 | Arthur Kreymer | | 6 | 7 | |
34 | 29 | Arthur Kreymer | |
35 | 29 | Arthur Kreymer | MASTER |
36 | 29 | Arthur Kreymer | | 09 | 10 | 11 | 12 | |
37 | 29 | Arthur Kreymer | | 13 | 14 | 15 | 16 | |
38 | 29 | Arthur Kreymer | | 17 | 18 | 19 | 20 | |
39 | 29 | Arthur Kreymer | | 21 | 22 | 23 | 24 | |
40 | 29 | Arthur Kreymer | |
41 | 30 | Arthur Kreymer | MINDER |
42 | 29 | Arthur Kreymer | | 0 | 1 | 4 | 5 | |
43 | 29 | Arthur Kreymer | | 2 | 3 | 6 | 7 | |
44 | 29 | Arthur Kreymer | |
45 | 29 | Arthur Kreymer | CHANNEL |
46 | 29 | Arthur Kreymer | | 00 | 01 | 02 | 03 | |
47 | 29 | Arthur Kreymer | | 04 | 05 | 06 | 07 | |
48 | 29 | Arthur Kreymer | | 08 | 09 | 10 | 11 | |
49 | 1 | Benton Pahlka | | 12 | 13 | 14 | 15 | |
50 | 30 | Arthur Kreymer | |
51 | 30 | Arthur Kreymer | FD CRATE-VARC-VMM-VADC-CHIP map |
52 | 30 | Arthur Kreymer | |
53 | 30 | Arthur Kreymer | CRATE |
54 | 30 | Arthur Kreymer | |
55 | 30 | Arthur Kreymer | CRATE |
56 | 30 | Arthur Kreymer | | 0 | 1 | 2 | 3 | |
57 | 30 | Arthur Kreymer | | 4 | 5 | 6 | 7 | |
58 | 30 | Arthur Kreymer | | 8 | 9 | 10 | 11 | |
59 | 30 | Arthur Kreymer | | 12 | 13| 14 | 15 | |
60 | 30 | Arthur Kreymer | |
61 | 30 | Arthur Kreymer | VARC-VMM |
62 | 30 | Arthur Kreymer | | 0-5 | 1-5 | 2-5 | |
63 | 30 | Arthur Kreymer | | 0-4 | 1-4 | 2-4 | |
64 | 30 | Arthur Kreymer | | 0-3 | 1-3 | 2-3 | |
65 | 30 | Arthur Kreymer | | 0-2 | 1-2 | 2-2 | |
66 | 30 | Arthur Kreymer | | 0-1 | 1-1 | 2-1 | |
67 | 30 | Arthur Kreymer | | 0-0 | 1-0 | 2-0 | |
68 | 30 | Arthur Kreymer | |
69 | 30 | Arthur Kreymer | VADC-CHIP |
70 | 30 | Arthur Kreymer | | 1-0 | 1-1 | 1-1 | |
71 | 30 | Arthur Kreymer | | 0-0 | 0-1 | 0-1 | |
72 | 29 | Arthur Kreymer | |
73 | 29 | Arthur Kreymer | |
74 | 25 | Benton Pahlka | |
75 | 17 | Benton Pahlka | h2. Shifter's ToDo List |
76 | 11 | Benton Pahlka | |
77 | 18 | Benton Pahlka | * ensure the highest uptime of both Far and Near detectors |
78 | 18 | Benton Pahlka | * diagnose and fix problems quickly and efficiently |
79 | 18 | Benton Pahlka | * alert the system experts and work with them in case of problems |
80 | 18 | Benton Pahlka | * perform regular inspections of the data taken |
81 | 24 | Benton Pahlka | * monitor detector systems and environment conditions |
82 | 1 | Benton Pahlka | * Regularly check DAQ, DCS status webpages |
83 | 25 | Benton Pahlka | * Spend time looking at the real time events using the event display |
84 | 1 | Benton Pahlka | * READ the previous CRL entries entered in the last 24 hours |
85 | 1 | Benton Pahlka | * RECORD anything anomalous in the CRL |
86 | 25 | Benton Pahlka | * Enter new problems into the JIRA issue tracking system |
87 | 25 | Benton Pahlka | * fill out %{color:red}shifter's checklists% |
88 | 10 | Benton Pahlka | |
89 | 10 | Benton Pahlka | |
90 | 25 | Benton Pahlka | h2. %{color:red}Shifter's Checklist Forms% |
91 | 19 | Benton Pahlka | |
92 | 19 | Benton Pahlka | It's important to let the online statistics accumulate, so make sure that the data run has been running for at least two hours before proceeding with the checklist. |
93 | 10 | Benton Pahlka | |
94 | 10 | Benton Pahlka | * Start_Shift |
95 | 19 | Benton Pahlka | * DCSChecklist_Near |
96 | 19 | Benton Pahlka | * DCSChecklist_Far |
97 | 1 | Benton Pahlka | * OMCheckListNear |
98 | 19 | Benton Pahlka | * OMCheckListFar |
99 | 35 | Donatella Torretta | * Beam |
100 | 4 | Benton Pahlka | * End_Shift |
101 | 5 | Benton Pahlka | |
102 | 5 | Benton Pahlka | h2. Please click "Update" or "Latest" (or "Current") on NuMI elog before inserting plots |
103 | 4 | Benton Pahlka | |
104 | 2 | Benton Pahlka | |
105 | 2 | Benton Pahlka | h2. Job List |
106 | 19 | Benton Pahlka | |
107 | 7 | Phil Adamson | |
108 | 33 | Donatella Torretta | * The 'Big Green button' has been replaced by the "A9 Event Monitoring Web page":http://dbweb3.fnal.gov:8080/ifbeam/app/a9_monitor .The top portion should be green and always be up to date, updating once per second. Please restart the page promptly if it gets stuck, and note the time in the ECL. |
109 | 2 | Benton Pahlka | |
110 | 2 | Benton Pahlka | * The Far Detector needs to be notified of beam downtime as follows. |
111 | 2 | Benton Pahlka | If the beam will be down for long enough from 07:30-17:30, please notify the mine crew. |
112 | 2 | Benton Pahlka | ** If there is downtime of at least half an hour notify Soudan. |
113 | 2 | Benton Pahlka | ** If you learn of an all-day shutdown coming in the near future, inform the Run Coordinator and Soudan. |
114 | 9 | Arthur Kreymer | |
115 | 9 | Arthur Kreymer | * Please stop and restart OM Gui at the beginning of your shift, it leaks memory. |
116 | 1 | Benton Pahlka | |
117 | 9 | Arthur Kreymer | * When filling in the Near Detector OM check-list please make sure that the socket is "open", and that the status canvas gives a current time stamp. |
118 | 9 | Arthur Kreymer | ** When the MINERvA shifter completes their ND OM checklist and shuts down their monitoring window it closes our connection. |
119 | 9 | Arthur Kreymer | |
120 | 34 | Donatella Torretta | * ( this is obsolete: will be updated asap) The 'Big Green Button' shows file write latency. It flashes orange if this goes over 3 seconds, and turns red if the file is badly out of date. In this case, restart the Beam data logger, as described at [[BEAMDATA]] |
121 | 1 | Benton Pahlka | |
122 | 22 | Benton Pahlka | |
123 | 22 | Benton Pahlka | * Check for good beam data logging at http://www-numi.fnal.gov/Minos/ControlRoom/beamdata/LastOnLineBeam.html. This plot is updated daily. Check reference plots at "BEAMDATA":http://www-numi.fnal.gov/Minos/ControlRoom/beamdata/LastOnLineBeam.html |
124 | 1 | Benton Pahlka | |
125 | 1 | Benton Pahlka | * You need to post the Beam Shift Plots using NUMI Elog and Minos CRL sessions on minos-acnet, from the files in /home/minos/BeamPlots . The NFS server which made these available in /misc/mcr/... has been retired, |
126 | 3 | Benton Pahlka | |
127 | 1 | Benton Pahlka | * The Minerva Control Room Logbook is at http://dbweb0.fnal.gov/ECL/minerva |
128 | 1 | Benton Pahlka | |
129 | 1 | Benton Pahlka | * If G:RD1224 comes into alarm at 14:30, this is expected. If the alarm won't clear after 14:45, call MCR and ask them to remove multiwire 112 from the NuMI beamline. An alert box will pop up on minos-om console to remind you. |
130 | 9 | Arthur Kreymer | |
131 | 28 | Arthur Kreymer | * If Firefox starts giving errors, then restart it. |
132 | 1 | Benton Pahlka | |
133 | 1 | Benton Pahlka | * Please check the Run Control GUI, DCS status pages, and JAS regularly for warnings. The shifter is the 1st responder to these error conditions and should notice alarms on the time scale of minutes (not hours). |
134 | 1 | Benton Pahlka | |
135 | 39 | Donatella Torretta | * If you need to stop/start a run, please **always start RH24Hour sequence**, unless instructed otherwise. This will take care that all the necessary OM plots are filled. |
136 | 36 | Donatella Torretta | |
137 | 1 | Benton Pahlka | * Please watch the LCW output temperature on the ND DCS Magnet Status section. We have had problems with a water filter clogging up, which will take down both the ND and the NuMI absorber if it stopped up. If the temperature gets very high (>75) or increases quickly (so that it will reach 80 F in less than a day) call the Run Coordinator, then John Voirin or Bill Moorhouse. The temperature regulation is set at 67 F. |
138 | 1 | Benton Pahlka | ** This will also restrict cooling to the NuMI absorber. Please let the NuMI Beam Coordinator (Sam Childress or Peter Lucas) that there is a problem so they can watch that temperature. |
139 | 1 | Benton Pahlka | |
140 | 9 | Arthur Kreymer | * Due to budget cuts, we are able to access the far detector only during regular hours (weekend days are still ok) except in emergencies, where loss of data doesn't count as an emergency. |
141 | 9 | Arthur Kreymer | |
142 | 1 | Benton Pahlka | * The Soudan On Call Phone number will not work at night. Instead, call Bill Miller or Jerry Meier, plus the run coordinator (Greg or Chris) and we will figure out if it's a real emergency or if budget cuts will be costing us data. |
143 | 1 | Benton Pahlka | ** If Bill doesn't answer his cell, try his home number. If he's at home, his land line works and cell coverage doesn't dip down next to the lake. |
144 | 1 | Benton Pahlka | |
145 | 1 | Benton Pahlka | * The ND magnet can now be controlled remotely (E:NDMAG on ACNET). This includes changing polarity, turning the power supply on and off, and setting the current (a setting value of 4990 produces a current readback of 4973 amperes). The setting is an unsigned number; the current readback is a negative number. There is a status bit that indicates polarity. For further information see [this link|http://www-numi.fnal.gov/Minos/ControlRoom/nd_magnet.html]. |
146 | 1 | Benton Pahlka | |
147 | 22 | Benton Pahlka | |
148 | 1 | Benton Pahlka | |
149 | 1 | Benton Pahlka | * Answering the telephone |
150 | 1 | Benton Pahlka | ** Please let people know where they've called and who you are! E.g. |
151 | 1 | Benton Pahlka | ** "MINOS Control Room, this is Fred Jones" would suffice. |
152 | 1 | Benton Pahlka | ** Please try to always answer the telephone in a timely manner. If you need to step out for a few minutes check the caller ID on the phones when you get back. Call back all numbers that went unanswered. |
153 | 1 | Benton Pahlka | |
154 | 6 | Benton Pahlka | * Put a note in the logbook when you call experts or the run coordinator, at least the first time in a thread. |
155 | 6 | Benton Pahlka | |
156 | 6 | Benton Pahlka | |
157 | 27 | James Hylen | h2. Swing and Owl shifts are again being covered by Minerva |
158 | 6 | Benton Pahlka | |
159 | 27 | James Hylen | The swing and owl shifts are currently being run by the Minerva shifters. Here are the instructions that apply in that situation: |
160 | 6 | Benton Pahlka | |
161 | 6 | Benton Pahlka | The MINOS shifters should arrive at the control room at the start of their shifts, and should: |
162 | 6 | Benton Pahlka | |
163 | 6 | Benton Pahlka | * Deal with any problems they find |
164 | 27 | James Hylen | * Go through the checklists with the previous MINOS shifters (except there won't be one) |
165 | 6 | Benton Pahlka | * Bring themselves up-to-date on any outstanding issues or problems likely to occur during the shift. |
166 | 6 | Benton Pahlka | |
167 | 6 | Benton Pahlka | |
168 | 6 | Benton Pahlka | Since there is now no overlap between MINOS shifters, it is __vital__ that regular use is made of the CRL to pass on information, and ensure the following shifter knows the status of the detectors. |
169 | 6 | Benton Pahlka | |
170 | 6 | Benton Pahlka | The MINOS on-call shifter should make a logbook entry from home any time they are called. They should log: |
171 | 6 | Benton Pahlka | * What caused the call to be made |
172 | 6 | Benton Pahlka | * What action they took |
173 | 6 | Benton Pahlka | * Any action they told the Minerva shifter to take |
174 | 6 | Benton Pahlka | * Any phonecalls with MINOS experts they made or received. |
175 | 6 | Benton Pahlka | |
176 | 6 | Benton Pahlka | Minerva currently doesn't have access to the MINOS CRL. They should use the blue electronic post-it note on the minos-om. They should log in this any interventions with the MINOS systems, or relevant information such as phonecalls with MINOS experts. The MINOS day shifter should transfer this information to the MINOS CRL at the start of their shift. |
177 | 1 | Benton Pahlka | |
178 | 1 | Benton Pahlka | * Congratulations you made it this far! Please note in the CRL logbook that you actually read the memopad and know what to do on shift. |