Rack Power ONOFF procedures » History » Version 91
Sophie Berkman, 09/19/2019 03:40 PM
1 | 1 | Sowjanya Gollapinni | h1. Rack Power OFF procedures for planned power outages |
---|---|---|---|
2 | 56 | David Caratelli | |
3 | 56 | David Caratelli | *%{color:red}@Before a power-outage occurs@%*: alert Cryo engineers of planned MicroBooNE outages 1 week in advance. |
4 | 1 | Sowjanya Gollapinni | |
5 | 10 | Sowjanya Gollapinni | *Who does this:* In the normal mode of operation, it is expected that ONLY sub-system experts (most probably on-call experts) will do the power off for their respective sub-systems. It is only in their absence and upon approval from the run coordinator that others will be allowed to do this. |
6 | 1 | Sowjanya Gollapinni | |
7 | 67 | Sophie Berkman | *Step 0:* Go on the platform, with all requirements: Closed-toed shoes, and most importantly, Two-person rule! |
8 | 10 | Sowjanya Gollapinni | |
9 | 23 | Sowjanya Gollapinni | h2. %{color:green}@Readout Electronics Racks Power-Off/On Procedure:@% |
10 | 1 | Sowjanya Gollapinni | |
11 | 10 | Sowjanya Gollapinni | *Step 1:* Make sure the software DAQ/read-out processes are not running. In other words, this means that the platform power off procedure should ONLY be done AFTER the DAQ/read-out processes are brought down gracefully by the DAQ experts. Confirm from the On-call DAQ expert and the uB operator on shift that this is the case before proceeding. |
12 | 3 | Sowjanya Gollapinni | |
13 | 67 | Sophie Berkman | *%{color:red}@Remember, the racks should be powered off in the following order, and following indicated steps.@%* |
14 | 4 | Sowjanya Gollapinni | |
15 | 2 | Sowjanya Gollapinni | *Side note:* For reference, we are following the reverse of the prescription as written in |
16 | 2 | Sowjanya Gollapinni | http://microboone-docdb.fnal.gov:8080/cgi-bin/RetrieveFile?docid=3825&filename=TPC-R1_Power-up.pdf&version=10 |
17 | 2 | Sowjanya Gollapinni | |
18 | 1 | Sowjanya Gollapinni | *1. TPC-R2 through TPC-R5 power off:* |
19 | 58 | David Caratelli | 0. Make sure DAQ is down. |
20 | 1 | Sowjanya Gollapinni | a. Switch off both Wiener PS using the red toggle switch on the front panel (gently push down the toggle switch for 3 seconds until the display turns off). |
21 | 5 | Sowjanya Gollapinni | b. Switch off the middle (CB2) and lowest (CB3) circuit breaker (circuit breaker switches have blue LEDs lit on them) by accessing the back side of the rack; verify fans are off. |
22 | 68 | Sophie Berkman | c. Switch off top (CB1) circuit breaker; verify NetGear network switch inside rack is off. Look to see if lights on the top right side are off. |
23 | 11 | Sowjanya Gollapinni | d. Switch off Slow controls using front panel switch on the slow controls panel (gently pull the Chassis on/off switch and press down). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
24 | 68 | Sophie Berkman | e. Switch off the RPS (use switch located on the back panel of the RPS unit). Go behind the racks and use a step stool to reach the switch, if needed. The switch is black and in the top right. Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box, located at the bottom on the front of the rack, are off. |
25 | 69 | Sophie Berkman | f. Only the AC Input Good LED on the AC Switch Box, located at the bottom of the front of the rack, should be ON. |
26 | 2 | Sowjanya Gollapinni | |
27 | 2 | Sowjanya Gollapinni | *2. TPC-R1 power off:* |
28 | 58 | David Caratelli | 0. Make sure DAQ is down. |
29 | 5 | Sowjanya Gollapinni | a. Switch off Wiener PS using the red toggle switch on the front panel (gently push down the toggle switch for 3 seconds until the display turns off). |
30 | 14 | Sowjanya Gollapinni | b. Switch off the lowest (CB3) circuit breaker; verify fans are off. |
31 | 14 | Sowjanya Gollapinni | c. Switch off the middle (CB2) circuit breaker; verify NetGear network switch inside rack is off. |
32 | 14 | Sowjanya Gollapinni | d. Switch off Slow controls using front panel switch on the slow controls panel (gently pull the Chassis on/off switch and press down). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
33 | 14 | Sowjanya Gollapinni | e. Switch off the RPS (use switch located on the back panel of the RPS unit). Go behind the racks and use a step stool to reach, if needed; verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
34 | 2 | Sowjanya Gollapinni | f. Only the AC Input Good LED on the AC Switch Box should be ON. |
35 | 2 | Sowjanya Gollapinni | |
36 | 2 | Sowjanya Gollapinni | *3. LIZ Rack power off:* |
37 | 58 | David Caratelli | 0. Make sure DAQ is down. |
38 | 2 | Sowjanya Gollapinni | a. Switch off the two NIM bins using their front panel switches. |
39 | 69 | Sophie Berkman | b. Switch off the Tektronix function generator (Strobe pulser) using its front panel on/off button. |
40 | 69 | Sophie Berkman | c. Switch off the both fan switches on the fan front panels. The top fan is a green button, the lower one is a silver switch in the center. Verify the fans are off. |
41 | 82 | Sophie Berkman | d. Switch off the middle (CB2), top (CB1), and bottom (CB3) circuit breakers. Note: lights on the top two breakers are broken. |
42 | 11 | Sowjanya Gollapinni | e. Switch off Slow controls using front panel switch on the slow controls panel (gently pull the Chassis on/off switch and press down). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
43 | 5 | Sowjanya Gollapinni | f. Switch off the RPS (use switch located on the back panel of the RPS unit). Go behind the racks and use a step stool to reach, if needed; verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
44 | 1 | Sowjanya Gollapinni | g. Only the AC Input Good LED on the AC Switch Box should be ON. |
45 | 2 | Sowjanya Gollapinni | |
46 | 5 | Sowjanya Gollapinni | *4. PMT/TRIG Rack power off:* |
47 | 59 | David Caratelli | |
48 | 59 | David Caratelli | |
49 | 69 | Sophie Berkman | *%{color:red}@First confirm from the On-call PMT expert and uB operator on shift that the PMT HV is ramped down as per procedure and is at 0 V. Do not proceed without this confirmation. This can be checked on the front of the PMT rack.@%* |
50 | 59 | David Caratelli | |
51 | 82 | Sophie Berkman | 0. Make sure DAQ is down, and the PMT HV is off. |
52 | 69 | Sophie Berkman | a. Switch off Wiener PS using the red toggle switch on the front panel (gently push down the toggle switch for 3 seconds until the display turns off). There is one for both the PMT and trigger. |
53 | 74 | Sophie Berkman | b. Switch off the NIM bin using its front panel switch. (Note: light is broken on the front of the trigger NIM crate power supply.) |
54 | 84 | Sophie Berkman | c. Turn off PMT power supply on the bottom of the front of the rack. Check with the PMT expert to see if it safe to do so. |
55 | 84 | Sophie Berkman | d. Turn off the PMT HV circuit braker (CB3) which is the bottom circuit breaker on the back of the rack. |
56 | 28 | Jeremy Hewes | d. Switch off the fan underneath the trigger NIM bin. |
57 | 69 | Sophie Berkman | e. Switch off the middle (CB2) circuit breaker; verify the fan is off. (Note: LED on CB2 is broken.) |
58 | 28 | Jeremy Hewes | f. Switch off the CB1 circuit breaker; verify NetGear network switch inside rack is off. |
59 | 28 | Jeremy Hewes | g. Switch off Slow controls using front panel switch on the slow controls panel (gently pull the Chassis on/off switch and press down). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
60 | 28 | Jeremy Hewes | h. Switch off the RPS (use switch located on the back panel of the RPS unit). Go behind the racks and use a step stool to reach, if needed; verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
61 | 28 | Jeremy Hewes | i. Only the AC Input Good LED on the AC Switch Box should be ON. |
62 | 2 | Sowjanya Gollapinni | |
63 | 14 | Sowjanya Gollapinni | 5. Make an elog entry that the readout electronics racks have been successfully powered off. |
64 | 6 | Sowjanya Gollapinni | |
65 | 88 | Sophie Berkman | h2. %{color:green}@DRIFT HV racks Power-Off/On procedure:@% |
66 | 1 | Sowjanya Gollapinni | |
67 | 20 | Sowjanya Gollapinni | *%{color:red}@First confirm from the On-call Drift HV expert and uB operator on shift that the DRIFT HV is ramped down as per procedure and is at 0 V. Do not proceed without this confirmation.@%* |
68 | 1 | Sowjanya Gollapinni | |
69 | 1 | Sowjanya Gollapinni | Step 1: After confirming the above, ensure that the Glassman is at 0 V by looking at the power supply front panel. If the power happens to be off, the voltage is 0. |
70 | 1 | Sowjanya Gollapinni | (At this point, if a power outage occurs, it is ok from a HV health standpoint. The remaining steps are additions for a more graceful shutdown of the entire HV rack.) |
71 | 1 | Sowjanya Gollapinni | |
72 | 1 | Sowjanya Gollapinni | a. After confirming Step 1, turn off the Glassman by pushing the orange on/off button on the front of the supply. |
73 | 88 | Sophie Berkman | b. Turn off the slow controls box on rack 1 by gently pulling the on/off switch on the front left side of the box and pushing it down. The +5V, +3.3V, and RPS Status LEDs should turn off. |
74 | 88 | Sophie Berkman | c. Turn off oscilloscope on front of rack 2. |
75 | 77 | Sophie Berkman | d. Switch off the RPS (use switch located on the back panel of the RPS unit). Go behind TPC R1 and R2 and use a step stool to reach, if needed; verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
76 | 88 | Sophie Berkman | e. Turn off SurgeX on front of rack 2. |
77 | 1 | Sowjanya Gollapinni | f. Only the AC Input Good LED on the AC Switch Box should be ON. |
78 | 77 | Sophie Berkman | |
79 | 77 | Sophie Berkman | Follow the same procedures for Rack 1 and 2, except that only Rack 2 has an oscilloscope. |
80 | 1 | Sowjanya Gollapinni | |
81 | 1 | Sowjanya Gollapinni | Once done, let the uB operator on shift know that the power-off is done and make an e-log entry that the rack has been successfully powered off. |
82 | 14 | Sowjanya Gollapinni | |
83 | 23 | Sowjanya Gollapinni | h2. %{color:green}@ZMON box Power-Off/On procedure:@% |
84 | 14 | Sowjanya Gollapinni | |
85 | 78 | Sophie Berkman | a. The ZMON unit is located separately on a single shelf next to the PM01 rack. Turn off the ZMON impedance monitor by gently pulling the on/off switch on the front left side of the box and pushing it down. |
86 | 78 | Sophie Berkman | b. Turn off audio amplifier to right of impedance monitor. |
87 | 1 | Sowjanya Gollapinni | |
88 | 21 | Sowjanya Gollapinni | Once done, let the uB operator on shift know that the power-off is done and make an e-log entry that the rack has been successfully powered off. |
89 | 21 | Sowjanya Gollapinni | |
90 | 23 | Sowjanya Gollapinni | h2. %{color:green}@TPC-PS (subsystem: OnDetPower) rack Power-Off/On procedure:@% |
91 | 14 | Sowjanya Gollapinni | |
92 | 19 | Sowjanya Gollapinni | *%{color:red}@The TPC-PS rack power down CANNOT be done until the TPCPS expert has gracefully brought all channels down and turned them off including the Power supply Main Switch. First confirm from the uB operators on shift that this has been done. Once confirmed, proceed with the steps below.@%* |
93 | 14 | Sowjanya Gollapinni | |
94 | 79 | Sophie Berkman | a. Switch off the Wiener MPOD power supplies (located on the bottom portion of the rack) by pressing the front panel ON/OFF switch. The front panel displays should turn off. Note there are two on the front rack. |
95 | 79 | Sophie Berkman | b. Switch off the Calibration Pulsar (Tektronix rack mounted pulse generator) |
96 | 14 | Sowjanya Gollapinni | c. Turn off the Slow controls box (second box from top). Slightly (and gently) pull the Chasis ON/OFF switch and press down. All LEDs should come down. |
97 | 1 | Sowjanya Gollapinni | d. Now, go to the back side of the rack, and open the back door of the rack and power off the RPS ON/OFF switch located on the back panel of the RPS box (Top most box in the rack). Use step stool if needed to reach the switch. |
98 | 21 | Sowjanya Gollapinni | e. Flip all the Eaton breaker switches down (Eaton breaker switches are located on the right side of each rack with blue lights lit. There are 3 Eaton switches per rack). |
99 | 14 | Sowjanya Gollapinni | |
100 | 21 | Sowjanya Gollapinni | Once done, let the uB operator on shift know that the power-off is done and make an e-log entry that the rack has been successfully powered off. |
101 | 21 | Sowjanya Gollapinni | |
102 | 23 | Sowjanya Gollapinni | h2. %{color:green}@LASER racks Power-Off/On procedure:@% |
103 | 19 | Sowjanya Gollapinni | |
104 | 54 | Thomas Strauss | *%{color:red}@First inform from the LASER experts (Michele Weber, Igor Kreslo, Thomas Strauss). They will ensure that the LASER is off and the Laser computers that are in the rack are also gracefully brought down. Do not proceed without this confirmation.@%* |
105 | 25 | Matthias Luethi | Turning off devices in the rack: |
106 | 27 | Matthias Luethi | 1. Contact a laser expert, who will tell you where you can find the key to open the laser racks. |
107 | 71 | Sophie Berkman | 2. Turn off the main switch of the laser power supply on the front (different from the key). Note: Usually off when not taking laser data. |
108 | 71 | Sophie Berkman | 3. Turn off the NIM crate power. Note: Usually off when not taking laser data. |
109 | 72 | Sophie Berkman | 4. Turn off the server if they are still running (Button is in the very right upper corner, under UPS). %{color:red}@Usually on@% |
110 | 27 | Matthias Luethi | 5. Open the laser racks on the back: |
111 | 72 | Sophie Berkman | 6. Turn all switches to the off state on all devices (T-OMG1, T-OMG2, Aperture, Attenuator etc. ) on the power supply box (located about 1m above ground). Note: Usually off when not taking laser data. |
112 | 72 | Sophie Berkman | 7. Turn off the main switch of the device power supply box (located on the back of the box). Note: Usually off when not taking laser data. |
113 | 72 | Sophie Berkman | 8. Turn off the power of the Thermionics motor control unit (blue box, switch is located on the front). Note: Usually off when not taking laser data. |
114 | 72 | Sophie Berkman | 9. Turn off the power of the Heidenhain encoder control unit (grey box, switch is located next to the power cable in the back of the device). Note: Usually off when not taking laser data. |
115 | 72 | Sophie Berkman | 10. Turn off the power supply of the fans in the laser enclosure (lower metallic box), switch is located in the upper left corner. Note: Usually off when not taking laser data. |
116 | 1 | Sowjanya Gollapinni | |
117 | 1 | Sowjanya Gollapinni | Turning off slow controls |
118 | 85 | Sophie Berkman | a. Turn off green button on front of laser rack. |
119 | 85 | Sophie Berkman | b. Turn off the slow controls box by gently pulling the on/off switch on the front left side of the box and pushing it down. The +5V, +3.3V, and RPS Status LEDs should turn off. |
120 | 85 | Sophie Berkman | c. Switch off the RPS (use switch located on the back panel of the RPS unit). Go behind the racks and use a step stool to reach, if needed; verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
121 | 85 | Sophie Berkman | d. Only the AC Input Good LED on the AC Switch Box should be ON. |
122 | 1 | Sowjanya Gollapinni | |
123 | 85 | Sophie Berkman | 11. Turn off both UPSes. %{color:red}@Usually on@% |
124 | 72 | Sophie Berkman | |
125 | 1 | Sowjanya Gollapinni | Once done, let the uB operator on shift know that the power-off is done and make an e-log entry that the rack has been successfully powered off. |
126 | 1 | Sowjanya Gollapinni | |
127 | 1 | Sowjanya Gollapinni | Power on: |
128 | 72 | Sophie Berkman | 1. Turn on slow controls. |
129 | 72 | Sophie Berkman | 2. On both UPSes in the rack, unplug the cable with the label "EPO" (this will make it possible to power on the UPS). |
130 | 72 | Sophie Berkman | 3. Power on the lower UPS first, followed by the upper UPS. |
131 | 72 | Sophie Berkman | 4. Turn on the Rack Protection System (located at the top of the rack and switch in the back). |
132 | 72 | Sophie Berkman | 5. The UPS should switch from battery mode to external power within few seconds. |
133 | 1 | Sowjanya Gollapinni | 6. Plug EPO cable back in. |
134 | 73 | Sophie Berkman | 7. Turn on all of the devices above in reverse order. If not taking laser runs, only power up devices that are usually on. |
135 | 72 | Sophie Berkman | CAUTION: *Do not turn on the green alignment laser*. This is the switch on the silver panel in the back labeled A-Laser!. It should have a tape to cover it in the closed position. If that is missing, call Thomas/Michele/Igor. |
136 | 75 | Sophie Berkman | 8. Big green button on front of laser racks is usually on; turn it on if it is not already. |
137 | 75 | Sophie Berkman | 9. Make an elog that rack has been successfully powered on. |
138 | 72 | Sophie Berkman | |
139 | 86 | Sophie Berkman | -After turning on slow controls: On both UPS in the rack, unplug the cable with the label EPO (this will allow to power on the UPS). Then power on the lower UPS first, followed by the upper UPS. Turn on the Rack Protection System (located at the top of the rack and switch in the back). The UPS should switch from battery mode to external power within few seconds. After this power up the devices in reverse order (as described above). Between step 3 and 4, plug back in the EPO cable.- |
140 | 87 | Sophie Berkman | -CAUTION: *Do not turn on the green alignment laser*. This is the switch on the silver panel in the back labeled A-Laser!. It should have a tape to cover it in the closed position. If that is missing, call Thomas/Michele/Igor.- |
141 | 1 | Sowjanya Gollapinni | |
142 | 49 | Rui An | h2. %{color:green}@ MuCS (Muon Counter System) rack Power-Off/On procedure:@% |
143 | 33 | Matthew Bass | |
144 | 33 | Matthew Bass | h2. Powering down the system |
145 | 33 | Matthew Bass | |
146 | 49 | Rui An | To power off the MuCS rack the following steps should be followed by a MuCS expert: |
147 | 80 | Sophie Berkman | # Set switches on the HV PS to "off" (NOT the "kill") to ramp down the HV for the PMTs (four red switches on front). |
148 | 63 | Rui An | # Switch off the LV power supply by pressing (1)the output button (2)On/off button in the LV power supply. |
149 | 83 | Rui An | # Turn off Nim rack |
150 | 83 | Rui An | # Turn off Nim fan |
151 | 33 | Matthew Bass | # Shut down the laptop. |
152 | 33 | Matthew Bass | # Open rear door and flip the power switch on the RPS to the off position (looking from the back of the rack it's at the top right). |
153 | 33 | Matthew Bass | # Power off the SurgeX by flipping the switch on the front of the rack. |
154 | 33 | Matthew Bass | |
155 | 33 | Matthew Bass | h2. Powering on the system |
156 | 33 | Matthew Bass | |
157 | 57 | David Caratelli | To power on the MuCS rack the following steps should be followed by a MuCS expert: |
158 | 33 | Matthew Bass | # Power on the SurgeX. |
159 | 33 | Matthew Bass | # Open rear door and power on the RPS. |
160 | 34 | Matthew Bass | # Power on the laptop. Make sure it boots and logs into the the dcdaq account. Should do so automatically, if not log into that account. This will start a vnc server so that experts can access the machine remotely. |
161 | 33 | Matthew Bass | # Turn on the LV. This required both turning on the LV PS and turning on the LV power output. There is a light on the LV PS to indicate if LV is on as well as three LEDs on the front banana plugs to indicate that the LV is on. |
162 | 33 | Matthew Bass | # Once the LV is confirmed to be on (LED lights are on) then the HV can be turned on by setting the switches on the HV supply to the "on" (up) position. |
163 | 33 | Matthew Bass | # After a reset, you should take a test run (use Ghost mode) to ensure that triggers are coming out unprescaled (top counter) and prescaled (bottom counter). Often the prescaled triggers do not come through and the prescaler has to be reset. To reset the prescaler (second trigger module from left, labeled "Trigger Divider"), set the top counter to 000 and then back to 100 (the nominal prescale factor for MuCS triggers). |
164 | 35 | Rui An | |
165 | 35 | Rui An | h2. %{color:green}@ CRT (Cosmic Ray Tagger) rack Power-Off/On procedure:@% |
166 | 38 | Rui An | |
167 | 38 | Rui An | *Power OFF:* |
168 | 38 | Rui An | |
169 | 39 | Rui An | %{color:red}Before powering off the racks, please refer to the link below to turn off CRT DAQ and bias: |
170 | 39 | Rui An | https://cdcvs.fnal.gov/redmine/projects/uboone-operations/wiki/Cosmic_Ray_Tagger_-_Experts_Only% |
171 | 37 | Rui An | |
172 | 37 | Rui An | There are three racks for CRT. They are CRT-DAQ-R1, CRT-DAQ-R2 and CRT-Utility racks. |
173 | 37 | Rui An | |
174 | 37 | Rui An | CRT-DAQ-R1 rack power off: |
175 | 81 | Sophie Berkman | # Make sure turn off the servers following descriptions in link above. Do NOT use the on/off button which is brutal. (Note: This step usually done remotely) |
176 | 1 | Sowjanya Gollapinni | # Turn off slow control box(use switch on the front). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
177 | 46 | Rui An | # Turn off UPS use its power button. Press the button for about 3 seconds until the green light if off. |
178 | 37 | Rui An | # Turn off RPS(use switch on the back). Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
179 | 37 | Rui An | # Now rack is off and only the AC Input Good LED on the AC Switch Box should be ON. |
180 | 37 | Rui An | |
181 | 37 | Rui An | CRT-DAQ-R2 rack power off: |
182 | 81 | Sophie Berkman | # Make sure turn off the servers following descriptions in link above. Do NOT use the on/off button which is brutal. (Note: This step usually done remotely) |
183 | 1 | Sowjanya Gollapinni | # Turn off slow control box(use switch on the front). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
184 | 46 | Rui An | # Turn off UPS use its power button. Press the button for about 3 seconds until the green light if off. |
185 | 37 | Rui An | # Turn off RPS(use switch on the back). Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
186 | 37 | Rui An | # Now rack is off and only the AC Input Good LED on the AC Switch Box should be ON. |
187 | 37 | Rui An | |
188 | 37 | Rui An | CRT-Utility rack power off: |
189 | 81 | Sophie Berkman | # Turn off Wiener PS channel-wisely using slow monitoring which is also described in the link above. If you can not figure it out, go to item (2). If it works, go to item (4) (Note: This step usually done remotely) |
190 | 44 | Rui An | # Turn off Wiener PS channel-wisely using the switch on the front. If you can not figure it out, go to item (1)...sorry, call expert then. |
191 | 39 | Rui An | # Turn off Wiener PS using the red toggle switch on the front panel (gently push down the toggle switch for 3 seconds until the display turns off). |
192 | 1 | Sowjanya Gollapinni | # Turn off the NIM crate and its fan(use switch in the front). These two are now put in 'OFF' state. |
193 | 1 | Sowjanya Gollapinni | # Turn off PPS(use switch on the front). Check the blinking blue light is off. (Light located on the silver box in the back of the crate). |
194 | 1 | Sowjanya Gollapinni | # Turn off slow control box(use switch on the front). The +5V, +3.3V, and Heart Beat LEDs should turn off. |
195 | 1 | Sowjanya Gollapinni | # Turn off RPS(use switch on the back). Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are off. |
196 | 1 | Sowjanya Gollapinni | # Turn off the Surge X(use switch on the front). Verify the power light is off. |
197 | 1 | Sowjanya Gollapinni | |
198 | 1 | Sowjanya Gollapinni | Once done, let the uB operator on shift know that the power-off is done and make an e-log entry that the rack has been successfully powered off. |
199 | 1 | Sowjanya Gollapinni | |
200 | 1 | Sowjanya Gollapinni | *Power On:* |
201 | 1 | Sowjanya Gollapinni | |
202 | 1 | Sowjanya Gollapinni | Please power on R2 first which has the network switch . |
203 | 1 | Sowjanya Gollapinni | |
204 | 1 | Sowjanya Gollapinni | CRT-DAQ-R2 rack power on: |
205 | 1 | Sowjanya Gollapinni | # Check the AC Input Good LED on the AC Switch Box is ON. |
206 | 1 | Sowjanya Gollapinni | # Turn on RPS. Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are on. |
207 | 1 | Sowjanya Gollapinni | # Turn on UPS by the power button on the front. Hold the power button for about 3 seconds. It can take up to minutes for the UPS to warm up. |
208 | 1 | Sowjanya Gollapinni | # Wait some time for the network switch to work |
209 | 1 | Sowjanya Gollapinni | # Turn on slow control box(use switch on the front). The +5V, +3.3V, and Heart Beat LEDs should turn on. |
210 | 1 | Sowjanya Gollapinni | # Check the power light of network switch the front is on. |
211 | 1 | Sowjanya Gollapinni | # Turn on the servers(use red button on the front). |
212 | 1 | Sowjanya Gollapinni | |
213 | 1 | Sowjanya Gollapinni | CRT-DAQ-R1 rack power on: |
214 | 1 | Sowjanya Gollapinni | # Check the AC Input Good LED on the AC Switch Box is ON. |
215 | 1 | Sowjanya Gollapinni | # Turn on RPS. Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are on. |
216 | 1 | Sowjanya Gollapinni | # Turn on UPS by the power button on the front. Hold the power button for about 3 seconds. It can take up to minutes for the UPS to warm up. |
217 | 1 | Sowjanya Gollapinni | # Turn on slow control box(use switch on the front). The +5V, +3.3V, and Heart Beat LEDs should turn on. |
218 | 1 | Sowjanya Gollapinni | # Turn on the servers(use red button on the front). (Note: Usually turn on themselves. Contact CRT expert if they do not.) |
219 | 1 | Sowjanya Gollapinni | |
220 | 1 | Sowjanya Gollapinni | |
221 | 1 | Sowjanya Gollapinni | CRT-Utility rack power on: |
222 | 1 | Sowjanya Gollapinni | # Turn on the Surge X(use switch on the front). Verify the power light is on. |
223 | 1 | Sowjanya Gollapinni | # Turn on RPS. Verify the AC Output ON, POWER, SENSOR, and ALARM LEDs on the AC Switch Box are on. |
224 | 1 | Sowjanya Gollapinni | # Turn on slow control box(use switch on the front). The +5V, +3.3V, and Heart Beat LEDs should turn on. |
225 | 1 | Sowjanya Gollapinni | # Turn on PPS. Check the blue blinking light is on. |
226 | 1 | Sowjanya Gollapinni | # If you need the NIM, turn on the NIM crate and its fan(use switch in the front). (Note: Usually off) |
227 | 1 | Sowjanya Gollapinni | # Turn on Wiener PS use the red toggle switch |
228 | 1 | Sowjanya Gollapinni | # Turn on Wiener PS channel-wisely using the switch on the front. If you can not figure it out, go to item (8). (Note: done remotely) |
229 | 1 | Sowjanya Gollapinni | # Turn on Wiener PS channel-wisely using slow monitoring which is also described in the link above. If you can not figure it out, call expert. (Note: done remotely) |
230 | 1 | Sowjanya Gollapinni | |
231 | 1 | Sowjanya Gollapinni | After powering on the racks, please refer to the link below to turn on CRT DAQ and bias: |
232 | 1 | Sowjanya Gollapinni | https://cdcvs.fnal.gov/redmine/projects/uboone-operations/wiki/Cosmic_Ray_Tagger_-_Experts_Only |
233 | 1 | Sowjanya Gollapinni | |
234 | 1 | Sowjanya Gollapinni | *Make an e-log entry after successfully turning off/ on the system.* |
235 | 89 | Sophie Berkman | |
236 | 91 | Sophie Berkman | +%{color:red}NOTE: The following documentation is kept for historic reasons only. Do not turn the following systems back on. |
237 | 89 | Sophie Berkman | |
238 | 89 | Sophie Berkman | h2. %{color:green}@Purity Monitor (PM01, PM02, PM03) rack Power-Off/On procedure:@% |
239 | 89 | Sophie Berkman | |
240 | 89 | Sophie Berkman | +*%{color:red}NOTE: Currently the Purity Monitor is NOT Being Used. Do not power back up these racks.%*+ |
241 | 89 | Sophie Berkman | |
242 | 89 | Sophie Berkman | h3. Power-off |
243 | 89 | Sophie Berkman | |
244 | 89 | Sophie Berkman | # Locate the three racks, which are on the platform. They are PM-R1, PM-R2, and PM-R3. |
245 | 89 | Sophie Berkman | # Turn off the NIM bins in each rack by moving the switch labeled "ON/OFF" to "OFF". If the NIM bin’s power light goes off, you were successful in turning the NIM bin off. If the light stays on, try moving the switch once more. |
246 | 89 | Sophie Berkman | # Each rack has a Windows server in it. Turn off the PCs by holding down their power buttons (yes, I know). This is the most secure way to turn off the Windows PCs as it does not involve actually logging into the system. |
247 | 89 | Sophie Berkman | # Turn off the Slow Controls box by flipping the switch on its front panel to the OFF position. |
248 | 89 | Sophie Berkman | # Go to the back of the rack and turn off the RPS box using the switch located on its back. |
249 | 89 | Sophie Berkman | # The rack can now be powered-off without causing harm. On the Surge-X power strips located in the top of each rack, press down on the "OFF" portion of the "ON/OFF" button. |
250 | 89 | Sophie Berkman | |
251 | 89 | Sophie Berkman | Once done, let the uB operator on shift know that the power-off is done and make an e-log entry that the rack has been successfully powered off. |
252 | 89 | Sophie Berkman | |
253 | 89 | Sophie Berkman | h3. Power-on |
254 | 89 | Sophie Berkman | |
255 | 89 | Sophie Berkman | # Locate the three racks, which are on the platform. They are PM-R1, PM-R2, and PM-R3. |
256 | 89 | Sophie Berkman | # Give the rack electricity by pressing down on the "ON" portion of the "ON/OFF" button on the Surge-X power strip. |
257 | 89 | Sophie Berkman | # Go to the back of the rack and turn on the RPS box using the switch located on its back. |
258 | 89 | Sophie Berkman | # Turn on the Slow Controls box by flipping the switch on its front panel to the ON position. |
259 | 89 | Sophie Berkman | # Turn on the NIM bins in each rack. This is accomplished by doing the opposite of the turn off procedure. Move the "ON/OFF" switch to the "ON" position to turn on the NIM bin. |
260 | 89 | Sophie Berkman | # Each rack has a Windows server in it. Turn on the PCs by pressing down their power buttons. Allow the disk check to proceed since we turned off the PC in such a hard fashion as described above. |
261 | 89 | Sophie Berkman | # The flash-lamps in PM-R1 and PM-R2 will need to be set to run again. To do this, take the clear LEXAN™ sheet off of the front of the rack. You’ll need a flathead screwdriver to accomplish this (if you can fit your hand in underneath the LEXAN™ sheet to get to the power supply panel, do that instead). Once that has been removed, open up the brass screen on the front of the Faraday cage. There are two screws for this on the top edge of the brass screen. The front of the flash-lamp power-supply will now be visible. Look for the white, square button labeled "RUN". Press that button. You should see a little, red light next to it. That means your pressing of the button was successful and you wont need to run off with the circus. |
262 | 89 | Sophie Berkman | # If the Windows servers are back online, call the purity monitor expert on call to turn the purity monitor DAQ on. They will do it remotely. |
263 | 89 | Sophie Berkman | |
264 | 89 | Sophie Berkman | h3. Power-on issues |
265 | 89 | Sophie Berkman | |
266 | 89 | Sophie Berkman | There are two potential issues with turning the purity monitors back on. You will be notified and walked through the procedures below by the purity monitor expert if they are needed. |
267 | 89 | Sophie Berkman | |
268 | 89 | Sophie Berkman | Firstly, the network on the Windows servers sometimes does not come back after startup. The purity monitor expert on call will confirm if this has happened. To fix this, simply unplug the network cable on the back of the server, wait 10 seconds (I suppose it should be a minute to conform to standard troubleshooting procedures, but we're not that patient), and plug it back in. |
269 | 89 | Sophie Berkman | |
270 | 89 | Sophie Berkman | Secondly, the flash-lamp power supply can sometimes come back in a funny state that does not allow it to run. One of the error message related to this issue is "Error: Capture timeout of the noise data after 300000 ms -- verify trigger 0". This means the flash-lamp can not fire. Here are the instructions on resetting it. -It unfortunately involves taking the side of the rack off and opening up the faraday cage-. If you do this, you must not do anything to alter the alignment of the flash-lamp housing or the fiber going into it. The purity monitor signals are highly sensitive to fiber-lamp alignment. |
271 | 89 | Sophie Berkman | |
272 | 89 | Sophie Berkman | # Power unit off. |
273 | 89 | Sophie Berkman | # Power unit on with run function off (don't run the DAQ program or have the electronics module on "Local"). You really don't need to worry about this step. |
274 | 89 | Sophie Berkman | # Set for frequency display. |
275 | 89 | Sophie Berkman | # Set frequency down to 0.1 Hz. |
276 | 89 | Sophie Berkman | # Set frequency up to 75 Hz. |
277 | 89 | Sophie Berkman | # Set frequency to desired repetition rate, we use 2 Hz. |
278 | 89 | Sophie Berkman | # Now set the energy level, we use 5,000 mJ. |