Project

General

Profile

Using Synoptic for monitoring » History » Version 30

Flor de maria Blaszczyk, 03/24/2015 05:43 PM

1 1 Flor de maria Blaszczyk
{{toc}}
2 1 Flor de maria Blaszczyk
3 1 Flor de maria Blaszczyk
h1. 1) How to start the Synoptic slow-control monitoring
4 1 Flor de maria Blaszczyk
5 29 Flor de maria Blaszczyk
If the Synoptic viewer is not opened already or if it has crashed, please follow the steps 1 to 6 in the section *"From the FTBF MCenter Control Room computers (any desktop computer)”* in "Starting the Synoptic OM":https://cdcvs.fnal.gov/redmine/projects/lardbt/wiki/How_to_use_the_online_monitoring
6 1 Flor de maria Blaszczyk
7 5 Flor de maria Blaszczyk
*All plots are interactive: you can scroll in / out (hold Ctrl key while you scroll) with your mouse or select a "box"*
8 5 Flor de maria Blaszczyk
9 1 Flor de maria Blaszczyk
h1. 2) The displays main menu
10 1 Flor de maria Blaszczyk
11 8 Flor de maria Blaszczyk
!MainMenu.png!
12 1 Flor de maria Blaszczyk
13 5 Flor de maria Blaszczyk
This is the main menu, all displays/controls a shifter or expert needs can be accessed through this menu. Click on the menu to open the display / control panel you would like to look at. See the "For shifters" section for a full description of each display.
14 1 Flor de maria Blaszczyk
15 1 Flor de maria Blaszczyk
*Note: All the displays have a button that allows you to go back to the main menu, generally at the bottom right corner of the display.*
16 1 Flor de maria Blaszczyk
17 1 Flor de maria Blaszczyk
h1. 3) For shifters
18 1 Flor de maria Blaszczyk
19 5 Flor de maria Blaszczyk
Unless you need to change the settings on one of the power supplies / tertiary beam magnet, these are the displays you will need to look at.
20 1 Flor de maria Blaszczyk
21 1 Flor de maria Blaszczyk
h2. Beam related information
22 2 Flor de maria Blaszczyk
23 1 Flor de maria Blaszczyk
h3. MCenter Supercycle
24 2 Flor de maria Blaszczyk
25 11 Flor de maria Blaszczyk
!MCenterSupercycle.png!
26 1 Flor de maria Blaszczyk
27 11 Flor de maria Blaszczyk
On this display you can see at which stage of the beam cycle you are. The plots evolve continuously, wait for the spill (circled) to appear before stopping / starting a run (on the screenshot above you can see 2 spills). The full cycle is 1mn.
28 22 Flor de maria Blaszczyk
29 1 Flor de maria Blaszczyk
h3. MCenter info
30 2 Flor de maria Blaszczyk
31 20 Flor de maria Blaszczyk
You can access the tertiary beam magnets and chiller controls from this display. You can also access the last 24h data for the magnets (temperatures and current).
32 2 Flor de maria Blaszczyk
33 8 Flor de maria Blaszczyk
!MCenterInfo.png!
34 1 Flor de maria Blaszczyk
35 3 Flor de maria Blaszczyk
*Beam related information*
36 1 Flor de maria Blaszczyk
* MC6CV indicates the opening a vertical collimator in the secondary beamline(see "Switchyard Layout":https://cdcvs.fnal.gov/redmine/attachments/download/23879/Switchyard-Current.pdf ). When the beam profiles do not look “good” (off-centered or too wide), MCR can change this value to improve the beam profile.
37 1 Flor de maria Blaszczyk
* MCENRG states the energy of the secondary beam at the LArIAT target.
38 22 Flor de maria Blaszczyk
39 22 Flor de maria Blaszczyk
*Tertiary magnets*
40 1 Flor de maria Blaszczyk
* MC7AT1 states the temperature of the coil of magnet 1. Alarm above 175º F.
41 1 Flor de maria Blaszczyk
* MC7AT2 states the temperature of the coil of magnet 2. Alarm above 175º F.
42 23 Flor de maria Blaszczyk
* +MC7AN+ is the current of the magnets . +Remember to report this number when starting a run+.
43 22 Flor de maria Blaszczyk
* MC7ANB is a probe inserted in our magnets to measure the polarity of the field. The actual value stated is not important as only the sign matters. +Double check that the polarity is the right one (positive or negative)+ required for the run and +remember to report its value in the elog when starting a run+.
44 1 Flor de maria Blaszczyk
45 1 Flor de maria Blaszczyk
*Scintillator counters*
46 1 Flor de maria Blaszczyk
* MC7SC1  states the number of counts for the scintillator counter before the LArIAT target.  Intensity of the secondary beam. 1E5 or more is pretty good.
47 22 Flor de maria Blaszczyk
* MC7SC2  states the number of counts for the scintillator counters after the last magnet.
48 22 Flor de maria Blaszczyk
* MC7SC3  states the number of counts for the scintillator counters after the Wire Chamber 4.
49 3 Flor de maria Blaszczyk
* MC7SC5 states the number of counts for the coincidence of SC1, 2, 3.
50 18 Flor de maria Blaszczyk
* MC7SC6 used to be the "trigger": coincidence between wire chambers, TOF, halo and/or other beam elements -> obsolete?
51 3 Flor de maria Blaszczyk
52 1 Flor de maria Blaszczyk
h3. Beam profiles
53 1 Flor de maria Blaszczyk
54 10 Flor de maria Blaszczyk
_Not available through Synoptic_ 
55 24 Flor de maria Blaszczyk
To get these for now you have to use ACNET. See "How to display the wire chambers positioned before the LArIAT target":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Using_ACNET_for_monitoring#How-to-display-the-wire-chambers-positioned-before-the-LArIAT-target-along-the-secondary-beam-line .
56 4 Flor de maria Blaszczyk
57 1 Flor de maria Blaszczyk
h3. Beam-line detectors: Upstream and Downstream TOF, Halo and Punch-through, Aerogel Cerenkov
58 3 Flor de maria Blaszczyk
59 10 Flor de maria Blaszczyk
!AGPMTsMonitor.png!
60 3 Flor de maria Blaszczyk
61 8 Flor de maria Blaszczyk
Because most of the PMTs for these systems are powered by the Zener voltage divider (aka COW) in the control room, controls and current monitoring are only available for the halo PMTs. These displays are similar, above is the one for the Aerogel Cerenkov.
62 8 Flor de maria Blaszczyk
63 28 Flor de maria Blaszczyk
_Note: If you cannot do settings on a page, it simply means no setting is possible. Pages where settings are possible are listed as "controls" in the main menu. Otherwise they are called "monitor"._ 
64 3 Flor de maria Blaszczyk
65 1 Flor de maria Blaszczyk
h2. TPC 
66 1 Flor de maria Blaszczyk
67 1 Flor de maria Blaszczyk
h3. High-voltage summary
68 3 Flor de maria Blaszczyk
69 12 Flor de maria Blaszczyk
This display shows the cathode, bias, cryo-PMTs, and SiPMs voltages for the last 24h. You might need to scroll down since all the plots don't fit in the screen.
70 12 Flor de maria Blaszczyk
71 3 Flor de maria Blaszczyk
h3. Cryogenic system
72 9 Flor de maria Blaszczyk
73 3 Flor de maria Blaszczyk
The cryogenic system control is fully automated, these plots are for the shifter general interest.
74 1 Flor de maria Blaszczyk
75 1 Flor de maria Blaszczyk
_Note: Not all of the devices of the cryogenic system are shown, only a selection relevant for the LArIAT shifter._ 
76 1 Flor de maria Blaszczyk
77 21 Flor de maria Blaszczyk
* *Overview* 
78 21 Flor de maria Blaszczyk
Shows an overall view of the current readings on different parts of the cryogenic system. For historical plots, see the individual displays.
79 21 Flor de maria Blaszczyk
80 21 Flor de maria Blaszczyk
* *Cryostat info*
81 3 Flor de maria Blaszczyk
The plots in this display show the temperatures inside the cryostat, the pressures in different parts of the cryostat (the vacuum jacket and between the helico-flex seals in particular), and the liquid Argon level inside the inner cryostat for the last 24h.
82 3 Flor de maria Blaszczyk
83 21 Flor de maria Blaszczyk
* *LAr and N duwars*
84 3 Flor de maria Blaszczyk
These plots show the evolution over the last 24h of the pressure and level of the outer LAr and N duwars.
85 3 Flor de maria Blaszczyk
86 21 Flor de maria Blaszczyk
* *Filter and gas analyser*
87 5 Flor de maria Blaszczyk
For the gas analyser, you have to check the current configuration of the gas sampler. Please check the e-log for more information (?) .
88 1 Flor de maria Blaszczyk
89 1 Flor de maria Blaszczyk
h1. 4) For experts: Synoptic power supplies controls
90 1 Flor de maria Blaszczyk
91 12 Flor de maria Blaszczyk
Before you do anything... some useful information:
92 1 Flor de maria Blaszczyk
93 12 Flor de maria Blaszczyk
* *Settings are disabled by default.* This means you can zoom in / out on the plots or click on the links but cannot change any setting.
94 1 Flor de maria Blaszczyk
95 25 Flor de maria Blaszczyk
* *Closing a window restarts the plots, but the settings are NOT changed.* This means that if you close a window (on purpose or by mistake) or if the display crashes (it can happen from time to time) the power supply remains in whichever state it was before the closure. If it was on, it remains on at whatever voltage it was set. 
96 1 Flor de maria Blaszczyk
97 12 Flor de maria Blaszczyk
* *To power off a supply, please set the voltage to 0 first and then turn it off. Do not forget to turn it off!*
98 1 Flor de maria Blaszczyk
99 12 Flor de maria Blaszczyk
!BiasControls.png! !GlassmanControls.png! !CryoPMTControls.png!
100 12 Flor de maria Blaszczyk
101 15 Flor de maria Blaszczyk
1) To enable settings, click on the button on the bottom right hand corner and select for how long you wish to enable the settings (Disable, 10mn, 1h or 8h). Do not forget to disable the settings once you are done! 
102 16 Flor de maria Blaszczyk
103 15 Flor de maria Blaszczyk
_There are pop-up confirmation windows that will prevent you from changing anything by mistake but it is still better to disable the settings once you have finished._ 
104 1 Flor de maria Blaszczyk
105 1 Flor de maria Blaszczyk
2) To turn on / off an power supply, click on the on / off button. A window will pop-up for confirmation. When the supply is on, the light should be green.
106 1 Flor de maria Blaszczyk
107 6 Flor de maria Blaszczyk
3) Turn on the regulate function when available (the light will turn green). This is to have an output voltage that matches the set voltage, otherwise there is a small offset. 
108 1 Flor de maria Blaszczyk
109 16 Flor de maria Blaszczyk
_In some cases this feature has been disabled because it was causing more trouble than help. You might have to play with the value you enter to get on the readout the value you want if you see a disagreement._
110 1 Flor de maria Blaszczyk
111 1 Flor de maria Blaszczyk
4) Click on the button in the green frame "Set voltage" (in volts) next to the power supply you would like to set a voltage to. A window will pop up, enter the value including the "-" sign and validate. If you enter a positive value and the supply is negative only, nothing will happen. You will have to re-enter a value.
112 1 Flor de maria Blaszczyk
113 1 Flor de maria Blaszczyk
5) The selected supply readout voltage should indicate the new output voltage. Please wait until the reading stabilizes before changing to another value. This might take a few seconds.
114 1 Flor de maria Blaszczyk
115 12 Flor de maria Blaszczyk
6) Some controls (Glassman PS and Cryo-PMTs) might include additional features such as slow ramp options. 
116 1 Flor de maria Blaszczyk
117 12 Flor de maria Blaszczyk
Current can be readout in the bottom left hand side of the display. The top plot shows the voltage as a function of time, the bottom plot is the current as a function of time. To access the history plots, click on the "Last 24h" button.
118 1 Flor de maria Blaszczyk
119 1 Flor de maria Blaszczyk
h1. 5) For experts: Controlling the power supplies with ACNET
120 1 Flor de maria Blaszczyk
121 1 Flor de maria Blaszczyk
*Please use this method ONLY if the Synoptic displays are not working even after restarting the Synoptic Viewer* (and contact F. Blaszczyk to report the issue). Once ACNET settings permissions are enabled, it is very easy to make mistakes: there is no confirmation window so you could cause a power supply to turn off or trip if you are not familiar with ACNET.
122 1 Flor de maria Blaszczyk
123 1 Flor de maria Blaszczyk
[[Using ACNET to power up the power supplies]]
124 1 Flor de maria Blaszczyk
125 1 Flor de maria Blaszczyk
h1. Troubleshooting
126 1 Flor de maria Blaszczyk
127 14 Flor de maria Blaszczyk
If Synoptic crashes or hangs up, do not panic! Only the application is affected, not the devices themselves. You only need to close the application and restart it. The non-historical plots will be reset.
128 1 Flor de maria Blaszczyk
129 30 Flor de maria Blaszczyk
*The most common reasons why the Synoptic viewer does not start, crashes or gives you random errors are:*
130 27 Flor de maria Blaszczyk
131 30 Flor de maria Blaszczyk
* You are not opening Synoptic correctly, i.e. you forgot to get a Kerberos ticket or you didn't open Synoptic through the ACNET console when working on a control room desktop computer. Please read the instructions carefully before reporting an issue. 
132 1 Flor de maria Blaszczyk
133 30 Flor de maria Blaszczyk
* You don't have the right Java environment. Make sure you have the "Sun / Oracle Java Runtime Environment (JRE)":http://www.oracle.com/technetwork/java/javase/downloads/index.html installed and up-to-date. OpenJRE / IcedTea does not seem to work well with Synoptic (unless you're lucky).
134 13 Flor de maria Blaszczyk
135 30 Flor de maria Blaszczyk
* Your Java security parameters are not configured correctly. Because of some recent changes on the Java platform, you might have to do some tweaks to the Java security parameters. If you get an error that says that the application cannot be launched because it is from an unknown source / signature, please do the following:
136 30 Flor de maria Blaszczyk
137 1 Flor de maria Blaszczyk
1) Open the Java control panel. How to access it varies according to the OS (Google is your friend). You might have to launch it with admin privileges.
138 1 Flor de maria Blaszczyk
139 1 Flor de maria Blaszczyk
2) Select the security tab.
140 1 Flor de maria Blaszczyk
141 1 Flor de maria Blaszczyk
3) Drop the security to medium level.
142 1 Flor de maria Blaszczyk
*Note: This might not be possible in recent java versions. If you only have the high and very high options, choose high.
143 1 Flor de maria Blaszczyk
144 1 Flor de maria Blaszczyk
4) Add the following links to the exceptions list:
145 1 Flor de maria Blaszczyk
http://synoptic.fnal.gov
146 1 Flor de maria Blaszczyk
http://www-bd.fnal.gov
147 1 Flor de maria Blaszczyk
148 1 Flor de maria Blaszczyk
5) Validate. You might have to restart the computer for these changes to take effect.
149 1 Flor de maria Blaszczyk
150 1 Flor de maria Blaszczyk
*Note: Make sure you type "http" and not "https". The latter will not work.*
151 30 Flor de maria Blaszczyk
152 30 Flor de maria Blaszczyk
153 30 Flor de maria Blaszczyk
*The most common reasons why you cannot do settings are:*
154 30 Flor de maria Blaszczyk
155 30 Flor de maria Blaszczyk
* You forgot to enable the settings or you went past the time the settings were enabled.
156 30 Flor de maria Blaszczyk
157 30 Flor de maria Blaszczyk
* There are no possible settings on the display (monitor only plots).
158 30 Flor de maria Blaszczyk
159 30 Flor de maria Blaszczyk
* Your Kerberos account has not been granted setting permissions. There is only a few people who have settings permissions on their individual accounts. If you really need to do settings, all desktop computers in the control room can do settings, provided you started Synoptic correctly.
160 30 Flor de maria Blaszczyk
161 30 Flor de maria Blaszczyk
* You are off-site. Even if you follow the procedure, and even if you're connected using the Fermilab VPN, you will not be able to enable settings. 
162 30 Flor de maria Blaszczyk
163 30 Flor de maria Blaszczyk
*Common web-viewer issues:*
164 30 Flor de maria Blaszczyk
165 30 Flor de maria Blaszczyk
* "I know the device is on, why does it show as if it were off?" Because of Fermilab firewalls or your respective institution firewalls, it might take couple minutes for the displays to show up. If you see little "stars" instead of values with a unit in the readout sections of the displays and that nothing shows on the time plots, it means you're not getting any information from the devices. Only way to go around or speed things up: use the Fermilab VPN.
166 30 Flor de maria Blaszczyk
167 1 Flor de maria Blaszczyk
168 1 Flor de maria Blaszczyk
h1. Contact
169 1 Flor de maria Blaszczyk
170 1 Flor de maria Blaszczyk
*LArIAT contact*: Flor de Maria Blaszczyk (Boston University), fblaszcz@bu.edu
171 1 Flor de maria Blaszczyk
Office phone #: 617-358-0989
172 1 Flor de maria Blaszczyk
Cell-phone # (also on the Control Room white board): 225-280-0536
173 1 Flor de maria Blaszczyk
Skype: flor.de.maria.blaszczyk
174 1 Flor de maria Blaszczyk
175 1 Flor de maria Blaszczyk
_Need a new display? Don't understand something? Please let me know! All suggestions and comments are welcome._
176 1 Flor de maria Blaszczyk
177 7 Flor de maria Blaszczyk
*Synoptic support*: synoptic-support@fnal.gov
178 19 Flor de maria Blaszczyk
179 19 Flor de maria Blaszczyk
*ACNET controls*: Charlie Briegel, briegel@fnal.gov
180 19 Flor de maria Blaszczyk
181 19 Flor de maria Blaszczyk
*Emergencies*: If no matter what you do, you cannot restart the OM, please contact *Linden Carmichael* (carmichael@fnal.gov) x5036 or 630-728-7059 (cell) or *Denise Finstrom* x4688