Using Synoptic for monitoring » History » Version 51
- Table of contents
- 1) How to start the Synoptic slow-control monitoring
- 2) The displays main menu
- 3) For shifters
- 4) For experts: Synoptic power supplies controls
- 5) For experts: Controlling the power supplies with ACNET
Synoptic plots are interactive:
Zoom in by selecting a box around the area you're interested in.
Zoom out by right-clicking on the plot.
1) How to start the Synoptic slow-control monitoring¶
1) Open a console.
2) Go to /home/nfs/ftbf_user/acnet.
3) Run the LArIATViewer.sh script. This will get automatically a kerberos ticket with settings permissions and open the main menu.
Back up option: ACNET page D99 launches Synoptic for Lariat.
Detailed instructions (starting with launching ACNET):
If the Synoptic viewer is not opened already or if it has crashed, please follow the steps 1 to 6 here
2) The displays main menu¶
This is the main menu. All displays/controls a shifter or expert needs can be accessed through this menu. Click on the menu to open the display / control panel you would like to look at. See the "For shifters" section for a full description of each display.
Note: All the displays have a button that allows you to go back to the main menu, generally at the bottom right corner of the display.
3) For shifters¶
Unless you need to change the settings on one of the power supplies / tertiary beam magnet, these are the displays you will need to look at.
Beam related information¶
On this display you can see at which stage of the beam cycle you are. The plots evolve continuously, wait for the spill (circled) to appear before stopping / starting a run (on the screenshot above you can see 2 spills). The full cycle is 1mn.
You can access the tertiary beam magnets and chiller controls from this display. You can also access the last 24h data for the magnets (temperatures and current).
Beam related information
- MC6CV indicates the opening a vertical collimator in the secondary beamline(see Switchyard Layout ). When the beam profiles do not look “good” (off-centered or too wide), MCR can change this value to improve the beam profile.
- MCENRG states the energy of the secondary beam at the LArIAT target.
- MC7AT1 states the temperature of the coil of magnet 1. Alarm above 175º F.
- MC7AT2 states the temperature of the coil of magnet 2. Alarm above 175º F.
- is the current of the magnets . .
- MC7ANB is a probe inserted in our magnets to measure the polarity of the field. The actual value stated is not important as only the sign matters. required for the run and .
- MC7SC1 states the number of counts for the scintillator counter before the LArIAT target. Intensity of the secondary beam. 1E5 or more is pretty good.
- MC7SC2 states the number of counts for the scintillator counters after the last magnet.
- MC7SC3 states the number of counts for the scintillator counters after the Wire Chamber 4.
- MC7SC5 states the number of counts for the coincidence of SC1, 2, 3.
- MC7SC6 used to be the "trigger": coincidence between wire chambers, TOF, halo and/or other beam elements -> obsolete?
Not available through Synoptic
To get these for now you have to use ACNET. See How to display the wire chambers positioned before the LArIAT target .
Beam-line detectors: Upstream and Downstream TOF, Halo and Punch-through, Aerogel Cerenkov¶
Because most of the PMTs for these systems are powered by the Zener voltage divider (aka COW) in the control room, controls and current monitoring are only available for the halo PMTs. These displays are similar, above is the one for the Aerogel Cerenkov.
Note: If you cannot do settings on a page, it simply means no setting is possible. Pages where settings are possible are listed as "controls" in the main menu. Otherwise they are called "monitor".
This display shows the cathode, bias, cryo-PMTs, and SiPMs voltages for the last 24h. You might need to scroll down since all the plots don't fit in the screen.
The cryogenic system control is fully automated, these plots are for the shifter general interest.
Note: Not all of the devices of the cryogenic system are shown, only a selection relevant for the LArIAT shifter.
Shows an overall view of the current readings on different parts of the cryogenic system. For historical plots, see the individual displays.
- Cryostat info
The plots in this display show the temperatures inside the cryostat, the pressures in different parts of the cryostat (the vacuum jacket and between the helico-flex seals in particular), and the liquid Argon level inside the inner cryostat for the last 24h.
- LAr and N dewars
These plots show the evolution over the last 24h of the pressure and level of the outer LAr and N dewars.
- Filter and gas analyser
For the gas analyser, you have to check the current configuration of the gas sampler. Please check the e-log for more information (?) .
4) For experts: Synoptic power supplies controls¶
Before you do anything... some useful information:
- Settings are disabled by default. This means you can zoom in / out on the plots or click on the links but cannot change any setting.
- Closing a window restarts the plots, but the settings are NOT changed. This means that if you close a window (on purpose or by mistake) or if the display crashes (it can happen from time to time) the power supply remains in whichever state it was before the closure. If it was on, it remains on at whatever voltage it was set.
- To power off a supply, please set the voltage to 0 first and then turn it off. Do not forget to turn it off!
- If a VME PS has to be turned off in an emergency situation (e.g. problem with TPC PMTs) - turn off the regulate function first, then
1) To enable settings, click on the button on the bottom right hand corner and select for how long you wish to enable the settings (Disable, 10mn, 1h or 8h). Do not forget to disable the settings once you are done!
There are pop-up confirmation windows that will prevent you from changing anything by mistake but it is still better to disable the settings once you have finished.
2) To turn on / off an power supply, click on the on / off button. A window will pop-up for confirmation. When the supply is on, the light should be green.
3) Turn on the regulate function when available (the light will turn green). This is to have an output voltage that matches the set voltage, otherwise there is a small offset.
- Ramps and regulate are not compatible. Make sure regulate is off before using / setting a voltage on the ramp mode of a power supply.
- When regulate is off, there is an offset between the value you set and the actual readout. The lower the voltage you set (with respect to the range of the PS, ie 0-2kV or 0-500V), the larger the offset.
- In particular, for the induction plane bias, set a value of ~ 36-38 V to get 18V on the output. Do not use regulate for this value, it will not work.
In some cases this feature has been disabled because it was causing more trouble than help. You might have to play with the value you enter to get on the readout the value you want if you see a disagreement.
4) Click on the button in the green frame "Set voltage" (in volts) next to the power supply you would like to set a voltage to. A window will pop up, enter the value including the "-" sign and validate. If you enter a positive value and the supply is negative only, nothing will happen. You will have to re-enter a value.
5) The selected supply readout voltage should indicate the new output voltage. Please wait until the reading stabilizes before changing to another value. This might take a few seconds.
6) Some controls (Cryo-PMTs) might include additional features such as slow ramp options. Please select the proper button according to the ramp time you wish to have. The Glassman has a ramp built in.
Current can be readout in the bottom left hand side of the display. The top plot shows the voltage as a function of time, the bottom plot is the current as a function of time. To access the history plots, click on the "Last 24h" button.
Note: The VME power supplies are not stable below a certain a value: for the 0-2kV ones (all PMTs, including cryo ones), do not set voltages below 200V; for the 0-500V (bias PS), do not set values below 36V (which will give you an 18V output).
5) For experts: Controlling the power supplies with ACNET¶
Please use this method ONLY if the Synoptic displays are not working even after restarting the Synoptic Viewer (and contact F. Blaszczyk to report the issue). Once ACNET settings permissions are enabled, it is very easy to make mistakes: there is no confirmation window so you could cause a power supply to turn off or trip if you are not familiar with ACNET.
If Synoptic crashes or hangs up, do not panic! Only the application is affected, not the devices themselves. You only need to close the application and restart it. The non-historical plots will be reset.
The most common reasons why the Synoptic viewer does not start, crashes or gives you random errors are:
- You are not opening Synoptic correctly, i.e. you forgot to get a Kerberos ticket or you didn't open Synoptic through the ACNET console when working on a control room desktop computer. Please read the instructions carefully before reporting an issue.
- You don't have the right Java environment. Make sure you have the Sun / Oracle Java Runtime Environment installed and up-to-date. OpenJRE / IcedTea does not seem to work well with Synoptic (unless you're lucky).
- Your Java security parameters are not configured correctly. Because of some recent changes on the Java platform, you might have to do some tweaks to the Java security parameters. If you get an error that says that the application cannot be launched because it is from an unknown source / signature, please do the following:
1) Open the Java control panel. How to access it varies according to the OS (Google is your friend). You might have to launch it with admin privileges.
2) Select the security tab.
3) Drop the security to medium level.
*Note: This might not be possible in recent java versions. If you only have the high and very high options, choose high.
5) Validate. You might have to restart the computer for these changes to take effect. Note: Make sure you type "http" and not "https". The latter will not work.
The most common reasons why you cannot do settings are:
- You forgot to enable the settings or you went past the time the settings were enabled.
- There are no possible settings on the display (monitor only plots).
- You are not including the "-" sign in front of the value you are trying to set. All the negative VME power supplies require you to include the sign, while the Glassman does not.
- You are trying to set a value larger than the allowed limit. For security reasons or physical reasons (maximum PS voltage), some settings have been restricted to a particular range.
- Your Kerberos account has not been granted setting permissions. There is only a few people who have settings permissions on their individual accounts. If you really need to do settings, all desktop computers in the control room can do settings, provided you started Synoptic correctly.
- You are off-site. Even if you follow the procedure, and even if you're connected using the Fermilab VPN, you will not be able to enable settings.
- We (as in LArIAT users) do not have settings permissions for that particular device. This shouldn't happen since all the devices used on Synoptic are LArIAT devices so we should have permissions for all of them. If it does happen, the device might be a recent one so we haven't been granted permissions yet. Please let Flor Blaszczyk and Charlie Briegel know. If you are doing settings on ACNET, make sure it is one of our devices and refrain from trying to change other devices (unless you are 100% sure you should).
Common web-viewer issues:
- "I know the device is on, why does it show as if it were off?" Because of Fermilab firewalls or your respective institution firewalls, it might take couple minutes for the displays to show up. If you see little "stars" instead of values with a unit in the readout sections of the displays and that nothing shows on the time plots, it means you're not getting any information from the devices. Only way to go around or speed things up: use the Fermilab VPN.
LArIAT contact: Flor de Maria Blaszczyk (Boston University), firstname.lastname@example.org
Office phone #: 617-358-0989
Cell-phone # (also on the Control Room white board): 225-280-0536
Need a new display? Don't understand something? Please let me know! All suggestions and comments are welcome.
Synoptic support: email@example.com
ACNET controls: Charlie Briegel, firstname.lastname@example.org
Emergencies: If no matter what you do, you cannot restart the OM, please contact Linden Carmichael (email@example.com) x5036 or 630-728-7059 (cell) or Denise Finstrom x4688