Project

General

Profile

LArIAT Run 2 Shifter Instructions » History » Version 18

Version 17 (Luke Batten, 02/19/2016 10:03 AM) → Version 18/119 (Luke Batten, 02/19/2016 10:09 AM)

h1. LArIAT Run 2 Shifter Instructions

*_Remember to call MCR at the beginning and ending of each shift!!!_*

h2. Please don't hesitate to contact the experts when something doesn't look right!!!
%{color:red}"Troubleshooting":https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki#Troubleshooting%

h2. %{color:green}Before starting the first run of the day shift%

* Check the pressure in the wire chambers’ gas bottle and the slow bubbles in the wire chambers’ gas panel “Return” bubblers. If you don’t know how to do it or where it is, shame on us we haven’t showed you yet (see [[Wire Chamber Gas/Electronics Instructions]]).

From an MCenter machine such as ftbflx18 or ftbflx15:
* Log in with username = @ftbf_user@. Password is YOUR kerberos password, then it will ask for YOUR kerberos principal.
* Open a terminal window. If "klist" doesn't show that you have a valid kerberos ticket, get one: @kinit <your_kerberos_principal>@
* If ftbf_user is already logged in - reset the kerberos ticket: kdestroy and then @kinit <your_kerberos_principal>@
* +ACNET/Synoptic+ not always keep running properly after such reset, so it's recommended to restart +both of them+ (see instructions in the next point)
* Open in a new tab "Using ACNET for monitoring":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Using_ACNET_for_monitoring?parent=Wiki This page contains the instructions to monitor the beam status through ACNET. Also open "Synoptic":https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki/Using_Synoptic_for_monitoring
* Open "Operations Elog":https://www-bd.fnal.gov/Elog/?logNames=Operations +in the new tab+ This is the Main Control Room (MCR) Elog. Use it to check any possible problem affecting the MCenter beam.
* Log the previous shifter out of the "LArIAT Elog":http://dbweb0.fnal.gov:8080/ECL/lariat/E/index (if they are logged in), and log yourself in. Make a new entry with the "Start of Shift Checklist" form.

* Open the "Run Summary":http://lariat-wbm.fnal.gov/wbm/servlet/LariatRunSummary

h2. %{color:green}During the shift%

* If you have questions, call an expert! "LArIAT Call List":https://docs.google.com/spreadsheets/d/1BCeFLgITn6lzCUgPFUd5y_5taIngt-yKgxg8y2l-tNY/edit?usp=sharing
* Or, you can use Google Hangouts: send an email to lariat.shift@gmail.com to get invitation.
* As well as Google Hangouts, you can Skype an expert! How to access Skype:
* On the ftbf_user account:
** "cd ~/Downloads/skype-4.3.0.37"
** "skype"
* You can find the password in the top right blue box of the whiteboard in the control room.

What beam should I request? The "Run Plan":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Run_Plan lists current and upcoming beam requests, along with the other MCenter activities going on.

h3. Starting a new run

* Open in a new tab [[LArIAT DAQ Instructions]] and follow the instructions to start a new run.
* Make an entry on the "LArIAT e-Log":http://dbweb0.fnal.gov/ECL/lariat/E/index when starting a new run. Use the form "New Run" to report all the information in the relative fields.
* *Change/check the DAQ configuration* see "DAQ Configuration Instructions":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/1495ShifterInstructions
* *Changing gain or filter times* in the ASICS: check that there was [[Teensy Output]] in the initialization spew from the DAQ.

h3. During an ongoing run

* Monitor the beam status using the instructions in the "Using ACNET for monitoring":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Using_ACNET_for_monitoring, namely
** the *S60* page of ACNET and
** the profile plots for *MC7WC1* and *MC7WC2*.
** From ~ftbf_user/acnet, run @./LArIATViewer.sh@ to open the Synoptic displays.

* "Run Status Webpage":http://nusoft.fnal.gov/lariat/run.html to monitor the run status (run number, number of spills, number of triggers, etc)
* Note that, on the Run Status Webpage, %{color:red}if the run time appears red%, and the spills stop increasing, the run has come a stop.
** In order to get it running again, you can issue the 'lariatReset' command in the DAQ terminal, command, followed by 'go'.
* "Online DQM":http://lariat-dqm.fnal.gov/ to check basic data integrity.
* Did the run number fail to increment? If the number has reset to a low number such as 1 stop ther run and then edit /opt/lariat-online/config/runNumber.dat to correct the run number. Start new run after.
* Monitor the quality of the data by looking at DQM plots at the in the first few spills, and at end of each run, download the tarball at the bottom of the page.
* Add all of the plots to the elog.
* Use the event viewer to see TPC events. See "Event Viewer Instructions":https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki/Event_viewers . If you +decide to post some interesting event+ in the e-log, +please write the number of the spill/event in the title or content of the entry+. It's much easier to search for them later!
* Useful: "Recent run history":http://lariat-wbm.fnal.gov/wbm/servlet/LariatRunSummary , python scripts for making [[DQM plots]]

h3. Troubleshooting

%{color:red}Important! Follow instructions in link below if cathode HV trips off due to LAr level interlock.%
[[Drift HV]] TPC Cathode Voltage

If the "Troubleshooting Page":https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki#Troubleshooting doesn't help, "call an expert":https://docs.google.com/spreadsheets/d/1BCeFLgITn6lzCUgPFUd5y_5taIngt-yKgxg8y2l-tNY/edit?usp=sharing

*If a VME Power Supply has to be turned off in an emergency situation (e.g. problem with TPC PMTs) - turn off the regulate function first, then put the decreasing voltage values in the quick ramp window, go to 0 and then turn off!
*

h3. When the run has ended

* From the e-log entry which started this run, make a related entry summarizing the run. Add the final DQM plots (tab "Home" in the "Online DQM":http://lariat-dqm.fnal.gov).

* On the "Online DQM":http://lariat-dqm.fnal.gov , go to the Data Blocks tab and report the number of V1751 triggers, and the same for the V1740's, both for board 0 only.

h2. %{color:green}At the end of the shift%

* Make an entry in the e-Log using the form "Shift Summary" summing up the relevant information from the shift (make sure to include the total trigger counts for the V1751s and V1740s). For any other information to be posted in the e-Log during the shift use the "default" form.
* IF NO SHIFTER IS TAKING OVER FROM YOU
# Call MCR to stop the beam
# Also ask the MCR to release a key so you can put the enclosure into open access. (The open access rule is valid only till we'll be ready for the cryostat filling).

h2. *_Remember to call MCR at the beginning and ending of each shift!!!_*

h1. *_Remember to call MCR at the beginning and ending of each shift!!!_*