Project

General

Profile

Wiki » History » Version 216

Luke Batten, 02/23/2016 10:21 AM
Updated to include ROC West specific instructions. #2

1 104 Jennifer Raaf
!https:/redmine/attachments/download/17373/Lariat_Logo_256.jpg!  
2 104 Jennifer Raaf
 
3 1 William Badgett
MCenter Control Room (MC-CR) x3726 or x8871
4 117 Jennifer Raaf
* Call the Main Control Room (x3721) at the start and at the end of shift. This is required, and pleasant.
5 69 Jason St. John
* If the beam goes away for more than a few spills, look for Accelerator Alarms in ACNET (a default window). If the problem persists a few minutes, and you see nothing about it in the MCR elog, (or you just really want to find out more), call the MCR.  They're friendly, though they may be super-busy.
6 25 William Badgett
7 150 Jason St. John
{{toc}}
8 63 Jason St. John
9 204 Luke Batten
10 147 Jason St. John
h1. Shifter Stuff
11 1 William Badgett
12 207 Luke Batten
* [[Before your first shift at LArIAT]]
13 202 Jason St. John
* [[LArIAT Run 2 Shifter Instructions]] (February 2016)
14 130 Jennifer Raaf
** [[Run Plan]]
15 192 Jennifer Raaf
** "LArIAT Expert Call List":http://lariat.fnal.gov/internal/internal.html  (User is "lariat", password same as docdb)
16 1 William Badgett
17 171 Jason St. John
h2. Link summary ( [[quick start]] )
18 166 Steven Dytman
19 197 Jason St. John
* "Accelerator Schedule":http://www-ad.fnal.gov/ops/schedule.html  (power outages, etc)
20 215 Luke Batten
* "LArIAT e-Log":http://dbweb0.fnal.gov:8080/ECL/lariat/E/index  For making/ending access, starting/ending shifts.
21 210 Luke Batten
* [[LArIAT DAQ Instructions]] (February 2016)
22 147 Jason St. John
* "LArIAT Run Status Webpage":http://nusoft.fnal.gov/lariat/run.html
23 196 Ryan Linehan
* "LArIAT Run Summary Webpage":http://lariat-wbm.fnal.gov/wbm/servlet/LariatRunSummary
24 213 Luke Batten
* "LArIAT Online DQM":http://lariat-dqm.fnal.gov (works with VPN or VNC or on-site only, for now)
25 164 Johnny Ho
* How to use the [[event viewers]]
26 165 Johnny Ho
* How to make [[DQM plots]] (may be outdated)
27 1 William Badgett
* "Synoptic":https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki/Using_Synoptic_for_monitoring
28 149 Jason St. John
* "Beam monitoring(ACNET directly)":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Using_ACNET_for_monitoring?parent=Wiki
29 1 William Badgett
* "Accelerator Operations Elog":https://www-bd.fnal.gov/Elog/?logNames=Operations
30 1 William Badgett
* "MC7 WebCam":http://131.225.176.26/
31 1 William Badgett
32 151 Jason St. John
h3. Important knowledge
33 1 William Badgett
34 149 Jason St. John
* "List of MC7 ACNET devices":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/MC7_in_ACNET
35 149 Jason St. John
* [[MC-7 Enclosure Layout]]
36 1 William Badgett
* "In case the beam TVs are off":http://www-bd.fnal.gov/notifyservlet/www?project=&refresh=on&infolinks=top
37 1 William Badgett
* [[The LArIAT supercycle]] _How DAQ operations relate to the main injector supercycle_ 
38 151 Jason St. John
* "Hardware-Connections-and-Configurations":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Wiki#Hardware-Connections-and-Configurations
39 151 Jason St. John
* "Electronic Hardware Documentation":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Wiki#Electronic-Hardware-Documentation
40 132 Jason St. John
41 149 Jason St. John
h3. Obsolete links
42 1 William Badgett
43 202 Jason St. John
* [[LArIAT Run 1 Shifter Instructions]] (June 2015)
44 149 Jason St. John
* -LArIAT Engineering Run (Aug 2014) [[How to Run the Lariat Data Acquisition]]- (OBSOLETE)
45 1 William Badgett
* -"Shifter Instructions":https://docs.google.com/document/d/1mlN_UIOCqwhe0cFiU7mRc3-lxDZhY-4TmIy23rOzILI/pub August 2014- (Some obsolete information)
46 164 Johnny Ho
* -How to make [[Lariat DAQ Plots]]- (OBSOLETE)
47 149 Jason St. John
48 83 Jason St. John
h1. Troubleshooting 
49 1 William Badgett
50 152 Jason St. John
Any time day or night, please call experts if you are in need of help and the answer is not provided below.
51 152 Jason St. John
52 179 Jason St. John
h2. *Trouble getting started*
53 152 Jason St. John
54 205 Luke Batten
* If you cannot ssh to FTBFLX machines: Get a kerberos ticket for yourself: @kinit <yourKerberosPrincipal>@, then ssh ftbf_user@ftbflx18 (or ssh ftbf_user@ftbflx15 or ssh ftbf_user@ftbf-cr-03).
55 216 Luke Batten
* If your Kerberos username and password are good, but you can't log on to FTBFLX[NN] machines:  Have someone who CAN log into those machines check that your kerberos principal appears in @~ftbf_user/.k5login@ in the LArIAT section (email the Run Co-ordinator at stjohn@fnal.gov). 
56 216 Luke Batten
* The same ssh errors may also apply to computers at ROC West. Troubleshoot using the above methods.
57 1 William Badgett
58 152 Jason St. John
h2. *Trigger and DAQ system*
59 152 Jason St. John
60 188 Jason St. John
When the DAQ crashes, please post the relevant information to [[DAQerrors]] for experts to study.
61 188 Jason St. John
62 187 Jason St. John
h3. Common failures:
63 187 Jason St. John
64 187 Jason St. John
* DAQ fails with @ERROR: ReadRegisgter ACQUISITION_STATUS CAEN_DGTZ_CommError BoardId 0@  wait 2 minutes, then try to start again.
65 187 Jason St. John
** Try issuing the command @lariatReset 0 1@ waiting more then 5 seconds, and trying again.
66 187 Jason St. John
This command is appropriate when one sees any type of "CAEN_DGTZ" error.  This command will NOT help the persistent ports error.
67 187 Jason St. John
* DAQ fails with @Found persistent communication port still open@
68 187 Jason St. John
** Wait 8 minutes for the ports to clear, then try again.
69 187 Jason St. John
70 187 Jason St. John
h3. Other failures: 
71 187 Jason St. John
72 1 William Badgett
* If the DAQ is having trouble talking to the crates, try issuing the command @lariatReset 0 1@ waiting more then 5 seconds, and trying again.
73 187 Jason St. John
This command is appropriate when one sees any type of "CAEN_DGTZ" error.  This command will NOT help the persistent ports error.
74 187 Jason St. John
* If the trigger crate has been power cycled and the V1495 is not emitting triggers: [[Reset1495]]
75 83 Jason St. John
76 152 Jason St. John
h2. *Wire Chambers*
77 152 Jason St. John
78 162 Jason St. John
* If the wire chambers are acting strangely: "remote power cycling instructions":https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Communicating_with_the_wire_chambers including mini-DAQ and telnet interface.
79 135 Jason St. John
* If the wire chamber system is skipping spill numbers, it may be a high trigger rate (> 30 k per spill).  The wire chamber controller may still be reading out the hits from the last spill.
80 83 Jason St. John
81 172 Jason St. John
h2. Power Cycle the ASICs (TPC Wire Noise)
82 168 William Badgett
83 168 William Badgett
* Anecdotal evidence has shown that analog noise on the TPC wire readout channels can be 
84 169 William Badgett
alleviated by power cycling the TPC electronics: ASICs and Warm Receiver/Drivers
85 203 Will Foreman
* You can remotely power cycle the TPC electronics.  Log onto lariat-gateway00.fnal.gov with X-forwarding enabled, type "firefox", and go to http://lariat-pdu02.fnal.gov.  Usename "ftbf" (password posted on whiteboard in MC7).  Choose the *CYCLE* option, which will automatically give a 60 
86 173 William Badgett
second powerless interlude.
87 173 William Badgett
* Further important informations can be found on the white board in MC-CR.
88 168 William Badgett
* This mechanism is controlled by a smart power distribution unit (PDU) located under the 
89 168 William Badgett
TPC electronics power supply near the cryostat in the enclosure.   Due to electrical safety 
90 170 William Badgett
rules you must *NOT* use any of the other outlets on this PDU.  Do *NOT* remove the protective 
91 168 William Badgett
outlet covers at any time.
92 177 William Badgett
!https://redmine.fnal.gov/redmine/attachments/download/25467/lariat-pdu02-cycle.png!
93 174 William Badgett
94 181 Jason St. John
h2. Recover from a LAr level interlock
95 181 Jason St. John
96 182 Jason St. John
Assuming the LAr Level dropped low enough to trip off the TPC Cathode power supply, and maybe you even powered down the PMTs.
97 182 Jason St. John
98 181 Jason St. John
# Be sure HV is set to zero for these: Cathode Drift, Wire Bias, cryo-PMTs
99 183 Sarah Lockwitz
How to control the [[Drift HV]]
100 181 Jason St. John
# Power down the ASICs. (They should be off when TPC voltages change.)
101 181 Jason St. John
# Bring up the Cathode
102 181 Jason St. John
# Bring up the Wire Bias
103 181 Jason St. John
# Bring up the ASICs
104 181 Jason St. John
# Bring up the PMTs
105 181 Jason St. John
106 68 Michael Kordosky
h1. Hardware Connections and Configurations
107 1 William Badgett
108 141 William Badgett
* [[TPC Channel Mapping]]
109 51 Jason St. John
* [[Non-TPC Detectors]] *Naming and numbering in MC7*
110 133 Jason St. John
* "Cable Patch Panel Spreadsheet":http://goo.gl/JXiH8Y
111 54 Jason St. John
* [[Connections on the Control Room Patch Panel]]
112 54 Jason St. John
113 51 Jason St. John
* [[Logical inputs to the CAEN V1740]]
114 51 Jason St. John
* [[Connections into the WUT TDC]]
115 51 Jason St. John
* [[Connections into the V1751 Digitizer]]
116 1 William Badgett
* [[Trigger inputs|Connections in/out of the V1495 Trigger]]
117 68 Michael Kordosky
* [[Logic pulse widths and discriminator thresholds]]
118 68 Michael Kordosky
* [[WUT configuration]]
119 74 William Badgett
* [[Timing of ACnet TCLK Events]]
120 140 William Badgett
* The [[Teensy]] LAr ASIC controller's configuration
121 50 Michael Kordosky
122 138 Roberto Acciarri
* [[Punch Through counters voltages and rates ]]
123 138 Roberto Acciarri
124 102 Jason St. John
h1. Electronic Hardware Documentation
125 45 Michael Kordosky
126 51 Jason St. John
* Link to LArIAT eLog http://dbweb0.fnal.gov/ECL/lariat
127 51 Jason St. John
* [[LariatOnlineGit]] Accessing the LArIAT Online GIT repository
128 98 Brian Rebel
* [[Building LArIATOnline with CMake]]
129 44 Michael Kordosky
130 51 Jason St. John
* [[LArIAT TPC Readout Parameters]]
131 185 William Badgett
* [[LArASIC Preamp Documentation from BNL]]
132 51 Jason St. John
* [[LArIAT DAQ Commercial Products]] Technical Documentation and Firmware Files
133 101 William Badgett
* [[LArIAT CAEN Products]] Technical Documentation and Firmware Files
134 51 Jason St. John
* Test Beam Wire Chamber Sten Hensen's [[TDC Readout Documentation]]
135 89 William Badgett
* WUT Wave Union TDC: [[Jinyuan's TDC Documentation]]
136 51 Jason St. John
* [[v1495 notes]] Notes and working area for the V1495 and V2718
137 195 Johnny Ho
* [[A3818 PCI optical controller]] links
138 35 Michael Kordosky
139 1 William Badgett
* [[DAQ Configuration]] settings, parameters, starting a run
140 51 Jason St. John
* [[Raw Data Format and Readout Source code]]
141 100 John Freeman
* [[All things lariat-artdaq]] (UPDATED 11/5/14)
142 154 Jason St. John
* [[Interpreting Wire Chamber TDC Data]]
143 36 Michael Kordosky
144 54 Jason St. John
* [[LArIAT Test Stand]] Photographs
145 47 Michael Kordosky
146 72 Michael Kordosky
h1. Diagnostic and Control Software
147 72 Michael Kordosky
148 73 Michael Kordosky
_Test programs in the_ lariat-online/daq/src _directory_
149 73 Michael Kordosky
150 72 Michael Kordosky
* [[DumpDigitizerData]]
151 72 Michael Kordosky
* [[SummarizeDAQOutput]]
152 72 Michael Kordosky
* [[Reset1495]]
153 72 Michael Kordosky
* [[ScalarReadout]]
154 97 Pawel Kryczynski
* [[Data_quality_monitoring_module]]
155 72 Michael Kordosky
156 139 William Badgett
* CAEN's [[WaveDump]] utility
157 139 William Badgett
158 75 Jason St. John
h1. Examining the WC mini DAQ ASCII data
159 75 Jason St. John
160 75 Jason St. John
The Processor makes TTrees from the ASCII files saved by @mc7-daq.py@
161 82 Jason St. John
[[WC MiniDAQ Data Processor]]
162 75 Jason St. John
163 153 Jason St. John
h1. Data Files from the year 2013
164 76 Will Flanagan
165 85 William Badgett
Data files for various beam conditions can be found in the [[DataFiles]] page.
166 85 William Badgett
167 51 Jason St. John
h1. Meetings
168 51 Jason St. John
169 51 Jason St. John
* [[Connecting to LArIAT ReadyTalk]]
170 198 Johnny Ho
171 1 William Badgett
h1. Miscellaneous
172 198 Johnny Ho
173 216 Luke Batten
* The control room shifter computer (MCenter) can be logged into as ftbf_user@ftbflx18.fnal.gov after passing through lariat-gateway.fnal.gov
174 198 Johnny Ho
* [[Proxy using SSH tunnel]]