Project

General

Profile

Wiki » History » Version 58

Gustavo Valdiviesso, 07/02/2018 11:50 PM

1 30 Gustavo Valdiviesso
!https://cdcvs.fnal.gov/redmine/attachments/download/48302/sbnd-logo-big.png!
2 23 Gustavo Valdiviesso
3 38 Gustavo Valdiviesso
---
4 38 Gustavo Valdiviesso
5 33 Gustavo Valdiviesso
h2. %{color:red}Quick Info%
6 1 Jose Ignacio Crespo Anadon
7 49 Gustavo Valdiviesso
* *RUN COORDINATOR* Gustavo Valdiviesso (630-696-1866)
8 43 Krishan Mistry
* Google Hangouts ID: sbndshift@gmail.com (password is the same as the sbn-doc-db)
9 33 Gustavo Valdiviesso
* "Hangouts Group":https://hangouts.google.com/group/cdpWmYQYwS3z31T62
10 33 Gustavo Valdiviesso
* VST shift: *+1 331 442 4353* (Hangouts Voice Service)
11 33 Gustavo Valdiviesso
* ROC West x5413
12 33 Gustavo Valdiviesso
* MCenter Control Room (MC-CR) x3726 or x8871
13 33 Gustavo Valdiviesso
* Internationally: prefix *+1 630 840* to any extensions (marked with x)
14 33 Gustavo Valdiviesso
* "Experts list":https://docs.google.com/spreadsheets/d/1_lixBwEmZP8X2hEL4gabbaPx3uZYUMtQdMLQH-5-aQE/edit?usp=sharing
15 6 Gustavo Valdiviesso
16 38 Gustavo Valdiviesso
---
17 38 Gustavo Valdiviesso
18 33 Gustavo Valdiviesso
{{toc}}
19 1 Jose Ignacio Crespo Anadon
20 33 Gustavo Valdiviesso
21 33 Gustavo Valdiviesso
h1. Welcome to the SBND VST Wiki
22 33 Gustavo Valdiviesso
23 1 Jose Ignacio Crespo Anadon
This is the wiki for the SBND's Vertical Slice Test (VST). This is an integration of the cold and warm electronics with DAQ and online monitoring using LArIAT's cryostat and TPC.
24 1 Jose Ignacio Crespo Anadon
25 33 Gustavo Valdiviesso
*HUGE DISCLAIMER: IT IS TOO SOON TO GET COMFORTABLE*
26 33 Gustavo Valdiviesso
*THIS PAGE IS BEING DEVELOPED RIGHT NOW! CHECK IT EVERY TIME SO YOU ARE UPDATED TOO!*
27 1 Jose Ignacio Crespo Anadon
28 49 Gustavo Valdiviesso
h1. %{color:red}Run Plan for Jun 29 to Jul 02%
29 49 Gustavo Valdiviesso
30 49 Gustavo Valdiviesso
*  Take beam data with these configurations: Energy = 64GeV, Intensity = 7E8, MC7 Magnet = 100 amps
31 49 Gustavo Valdiviesso
*  Take 2h runs, which has to be done by hand. Shifter has to stop the SBND DAQ (ctrl+C) and launch the script again every two hours. First run of the plan is #40, which started Jun 29 18:05:25 CDT
32 53 Gustavo Valdiviesso
*  When the new run starts, the Online monitor show reliable information for the noise correlation matrix and the wires rms. Save a snapshot of
33 53 Gustavo Valdiviesso
34 53 Gustavo Valdiviesso
1) the Correlation Matrix
35 53 Gustavo Valdiviesso
2) the Collection Plan RMS 
36 53 Gustavo Valdiviesso
3) the Collection Plan Pulse Height
37 53 Gustavo Valdiviesso
38 53 Gustavo Valdiviesso
and add them to a New Run e-log entry (see entry "297":http://dbweb6.fnal.gov:8080/ECL/sbnd/E/show?e=297 as an example).
39 53 Gustavo Valdiviesso
40 53 Gustavo Valdiviesso
There are now 4 types of reports:
41 53 Gustavo Valdiviesso
42 53 Gustavo Valdiviesso
Start of Shift Checklist
43 53 Gustavo Valdiviesso
End of Shift Checklist
44 53 Gustavo Valdiviesso
45 53 Gustavo Valdiviesso
New Run
46 53 Gustavo Valdiviesso
End of Run
47 53 Gustavo Valdiviesso
48 53 Gustavo Valdiviesso
The shifter must fill in all of them. Instructions are in the form themselves.
49 1 Jose Ignacio Crespo Anadon
50 33 Gustavo Valdiviesso
h1. Taking VST Shifts
51 1 Jose Ignacio Crespo Anadon
52 54 Gustavo Valdiviesso
In summary, a VST shift is just like a LArIAT shift, with a few extras. If you didn't do this yet, make sure you are in the "SBND.Shift":https://hangouts.google.com/group/cdpWmYQYwS3z31T62 group at Google Hangouts.
53 33 Gustavo Valdiviesso
54 33 Gustavo Valdiviesso
h2(count). %{color:green}Prerequisites%
55 33 Gustavo Valdiviesso
56 33 Gustavo Valdiviesso
*Gaining Access*
57 33 Gustavo Valdiviesso
58 39 Gustavo Valdiviesso
* First, set up your Fermilab computing account and Kerberos. This can be done by following instructions "here":https://redmine.fnal.gov/redmine/projects/lardbt/wiki/Fermilab_Computing_Access. Check that you can issue a Kerberos ticket with 
59 1 Jose Ignacio Crespo Anadon
60 39 Gustavo Valdiviesso
<pre> kinit <yourKerberosPrincipal>@FNAL.GOV</pre> 
61 39 Gustavo Valdiviesso
62 39 Gustavo Valdiviesso
and confirm that you have gotten a kerberos ticket by checking the output of the command @klist@.
63 39 Gustavo Valdiviesso
64 33 Gustavo Valdiviesso
* If you are at Fermilab:
65 33 Gustavo Valdiviesso
** Check that you are connected via ethernet, or to the Fermilab @fgz@ Wi-Fi network and not the guest Wi-Fi network. This is required to access the lariat shift machines. The latter may lead to "Connection reset by peer" errors, refusing you access. Register your device to the fgz network "here":https://fermi.service-now.com/kb_view_customer.do?sysparm_article=KB0011206. 
66 1 Jose Ignacio Crespo Anadon
** If you find you cannot SSH into lariat-cr-02.fnal.gov, make sure your SSH config file allows X11 forwarding and all GSSAPI options. Further details can be found "here":https://cdcvs.fnal.gov/redmine/projects/lardbt/wiki/Fermilab_Computing_Access#Logging-into-Fermilab-Computers-with-Kerberos.
67 1 Jose Ignacio Crespo Anadon
68 1 Jose Ignacio Crespo Anadon
* If you are outside of the lab:
69 55 Gustavo Valdiviesso
** %{color:red} The Java dependent Cisco AnyConnect client can no longer run from a browser due to the lack of support for NPAPI%. This means that the old VPN method (https://vpn.fnal.gov) only works in old browsers. Use this as an alternative method, which is browser-independent:
70 54 Gustavo Valdiviesso
71 56 Gustavo Valdiviesso
Uninstall Cisco AnyConnect (skip this if you are sure you don't have it):
72 54 Gustavo Valdiviesso
73 54 Gustavo Valdiviesso
<pre>
74 54 Gustavo Valdiviesso
sudo /opt/cisco/vpn/bin/vpn_uninstall.sh
75 54 Gustavo Valdiviesso
</pre>
76 54 Gustavo Valdiviesso
77 54 Gustavo Valdiviesso
78 56 Gustavo Valdiviesso
Install  openconnect (it is an open source vpn client)
79 54 Gustavo Valdiviesso
80 54 Gustavo Valdiviesso
if you are using ubuntu...
81 54 Gustavo Valdiviesso
82 54 Gustavo Valdiviesso
<pre>
83 54 Gustavo Valdiviesso
sudo apt-get install openconnect 
84 54 Gustavo Valdiviesso
</pre>
85 54 Gustavo Valdiviesso
86 54 Gustavo Valdiviesso
if not, use the appropriate method for your system. You can verify the installation by asking the version:
87 54 Gustavo Valdiviesso
88 54 Gustavo Valdiviesso
<pre>
89 54 Gustavo Valdiviesso
openconnect --version
90 55 Gustavo Valdiviesso
</pre>
91 55 Gustavo Valdiviesso
92 56 Gustavo Valdiviesso
Install a vnc client of your choice. TigerVNC or Remmina work perfectly.
93 35 Gustavo Valdiviesso
94 1 Jose Ignacio Crespo Anadon
h2(count). When you are about to start
95 19 Gustavo Valdiviesso
96 1 Jose Ignacio Crespo Anadon
Contact the current shifter in the hangouts group to tell him/her that you are getting ready. This will give the current shifter time to fill in his  End Of Run report. Ask about the current plan and status (the shifter might ask you to read some e-log entries). 
97 19 Gustavo Valdiviesso
98 19 Gustavo Valdiviesso
Don't log into the hangouts yourself just yet. Wait until the current shifter tells you that he/she is ready to give you the controls. 
99 17 Gustavo Valdiviesso
100 1 Jose Ignacio Crespo Anadon
h2(count).  Setup your shift station
101 1 Jose Ignacio Crespo Anadon
102 35 Gustavo Valdiviesso
Either from a remote connection or from ROC-West, follow these instructions.
103 35 Gustavo Valdiviesso
104 35 Gustavo Valdiviesso
*Log onto the shift computer*
105 35 Gustavo Valdiviesso
106 35 Gustavo Valdiviesso
h3. For a shift at Fermilab:
107 35 Gustavo Valdiviesso
108 35 Gustavo Valdiviesso
* From a *ROC-West machine*, such as lariat-cr-02:
109 35 Gustavo Valdiviesso
** Log in with username = @lariat@.
110 35 Gustavo Valdiviesso
* From an *MCenter machine*, such as ftbflx18 or ftbflx15:
111 35 Gustavo Valdiviesso
** Log in with username = @ftbf_user@.
112 35 Gustavo Valdiviesso
* Password is YOUR kerberos password, then it will ask for YOUR kerberos principal. (Reverse from usual order)
113 35 Gustavo Valdiviesso
114 35 Gustavo Valdiviesso
h3. From a remote shift:
115 35 Gustavo Valdiviesso
116 35 Gustavo Valdiviesso
117 57 Gustavo Valdiviesso
* *VPN* - To connect to the Fermilab VPN, open a terminal and execute:
118 57 Gustavo Valdiviesso
119 57 Gustavo Valdiviesso
<pre>
120 57 Gustavo Valdiviesso
sudo openconnect https://vpn.fnal.gov
121 57 Gustavo Valdiviesso
</pre>
122 57 Gustavo Valdiviesso
123 57 Gustavo Valdiviesso
and it is going to ask for your Username and Password (your SERVICES password).
124 57 Gustavo Valdiviesso
125 57 Gustavo Valdiviesso
If it works, you will be greeted with this message:
126 57 Gustavo Valdiviesso
127 57 Gustavo Valdiviesso
<pre>
128 57 Gustavo Valdiviesso
| NOTICE TO USERS
129 57 Gustavo Valdiviesso
| This  is a Federal system (and/or it is directly connected to a Fermilab local network) ...
130 57 Gustavo Valdiviesso
</pre> 
131 57 Gustavo Valdiviesso
132 57 Gustavo Valdiviesso
That means you are in. Do not close this terminal.
133 57 Gustavo Valdiviesso
134 57 Gustavo Valdiviesso
* *SSH Tunnel* - In another terminal, get a Kerberos ticket
135 57 Gustavo Valdiviesso
136 57 Gustavo Valdiviesso
<pre>
137 57 Gustavo Valdiviesso
kinit <username>@FNAL.GOV
138 57 Gustavo Valdiviesso
</pre>
139 57 Gustavo Valdiviesso
140 57 Gustavo Valdiviesso
with your Kerberos ID. Now, open the tunnel with:
141 57 Gustavo Valdiviesso
142 57 Gustavo Valdiviesso
<pre>
143 57 Gustavo Valdiviesso
ssh -C -L 5900:localhost:5900 lariat@lariat-cr-02.fnal.gov
144 57 Gustavo Valdiviesso
</pre>
145 57 Gustavo Valdiviesso
146 57 Gustavo Valdiviesso
and you know it worked if you get another greeting:
147 57 Gustavo Valdiviesso
148 57 Gustavo Valdiviesso
<pre>
149 57 Gustavo Valdiviesso
Welcome to the LArIAT ROCwest Control Room
150 57 Gustavo Valdiviesso
</pre>
151 57 Gustavo Valdiviesso
152 57 Gustavo Valdiviesso
Again, leave this terminal open. If this fails, ask one of the following collaborators (stjohn@fnal.gov or badgett@fnal.gov) to add you to the ~lariat/.k5login list, which will grant you SSH access.
153 57 Gustavo Valdiviesso
154 57 Gustavo Valdiviesso
* *VNC* - Finally opening the VNC. You may use a client of you choice. When it asks for a server, use *localhost:5900* which is our tunnel. The password is the same as the *lariat-doc-db* password (*%{color:red}NOT SBND's%*).
155 57 Gustavo Valdiviesso
156 57 Gustavo Valdiviesso
157 35 Gustavo Valdiviesso
** *Please do not interfere with the shifter by VNC!*  Contact the shifter on Google Hangouts to confirm a convenient time before you test your VNC.  
158 1 Jose Ignacio Crespo Anadon
* *Google Hangouts* from Chrome browser (phone function does not work in Firefox)
159 36 Gustavo Valdiviesso
** Try to make a free phone call to a US number using the hangouts dialer (may require installing Google Talk plugin first time)
160 35 Gustavo Valdiviesso
** This is how the Main Control Room will phone you (it will ring when they dial +1 331-442-4353) and it is how you should phone them.
161 35 Gustavo Valdiviesso
162 1 Jose Ignacio Crespo Anadon
h3. Windows needed on the shifter computer (or by VNC)
163 35 Gustavo Valdiviesso
164 35 Gustavo Valdiviesso
See these "snapshots":https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki/How_to_set_up_your_shift_station#Shifter-desktop-layout of the ROC-West desktop should give you a good idea about what to look for.
165 35 Gustavo Valdiviesso
166 35 Gustavo Valdiviesso
167 35 Gustavo Valdiviesso
168 35 Gustavo Valdiviesso
---
169 18 Gustavo Valdiviesso
170 18 Gustavo Valdiviesso
171 18 Gustavo Valdiviesso
h2(count). Verify that Synoptic and Acnet are running
172 1 Jose Ignacio Crespo Anadon
173 18 Gustavo Valdiviesso
174 19 Gustavo Valdiviesso
You should get familiar with them. Always keep them open and in clear view. If connecting remotely, you should see them in the VNC shared desktop.
175 18 Gustavo Valdiviesso
176 18 Gustavo Valdiviesso
https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki/Using_Synoptic_for_monitoring
177 18 Gustavo Valdiviesso
178 18 Gustavo Valdiviesso
https://redmine.fnal.gov/redmine/projects/lariat-online/wiki/Using_ACNET_for_monitoring
179 18 Gustavo Valdiviesso
180 17 Gustavo Valdiviesso
h2(count). Connect as the SBND shifter in the hangouts
181 1 Jose Ignacio Crespo Anadon
182 1 Jose Ignacio Crespo Anadon
When the previous shifter had time to call the MCR and declare the end of his/her shift, you may log into the shifter's Hangouts account with:
183 1 Jose Ignacio Crespo Anadon
184 17 Gustavo Valdiviesso
sbndshift@gmail.com
185 1 Jose Ignacio Crespo Anadon
186 17 Gustavo Valdiviesso
using the current SBND DocDB password. The SBND Shift chat is used by the collaborators to communicate with the shifters and between themselves about the VST operations.
187 1 Jose Ignacio Crespo Anadon
188 17 Gustavo Valdiviesso
h2(count). Log into the SBND Electronic Logbook 
189 17 Gustavo Valdiviesso
190 47 William Badgett
http://dbweb0.fnal.gov/ECL/sbnd
191 1 Jose Ignacio Crespo Anadon
192 18 Gustavo Valdiviesso
with your Services user. Make an *VST Start of Shift Cheklist* entry and follow the checklist, which includes calling the Main Control Room (see next step).
193 17 Gustavo Valdiviesso
194 18 Gustavo Valdiviesso
h2(count). Calling the Main Control Room (MCR)
195 17 Gustavo Valdiviesso
196 17 Gustavo Valdiviesso
197 17 Gustavo Valdiviesso
Remember to call MCR (x3721) at the beginning and ending of each shift. If you are remote, you can use the hangouts to do so, but you may have to install a plugin first.
198 17 Gustavo Valdiviesso
199 17 Gustavo Valdiviesso
Main Control Room (internationally) +1.630.840.3721
200 17 Gustavo Valdiviesso
201 17 Gustavo Valdiviesso
Tell the MCR that you are the next LARIAT SHIFTER and if you are local or remote. If you are remote, inform the MCR of your contact number, which is the hangouts voice service:
202 1 Jose Ignacio Crespo Anadon
203 1 Jose Ignacio Crespo Anadon
+1 331 442 4354
204 18 Gustavo Valdiviesso
205 18 Gustavo Valdiviesso
You have to call the MCR at the begging and ending of each shift!
206 18 Gustavo Valdiviesso
207 1 Jose Ignacio Crespo Anadon
h2(count). During your shift
208 50 Gustavo Valdiviesso
209 50 Gustavo Valdiviesso
*See the RUN PLAN at the top of the page.*
210 1 Jose Ignacio Crespo Anadon
211 20 Gustavo Valdiviesso
You have to keep 3 (three) independent terminals running: LArIAT DAQ, SBND DAQ and SBND DQM.
212 14 Gustavo Valdiviesso
213 20 Gustavo Valdiviesso
* LArIAT DAQ: https://cdcvs.fnal.gov/redmine/projects/lariat-online/wiki/LArIAT_DAQ_Instructions
214 14 Gustavo Valdiviesso
215 20 Gustavo Valdiviesso
* SBND DAQ and DQM: https://redmine.fnal.gov/redmine/projects/sbnddaq/wiki/Starting_DAQ_Software
216 14 Gustavo Valdiviesso
217 58 Gustavo Valdiviesso
(*%{color:red}If the SBND DAQ won't start%...try running the command kill_ipcs*, then try again)
218 42 Gustavo Valdiviesso
219 21 Gustavo Valdiviesso
You also need the SBND DQM website (which can only see this via Fermilab VPN or locally through the fgz network): https://sbn-online.fnal.gov/cgi-bin/minargon/minargon.wsgi
220 7 Jose Ignacio Crespo Anadon
221 7 Jose Ignacio Crespo Anadon
222 7 Jose Ignacio Crespo Anadon
223 48 Gustavo Valdiviesso
Keep checking the Synoptics alarms and the DQM website. The DQM has several plots that should be updating every few minutes. If you see any of the time stamps getting too old, you may need to restart it (instructions above). Instructions on how the DQM works are in its first page.
224 10 Jonathan Asaadi
225 22 Gustavo Valdiviesso
Report any oddities in the e-log with a *default* form, under the *Vertical Slice Test* category.
226 6 Gustavo Valdiviesso
227 40 Gustavo Valdiviesso
---
228 41 Gustavo Valdiviesso
229 40 Gustavo Valdiviesso
---
230 41 Gustavo Valdiviesso
231 40 Gustavo Valdiviesso
---
232 6 Gustavo Valdiviesso
233 6 Gustavo Valdiviesso
h1. Advanced Stuff
234 6 Gustavo Valdiviesso
235 6 Gustavo Valdiviesso
h2. How to run the DAQ for the BNL-Nevis integration test
236 1 Jose Ignacio Crespo Anadon
237 1 Jose Ignacio Crespo Anadon
1. Make sure the Nevis crate and NIM bin are powered. Experts: (on-site) Davio Cianci, (off-site) José I. Crespo (Skype: josei.ca)
238 1 Jose Ignacio Crespo Anadon
2. ssh into the DAQ machine
239 4 William Badgett
Log into the SBND gateway (or you can create an FNAL VPN connection and skip sbnd-daq00, not needed on FNAL site)
240 1 Jose Ignacio Crespo Anadon
> ssh -Y sbnd-daq00.fnal.gov
241 1 Jose Ignacio Crespo Anadon
Log into the LArIAT gateway
242 1 Jose Ignacio Crespo Anadon
> ssh -Y lariat-gateway01.fnal.gov
243 1 Jose Ignacio Crespo Anadon
Log into the DAQ server using the common sbnd account (reserved for DAQ) 
244 1 Jose Ignacio Crespo Anadon
> ssh -Y sbnd@lariat-daq04
245 1 Jose Ignacio Crespo Anadon
3. Go to the jcrespo/ directory
246 1 Jose Ignacio Crespo Anadon
> cd jcrespo
247 1 Jose Ignacio Crespo Anadon
Run the DAQ-decoder-plotter script
248 1 Jose Ignacio Crespo Anadon
> ./run_and_plot_sbnddaq.sh
249 1 Jose Ignacio Crespo Anadon
and follow the instructions printed on screen. This script runs the DAQ in calibration mode (CALIB pulses are sent to the Magic Blue Box every 1 s) -- once you have collected the desired number of events, it requires you to stop the DAQ using CTRL + C twice --, then runs the binary decoder, and finally runs a ROOT analysis to plot the waveforms.
250 5 Jose Ignacio Crespo Anadon
251 5 Jose Ignacio Crespo Anadon
The data is saved in the directory /home/nfs/sbnd/jcrespo/runs
252 5 Jose Ignacio Crespo Anadon
The script makes a new directory for each run named RunYearMonthDayHourMinutesSecond (e.g. Run20180620113511).
253 5 Jose Ignacio Crespo Anadon
The raw binary data is the file named output_NevisTPCCALIB_generator.dat. For a hexdump, you can use
254 5 Jose Ignacio Crespo Anadon
> hexdump -v -e '8/2 "%04X ""\n"' output_NevisTPCCALIB_generator.dat | less
255 5 Jose Ignacio Crespo Anadon
(it will display the data in 8 columns with 2 bytes each). The ADC data is encoded in the lower 12 bits (3 last hex characters) of the words beginning with "0".
256 52 William Badgett
257 52 William Badgett
h2. How to configure [[LArIAT Trigger]]