Project

General

Profile

DAQ cluster

This page contains information on all the DAQ machines in the test beam cluster and how to access them.

DAQ machines

Manager nodes:
novadaq-test-runcontrol
novadaq-test-trigger
novadaq-test-db (Not actually for the database. For TB we use the ND DB machine. This machine is used for CR/Nearline releases.)
novadaq-test-datadisk
novadaq-test-master

Farm nodes:
novadaq-test-farm-01
novadaq-test-farm-02
novadaq-test-farm-03
novadaq-test-farm-04

TDU:
tdu-test-master-ppc-01
[tdu-test-master-arm-01]

DCMs:
dcm-5-01-01
dcm-5-01-02
dcm-5-01-03

Complete map with all network addresses:
NOvA DocDB 30333: https://nova-docdb.fnal.gov/cgi-bin/private/ShowDocument?docid=30333

Ganglia

Ganglia monitor is hosted on test-master: http://novadaq-test-master.fnal.gov/ganglia/
Note that the farms and managers are labeled as novadaq-data-test-<node>. This was necessary to ensure consistent communication between nodes. The "data" flag just denotes the private network side of those machines.

FTS

FTS is setup for raw files in /data/TestBeam and can be monitored here: http://novadaq-test-datadisk.fnal.gov:8888/fts/status

Accessing DAQ machines

The manager and farm nodes are on both the public FNAL network and our private test beam vlan, so may be accessed via fgz. The DAQ hardware components are only on the private network so must be accessed via test-master.

There are multiple users; the most commonly used is novadaq. You must be in the .k5login to access with Kerberos authentication (feel free to ask Mike Wallbank for access):

ssh novadaq@novadaq-test-master.fnal.gov
For convenience, the following aliases are defined:
  • tdu -- to ssh onto TDU
  • dcm1, dcm2, dcm3 -- to ssh onto DCMs 1,2,3

VNC desktops

Analogously to the near and far detectors, we use VNC desktops to control and monitor data taking. Instructions on logging onto VNC desktops:

See VNC instructions to get started. To setup tunnels to the test cluster VNC sessions use the following lines:

    ssh -L 5941:localhost:5951 -N -f -l novacr01 novadaq-test-master.fnal.gov
    ssh -L 5942:localhost:5952 -N -f -l novacr02 novadaq-test-master.fnal.gov
    ssh -L 5943:localhost:5953 -N -f -l novacr03 novadaq-test-master.fnal.gov
    ssh -L 5944:localhost:5954 -N -f -l novacr04 novadaq-test-master.fnal.gov
    ssh -L 5945:localhost:5951 -N -f -l novadaq novabeamlinedaq00.fnal.gov

Connect to localhost:594{1-4} to access CR-0{1-4}.
Remember to close your tunnels when you are done working:

    pkill -f 'ssh -L 5941:localhost:5951 -N -f -l novacr01 novadaq-test-master.fnal.gov'
    pkill -f 'ssh -L 5942:localhost:5952 -N -f -l novacr02 novadaq-test-master.fnal.gov'
    pkill -f 'ssh -L 5943:localhost:5953 -N -f -l novacr03 novadaq-test-master.fnal.gov'
    pkill -f 'ssh -L 5944:localhost:5954 -N -f -l novacr04 novadaq-test-master.fnal.gov'
    pkill -f 'ssh -L 5945:localhost:5951 -N -f -l novadaq novabeamlinedaq00.fnal.gov'

Web server

If novadaq-test-master is rebooted, the web server will need restarting in order to view ganglia and the tdu monitor. To start the web server, logon as root and do:

service httpd start