Project

General

Profile

Setting up new lngs test bench » History » Version 22

« Previous - Version 22/25 (diff) - Next » - Current version
Alessandro Razeto, 01/24/2013 08:35 AM


Setting up new lngs test bench

The new test-bench was installed in LNGS, the setup is based on DSFR5 and DSEB7 shipped by FNAL.
This page report all the activities done by Alessandro to install the system and have it running.

HW installation

The following items were installed in a room of electronic lab in LNGS:
  • DSFR5 (fragment receiver 5), DSEB7 (event builder 7), IB switch + cables from FNAL
  • 1x A3818 from Ed
  • 4x 62/125 optical fibers
  • Cisco RV042G router 1000baseT with 4 port switch
  • Belkin F1DS104P 4 port PS2 KVM
  • Belkin PS2F-USB USB to PS2 adapter

Router configuration

The RV042G router has been configured as follow:
  • world address ds50tb.lngs.infn.it
  • internal address gw.lngs.infn.it = 10.254.254.254
  • internal network 10.254.254.0/24
  • fixed dhcp entries + dns:
    • dsfr5 = 10.254.254.105
    • dseb7 = 10.254.254.7
    • ibds address still point to old 192.168 based ip: it is mandatory to change them.
  • added port forward 2000 + IP WAN to 22 LAN (then 2007 will be forwarded to EB7 and 2105 to FR5)

The router can be reached with a ssh tunnel:

ssh -C -L 8000:10.254.254.254:443 -p 2105 ds50tb.lngs.infn.it

Network schema
The network pattern is the following:
  • 10.254.254.10x will be assigned to FRx
  • 10.254.254.x will be assigned to EBx

Infiniband IPs will have the same pattern based on 10.254.253.0/24 numbering (and 10.254.252.0/24 for IPMI).
The same configurations for network will be used in the DAQ cluster of DS50.

DSFR5

  1. in bios disable NIC bios (to avoid trying DHCP there)
  2. root pwd changed to the same as darkside default
  3. changed network properties:
    • remove all static ips from /etc/sysconfig/networking/profiles/default/hosts
      • IP addresses should be configured in /etc/sysconfig/network-scripts/ifcfg-*
    • enable DHCP in /etc/sysconfig/networking/profiles/default/ifcfg-eth0
    • set timezone to rome (with tzselect)
  4. programs:
    • remove proxy from /etc/yum.cfg nd /etc/wgetrc
    • use lngs ntp server (ntp0.lngs.infn.it) in /etc/ntp.conf
      • (sfoulkes) I think this is the way to go. I updated the configuration on both dsfr5 and dseb7 and restarted the NTP daemons. Both of them synchronized with this server and appear to be working correctly.
    • install gpm, bash-completition, unison, nmap, socat, iperf
    • enable sshd and gpm as default (chkconfig sshd on)
  5. environment:
    • clone /products /usr/local /home/razeto from dsfr6-wh14.fnal.gov
    • recompile A3818 driver in /usr/local/CAEN and install it in kernel
      • cd /usr/local/CAEN/A3818Drv-1.3/ && make clean all (this folder is already patched with Alessandro's mod)
      • cp /usr/local/CAEN/A3818Drv-1.3/src/a3818.ko /lib/modules/2.6.32-279.1.1.el6.x86_64/extra/
      • depmod -a
    • install udev to automagically load caen driver (fix group to g163)
  6. PENDING:
    • hosts.equiv
    • IB ip
    • disable password access

DSEB7

  1. in bios lower fan speed
  2. follow point 1-4 from DSFR5, BUT
    • static ips are in /etc/hosts
    • DHCP has to be set in /etc/sysconfig/network-scripts/ifcfg-eth0
  3. PENDING:
    • same as FR5