Results of integration with prototype RCE system Oct 2014¶

Ryan Herbst, Matt Graham, Giles Barr, John Freeman, Kurt Biery, Tim Nicholls

System configuration¶

ATCA shelf with 1 COB, containing 4xDPMs (8RCEs) and 1xDTM installed. Set up on DAQ internal network with hostnames lbnedpm0-8, lbnedpm0, lbnecob-sm (shelf manager).
RCEs mount /data/lbnedaq/cob_nfs from lbne35t-gateway01 as /mnt/host

Test operation¶

IMPORTANT NOTE: Any data files generated in this test have a TEMPORARY data format that is likely to change soon!

Built, configured and ran lbne-artdaq system in /data/lbnedaq/rce ran with 2xRCEs (DPM0,1) in 2x2x2 mode on lbnedaq3

Default configuration for RCEs loaded by rceServer from file /data/lbnedaq/cob_nfs/35ton/config/defaults.xml

RCE data transfer firmware/software set up to generate 3xmicroslices per second. BoardReader configured to create 1 millislice per 3 microslices, i.e. 1Hz of fragments.

Wrote data file in this mode, stored on system as /data/lbnedaq/data/lbne_r001000_sr01_20141003T134235.root (see files below)

Also ran under DAQInterface / runControl prototype with guidance from John F, following instructions on wiki at: https://cdcvs.fnal.gov/redmine/projects/lbne-daq/wiki/Running_DAQ_Interface

Created DAQInterface configuration file at /data/lbnedaq/scratch/DAQInterface/lbnerc/docs/config_lbnedaq3_2RCE.txt:

lbne-artdaq: /data/lbnedaq/rce/build_lbne-artdaq

PMT host: lbnedaq3

pause before initialization: 0

# debug level can range from 0 to 3 (increasing order of verbosity)
debug level: 1

log directory:   /data/lbnedaq/daqlogs

BoardReader host: lbnedaq3
BoardReader port: 5205
BoardReader fhicl: /data/lbnedaq/fcl/BoardReader_TPC_RCE_lbnedaq3_1.fcl

BoardReader host: lbnedaq3
BoardReader port: 5206
BoardReader fhicl: /data/lbnedaq/fcl/BoardReader_TPC_RCE_lbnedaq3_2.fcl

EventBuilder host: lbnedaq3
EventBuilder port: 5235
EventBuilder fhicl: /data/lbnedaq/fcl/EventBuilder_lbnedaq2_1.fcl

EventBuilder host: lbnedaq3
EventBuilder port: 5236
EventBuilder fhicl: /data/lbnedaq/fcl/EventBuilder_lbnedaq2_2.fcl

Aggregator host: lbnedaq3
Aggregator port: 5265
Aggregator fhicl: /data/lbnedaq/fcl/Aggregator_lbnedaq2_1.fcl

Aggregator host: lbnedaq3
Aggregator port: 5266
Aggregator fhicl: /data/lbnedaq/fcl/Aggregator_lbnedaq2_2.fcl

BoardReader FCL files:

BoardReader_TPC_RCE_lbnedaq3_1.fcl

  daq: {
  max_fragment_size_words: 262144
  fragment_receiver: {
    mpi_buffer_count: 16
    mpi_sync_interval: 50
    first_event_builder_rank: 2
    event_builder_count: 2

        generator: TpcRceReceiver
    fragment_type: TPC
    fragment_id: 0
    board_id: 0
    sleep_on_stop_us: 500000 

 number_of_microslices_per_millislice: 3

 rce_client_host_addr: lbnedpm0 
 rce_client_host_port: 8090
 rce_client_timeout_usecs: 500000

 rce_xml_config_file: 'config/defaults.xml'  # Configuration file
 rce_daq_mode: 'Trigger' # Can be one of Burst, Scope, Trigger

 rce_data_dest_host: '10.0.1.2'
 rce_data_dest_port: 8991  
 rce_data_num_millislices: 0    # 0=Run until stopped
 rce_data_num_microslices: 100
 rce_data_frag_rate: 1000.0
 rce_data_adc_mode: 4
 rce_data_adc_mean: 1000.0
 rce_data_adc_sigma: 100.0

 receive_port: 8991

 receiver_debug_level: 1
 receiver_tick_period_usecs: 10000

 reporting_interval_fragments: 100

 raw_buffer_size: 1000000
 raw_buffer_precommit: 10 
 use_fragments_as_raw_buffer: true

    }

BoardReader_TPC_RCE_lbnedaq3_1.fcl:

  daq: {
  max_fragment_size_words: 262144
  fragment_receiver: {
    mpi_buffer_count: 16
    mpi_sync_interval: 50
    first_event_builder_rank: 2
    event_builder_count: 2

        generator: TpcRceReceiver
    fragment_type: TPC
    fragment_id: 1
    board_id: 1
    sleep_on_stop_us: 500000 

 number_of_microslices_per_millislice: 3

 rce_client_host_addr: lbnedpm1
 rce_client_host_port: 8090
 rce_client_timeout_usecs: 500000

 rce_xml_config_file: 'config/defaults.xml'  # Configuration file
 rce_daq_mode: 'Trigger' # Can be one of Burst, Scope, Trigger

 rce_data_dest_host: '10.0.1.2'
 rce_data_dest_port: 8992  
 rce_data_num_millislices: 0    # 0=Run until stopped
 rce_data_num_microslices: 100
 rce_data_frag_rate: 1000.0
 rce_data_adc_mode: 4
 rce_data_adc_mean: 1000.0
 rce_data_adc_sigma: 100.0

 receive_port: 8992

 receiver_debug_level: 1
 receiver_tick_period_usecs: 10000

 reporting_interval_fragments: 100

 raw_buffer_size: 1000000
 raw_buffer_precommit: 10 
 use_fragments_as_raw_buffer: true

    }

Wrote data file as /data/lbnedaq/data/lbne35t_r000999_sr01_20141003T135711.root (see below)