Results of integration with prototype RCE system Oct 2014¶
Ryan Herbst, Matt Graham, Giles Barr, John Freeman, Kurt Biery, Tim Nicholls
System configuration¶
ATCA shelf with 1 COB, containing 4xDPMs (8RCEs) and 1xDTM installed. Set up on DAQ internal network with hostnames lbnedpm0-8, lbnedpm0, lbnecob-sm (shelf manager).
RCEs mount /data/lbnedaq/cob_nfs from lbne35t-gateway01 as /mnt/host
Test operation¶
IMPORTANT NOTE: Any data files generated in this test have a TEMPORARY data format that is likely to change soon!
Built, configured and ran lbne-artdaq system in /data/lbnedaq/rce ran with 2xRCEs (DPM0,1) in 2x2x2 mode on lbnedaq3
Default configuration for RCEs loaded by rceServer from file /data/lbnedaq/cob_nfs/35ton/config/defaults.xml
RCE data transfer firmware/software set up to generate 3xmicroslices per second. BoardReader configured to create 1 millislice per 3 microslices, i.e. 1Hz of fragments.
Wrote data file in this mode, stored on system as /data/lbnedaq/data/lbne_r001000_sr01_20141003T134235.root (see files below)
Also ran under DAQInterface / runControl prototype with guidance from John F, following instructions on wiki at: https://cdcvs.fnal.gov/redmine/projects/lbne-daq/wiki/Running_DAQ_Interface
Created DAQInterface configuration file at /data/lbnedaq/scratch/DAQInterface/lbnerc/docs/config_lbnedaq3_2RCE.txt:
lbne-artdaq: /data/lbnedaq/rce/build_lbne-artdaq PMT host: lbnedaq3 pause before initialization: 0 # debug level can range from 0 to 3 (increasing order of verbosity) debug level: 1 log directory: /data/lbnedaq/daqlogs BoardReader host: lbnedaq3 BoardReader port: 5205 BoardReader fhicl: /data/lbnedaq/fcl/BoardReader_TPC_RCE_lbnedaq3_1.fcl BoardReader host: lbnedaq3 BoardReader port: 5206 BoardReader fhicl: /data/lbnedaq/fcl/BoardReader_TPC_RCE_lbnedaq3_2.fcl EventBuilder host: lbnedaq3 EventBuilder port: 5235 EventBuilder fhicl: /data/lbnedaq/fcl/EventBuilder_lbnedaq2_1.fcl EventBuilder host: lbnedaq3 EventBuilder port: 5236 EventBuilder fhicl: /data/lbnedaq/fcl/EventBuilder_lbnedaq2_2.fcl Aggregator host: lbnedaq3 Aggregator port: 5265 Aggregator fhicl: /data/lbnedaq/fcl/Aggregator_lbnedaq2_1.fcl Aggregator host: lbnedaq3 Aggregator port: 5266 Aggregator fhicl: /data/lbnedaq/fcl/Aggregator_lbnedaq2_2.fcl
BoardReader FCL files:
BoardReader_TPC_RCE_lbnedaq3_1.fcl
daq: { max_fragment_size_words: 262144 fragment_receiver: { mpi_buffer_count: 16 mpi_sync_interval: 50 first_event_builder_rank: 2 event_builder_count: 2 generator: TpcRceReceiver fragment_type: TPC fragment_id: 0 board_id: 0 sleep_on_stop_us: 500000 number_of_microslices_per_millislice: 3 rce_client_host_addr: lbnedpm0 rce_client_host_port: 8090 rce_client_timeout_usecs: 500000 rce_xml_config_file: 'config/defaults.xml' # Configuration file rce_daq_mode: 'Trigger' # Can be one of Burst, Scope, Trigger rce_data_dest_host: '10.0.1.2' rce_data_dest_port: 8991 rce_data_num_millislices: 0 # 0=Run until stopped rce_data_num_microslices: 100 rce_data_frag_rate: 1000.0 rce_data_adc_mode: 4 rce_data_adc_mean: 1000.0 rce_data_adc_sigma: 100.0 receive_port: 8991 receiver_debug_level: 1 receiver_tick_period_usecs: 10000 reporting_interval_fragments: 100 raw_buffer_size: 1000000 raw_buffer_precommit: 10 use_fragments_as_raw_buffer: true }
BoardReader_TPC_RCE_lbnedaq3_1.fcl:
daq: { max_fragment_size_words: 262144 fragment_receiver: { mpi_buffer_count: 16 mpi_sync_interval: 50 first_event_builder_rank: 2 event_builder_count: 2 generator: TpcRceReceiver fragment_type: TPC fragment_id: 1 board_id: 1 sleep_on_stop_us: 500000 number_of_microslices_per_millislice: 3 rce_client_host_addr: lbnedpm1 rce_client_host_port: 8090 rce_client_timeout_usecs: 500000 rce_xml_config_file: 'config/defaults.xml' # Configuration file rce_daq_mode: 'Trigger' # Can be one of Burst, Scope, Trigger rce_data_dest_host: '10.0.1.2' rce_data_dest_port: 8992 rce_data_num_millislices: 0 # 0=Run until stopped rce_data_num_microslices: 100 rce_data_frag_rate: 1000.0 rce_data_adc_mode: 4 rce_data_adc_mean: 1000.0 rce_data_adc_sigma: 100.0 receive_port: 8992 receiver_debug_level: 1 receiver_tick_period_usecs: 10000 reporting_interval_fragments: 100 raw_buffer_size: 1000000 raw_buffer_precommit: 10 use_fragments_as_raw_buffer: true }
Wrote data file as /data/lbnedaq/data/lbne35t_r000999_sr01_20141003T135711.root (see below)