FTS for the Laser Scanner » History » Version 2

« Previous - Version 2/11 (diff) - Next » - Current version
Andrew Norman, 10/30/2012 03:49 PM

FTS for the Laser Scanner

The file transfer service has been setup as a transport layer for data taken with the laser scanner at Ash River. Setting up the system required some additional steps to make it possible to bridge the gap between the machine that runs the laser scanner software (which is a windows 7 laptop) and the linux based system that runs the file transfer service.

General Topology and Dataflow

We have setup the FTS system in a slightly different manner for use with the laser scanner than we have with the rest of the DAQ. The data is generated on a windows based pc that is connected to a laser scanner. The data is then processed locally on the windows machine to generate a set of files for further analysis. These files are bundled into a "tar" format archive file and placed in the c:\Export directory of the windows machine.

The machine running the FTS instance is then setup to mount the c:\Export directory from the windows machine, and performs a synchronization of the files that it finds in that area with another directory that resides on the FTS machine's local disk array. The area that is sync'd to is currently setup as /assembly which is a symbolic link to /data-b/assembly (a directory on the secondary raid array of the disk).

This area (/assembly) is set as the dropbox location that the FTS system will look in for new files.

When a new file is found it is transfered via an FTS relay (being hosted from to an intermediate area on the Fermilab bluearc (/nova/ana/assembly_fts). This area is set as the drop box for the relay FTS agent which then transfers the files to both the enstore tape system and to a well organized area on bluearc designed to be used for analysis (/nova/ana/assembly_ana). In these areas the files are organized by directories corresponding to the numbers of the blocks and then again in directories corresponding to the layers numbers.

External Mount

In order to mount the disk from the machine that is taking the laser scanner data the following steps were taken:

  • The cifs file system extensions had to be installed (part of base Linux install on this machine)
  • Optionally the cifs-utils package can be installed to aid with debugging (this was done on novadcs-far-master)

The file system is mounted using the command:

mount -t cifs // -o ro,username=LAZER\ SCANNER,password=THEPASSWORD,forceuid,forcegid,uid=novaraw,gid=nova /mnt/laser_scan