Network Data Copy Tests¶

The following procedure is used to load the network between the DCM and a buffernode (or master)

On the source machine:

First generate a large file (this produces a 1 GB file on the local shared memory file system:

dd if=/dev/urandom of=/dev/shm/testfile bs=8192  count=131072 >& /dev/null

Next spin up a source port that will feed the file to a client. This incantation does so on port 9333

while true ; do cat /dev/shm/testfile ; done  | ./pv -b | nc -l 9333 > /dev/null

When this starts it will show a byte count of bytes transferred to the pipe. This should start immediately and then block at 64kb (if no one is reading).

Now on the DCM client side:

Start up a client to consume the file over the network:

while true ; do socat - tcp4-connect:192.168.136.16:9333 | pv -b > /dev/null ; done

When this connects it will show a running byte count of byte received. The example is:

[dcm-2-03-01]: while true ; do socat - tcp4-connect:192.168.136.16:9334 | pv -b > /dev/null ; done
10.4GiB

This test can be left running and will just continue to send the file between the two nodes. When the test fails the pipes will stall and you will get a sum of the number of bytes at the time when one of the ends failed.

Network test results¶