Project

General

Profile

Support #6926

Support #5787: FNAL CVMFS Stratum 1 support

Change pull_and_push.sh to use cvmfs_server snapshot

Added by Dave Dykstra almost 6 years ago. Updated almost 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Target version:
-
Start date:
09/03/2014
Due date:
09/05/2014
% Done:

0%

Estimated time:
8.00 h
Duration: 3

Description

Rsync slows down too much when there's other disk activity such as the installation of a new repository replica. Change pull_and_push.sh to use cvmfs_server snapshot on backup reading from master, instead of using rsync. Also write a remove-repository, and change add-repository to also do the double-snapshot. Also reduce the default CVMFS_NUM_WORKERS for replication; 16 does an awful lot of disk activity.

History

#1 Updated by Dave Dykstra almost 6 years ago

  • Parent task set to #5787

#2 Updated by Dave Dykstra almost 6 years ago

  • Status changed from New to Closed

This was finished last week. Did not end up reducing CVMFS_NUM_WORKERS, but did many measurements and found that the current machines are extremely slow at creating (and removing) many small files. Most likely it is because the filesystem is xfs.



Also available in: Atom PDF