Project

General

Profile

Feature #15474

pullProducts pulling only products that are not yet available

Added by Gianluca Petrillo over 2 years ago. Updated over 2 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Target version:
-
Start date:
02/06/2017
Due date:
% Done:

0%

Estimated time:
Scope:
Internal
Experiment:
-
SSI Package:
Co-Assignees:
Duration:

Description

I would like to have an option for pullProducts (e.g. --if-not-available-already) to skip pulling a product when it is already available in any of the configured UPS databases, as in

ups exists ProductName -q Qualifiers -f Flavour
regardless of which repository it comes from. Or in alternative, if present in any of the UPS databases specified on the command line (e.g. --if-not-available-at=/products --if-not-available-at=/cvmfs/mypath/myexperiment/products).

This would avoid the accumulation of data products on servers which already have most of them in a central repository, but not all (e.g. woof.fnal.gov, or my laptop if I am willing to turn CVMFS on).

History

#1 Updated by Lynn Garren over 2 years ago

  • Status changed from New to Feedback

pullProducts is designed to do this already. By default, pullProducts will check everything in $PRODUCTS unless you use the -p option to restrict the list of databases to check. Can you provide us with a specific use case that is problematic?

#2 Updated by Gianluca Petrillo over 2 years ago

Nope.
After your words, I realise that my normal "pullProducts workflow" does not include setting up other UPS databases (because I was not aware of this feature, as you may have figured out thanks to this request).
I just verified that doing that is enough to enable the feature I was looking for.

Sorry for the noise; you can close the request.

#3 Updated by Lynn Garren over 2 years ago

  • Status changed from Feedback to Closed

Feature already available.



Also available in: Atom PDF