Feature #15474
pullProducts pulling only products that are not yet available
0%
Description
I would like to have an option for pullProducts (e.g. --if-not-available-already) to skip pulling a product when it is already available in any of the configured UPS databases, as in
ups exists ProductName -q Qualifiers -f Flavourregardless of which repository it comes from. Or in alternative, if present in any of the UPS databases specified on the command line (e.g.
--if-not-available-at=/products --if-not-available-at=/cvmfs/mypath/myexperiment/products).
This would avoid the accumulation of data products on servers which already have most of them in a central repository, but not all (e.g. woof.fnal.gov, or my laptop if I am willing to turn CVMFS on).
History
#1 Updated by Lynn Garren about 3 years ago
- Status changed from New to Feedback
pullProducts is designed to do this already. By default, pullProducts will check everything in $PRODUCTS unless you use the -p option to restrict the list of databases to check. Can you provide us with a specific use case that is problematic?
#2 Updated by Gianluca Petrillo about 3 years ago
Nope.
After your words, I realise that my normal "pullProducts workflow" does not include setting up other UPS databases (because I was not aware of this feature, as you may have figured out thanks to this request).
I just verified that doing that is enough to enable the feature I was looking for.
Sorry for the noise; you can close the request.
#3 Updated by Lynn Garren about 3 years ago
- Status changed from Feedback to Closed
Feature already available.