Project

General

Profile

Feature #23906

Create a script to prune and purge the web-area

Added by Marco Mambelli 10 months ago. Updated about 2 months ago.

Status:
New
Priority:
High
Category:
-
Target version:
Start date:
01/15/2020
Due date:
% Done:

0%

Estimated time:
Stakeholders:

HEPCloud, Factory Ops

Duration:

Description

The web-area is the staging area for the files downloaded by the glideins.
Its size can grow considerably, especially if there are many entries and if there are many reconfig/update operations.
Deleting files from it at random may cause inconsistencies that cause errors when the Factory is restarted.
This happens especially because of signature files and download lists, that may end up referencing files that have been deleted.

A script for cleanup operations would be a useful tool. It should allow:
- purging of old files no more used by glideins or referenced by newer download files
- pruning files for entries that are no more in use
All of the above without removing files that are still referenced by files that are kept

This would have been useful in a recent cleanup of the HEPCloud Factory

History

#1 Updated by Marco Mambelli 9 months ago

  • Priority changed from Normal to High

#2 Updated by Marco Mascheroni 4 months ago

  • Target version changed from v3_6_3 to v3_6_4

#3 Updated by Marco Mambelli 2 months ago

  • Target version changed from v3_6_4 to v3_6_5

#4 Updated by Marco Mambelli about 2 months ago

  • Target version changed from v3_6_5 to v3_6_6

Also available in: Atom PDF