Project

General

Profile

Feature #15938

Archiving Tasks, Jobs and possibly job logs

Added by Marc Mengel over 2 years ago. Updated about 1 year ago.

Status:
Rejected
Priority:
Normal
Assignee:
Target version:
Start date:
03/21/2017
Due date:
% Done:

0%

Estimated time:
Scope:
Internal
Experiment:
-
Stakeholders:
Duration:

Description

This ticket is to track discussions of archiving jobs info, (which is a long term requiremnt 'cause we do not have database space to keep detailed job info indefinitely)

Current rough proposal:

  • Periodically Submissions (Tasks) of a certain age would have all the Task /Job / JobHistories / JobFiles etc associated with them dumped off to a database dump of some sort (text dump, or maybe sqlite tables)
  • this would be archived in an experiment provided dcache persistent area with small file aggregation.
  • at the same time, we could jobsub_fetchlog the associated logs to the same SFA area
  • Tasks thus archived would be replaced with entries in a new ArchivedTasks table, which would include summary counts, etc of jobs, etc as needed to continue to give total Campaign statistics.

History

#1 Updated by Stephen White over 2 years ago

  • Assignee set to Stephen White

#2 Updated by Anna Mazzacane about 2 years ago

  • Target version set to v2_3_0

#3 Updated by Anna Mazzacane about 2 years ago

  • Target version deleted (v2_3_0)

Moving this task outside this release. Need further discussion for the implementation.

#4 Updated by Anna Mazzacane over 1 year ago

  • Target version set to 1385

#5 Updated by Stephen White over 1 year ago

  • Target version changed from 1385 to Future

#6 Updated by Stephen White about 1 year ago

  • Status changed from Under Discussion to Rejected


Also available in: Atom PDF