Project

General

Profile

Feature #7926

Put stats from factory completed logs into glideresource ads

Added by Brian Bockelman over 5 years ago. Updated about 4 years ago.

Status:
Closed
Priority:
Urgent
Category:
-
Target version:
Start date:
02/23/2015
Due date:
% Done:

0%

Estimated time:
Stakeholders:

OSG, CMS

Duration:

Description

There's a wealth of information plotted here:

http://gfactory-1.t2.ucsd.edu/factory/monitor/factoryCompletedStats.html

However, OSG wants to aggregate this information in a different way from the glideinWMS factory (and wants to aggregate across factories too). I'd like to see the basic raw data in the glideresource ads. We can keep the same groupings. For example, for "User jobs per glidein", we might have six new attributes:
- GlideFactoryCompletedJobsPerGlideinNone
- GlideFactoryCompletedJobsPerGlidein1Job
- GlideFactoryCompletedJobsPerGlidein2Jobs
- GlideFactoryCompletedJobsPerGlidein4Jobs
- GlideFactoryCompletedJobsPerGlidein16Jobs
- GlideFactoryCompletedJobsPerGlideinManyJobs

This would be relatively accessible to Ganglia.

History

#1 Updated by Parag Mhashilkar over 5 years ago

  • Assignee set to Marco Mambelli
  • Target version set to v3_3

#2 Updated by Brian Bockelman about 5 years ago

  • Priority changed from High to Urgent

This is become more problematic for CMS. Raising priority.

#3 Updated by Parag Mhashilkar almost 5 years ago

  • Target version changed from v3_3 to v3_2_12

Marco, I am putting this for v3.2.12 but during the development if you feel that it breaks backwards compatibility we should move this back to v3.3 release

#4 Updated by Parag Mhashilkar over 4 years ago

  • Target version changed from v3_2_12 to v3_2_13

#5 Updated by Parag Mhashilkar over 4 years ago

  • Target version changed from v3_2_13 to v3_2_14

#6 Updated by Marco Mambelli over 4 years ago

  • Status changed from New to Feedback
  • Assignee changed from Marco Mambelli to Parag Mhashilkar

Changes are in v3/7926

The values refer to the Entry or the Factory, there is no per frontend/group breakdown.

Here the attributes in the glideresource classad, the names are GlideFactoryMonitorCompletedJobsPerEntry/PerFactory :

GlideFactoryMonitorCompletedJobsPerEntry16jobs = 0
GlideFactoryMonitorCompletedJobsPerEntry16jobs = 0
GlideFactoryMonitorCompletedJobsPerEntry1job = 0
GlideFactoryMonitorCompletedJobsPerEntry1job = 0
GlideFactoryMonitorCompletedJobsPerEntry2jobs = 0
GlideFactoryMonitorCompletedJobsPerEntry2jobs = 0
GlideFactoryMonitorCompletedJobsPerEntry4jobs = 0
GlideFactoryMonitorCompletedJobsPerEntry4jobs = 0
GlideFactoryMonitorCompletedJobsPerEntryMany = 0
GlideFactoryMonitorCompletedJobsPerEntryMany = 0
GlideFactoryMonitorCompletedJobsPerEntryNone = 0
GlideFactoryMonitorCompletedJobsPerEntryNone = 0
GlideFactoryMonitorCompletedJobsPerFactory16jobs = 0
GlideFactoryMonitorCompletedJobsPerFactory16jobs = 0
GlideFactoryMonitorCompletedJobsPerFactory1job = 0
GlideFactoryMonitorCompletedJobsPerFactory1job = 0
GlideFactoryMonitorCompletedJobsPerFactory2jobs = 0
GlideFactoryMonitorCompletedJobsPerFactory2jobs = 0
GlideFactoryMonitorCompletedJobsPerFactory4jobs = 0
GlideFactoryMonitorCompletedJobsPerFactory4jobs = 0
GlideFactoryMonitorCompletedJobsPerFactoryMany = 0
GlideFactoryMonitorCompletedJobsPerFactoryMany = 0
GlideFactoryMonitorCompletedJobsPerFactoryNone = 0
GlideFactoryMonitorCompletedJobsPerFactoryNone = 0

Here the example of the output from the factory glidefactory classad (at a time where there was some activity).

GlideinMonitorCompletedJobsPerEntry16jobs = 0
GlideinMonitorCompletedJobsPerEntry16jobs = 0
GlideinMonitorCompletedJobsPerEntry1job = 0
GlideinMonitorCompletedJobsPerEntry1job = 0
GlideinMonitorCompletedJobsPerEntry2jobs = 0
GlideinMonitorCompletedJobsPerEntry2jobs = 0
GlideinMonitorCompletedJobsPerEntry4jobs = 1
GlideinMonitorCompletedJobsPerEntry4jobs = 5
GlideinMonitorCompletedJobsPerEntryMany = 0
GlideinMonitorCompletedJobsPerEntryMany = 0
GlideinMonitorCompletedJobsPerEntryNone = 0
GlideinMonitorCompletedJobsPerEntryNone = 0
GlideinMonitorCompletedJobsPerFactory16jobs = 0
GlideinMonitorCompletedJobsPerFactory16jobs = 0
GlideinMonitorCompletedJobsPerFactory1job = 0
GlideinMonitorCompletedJobsPerFactory1job = 0
GlideinMonitorCompletedJobsPerFactory2jobs = 0
GlideinMonitorCompletedJobsPerFactory2jobs = 0
GlideinMonitorCompletedJobsPerFactory4jobs = 6
GlideinMonitorCompletedJobsPerFactory4jobs = 6
GlideinMonitorCompletedJobsPerFactoryMany = 0
GlideinMonitorCompletedJobsPerFactoryMany = 0
GlideinMonitorCompletedJobsPerFactoryNone = 0
GlideinMonitorCompletedJobsPerFactoryNone = 0

#7 Updated by Parag Mhashilkar about 4 years ago

  • Assignee changed from Parag Mhashilkar to Marco Mambelli

Sent feedback separately.

#8 Updated by Marco Mambelli about 4 years ago

  • Status changed from Feedback to Resolved

Feedback applied, tested and merged in branch_v3_2

#9 Updated by Parag Mhashilkar about 4 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF