Project

General

Profile

Feature #5519

Add limits on total idle glideins

Added by Igor Sfiligoi over 5 years ago. Updated over 5 years ago.

Status:
Closed
Priority:
High
Assignee:
Igor Sfiligoi
Category:
Frontend
Target version:
Start date:
02/26/2014
Due date:
% Done:

0%

Estimated time:
Stakeholders:

CMS

Duration:

Description

The Frontend currently only has limits on how many idle glideins there are per entry, but not how many in total there are.

CMS is currently hurting due to this, as any time the total exceeds about 2k, the system becomes unstable.

With hundreds of entries, there is no good per-entry number that would really be acceptable.


Related issues

Related to GlideinWMS - Feature #5579: Add limits on globaly total idle glideinsClosed03/03/2014

History

#1 Updated by Igor Sfiligoi over 5 years ago

  • Status changed from Assigned to Feedback
  • Assignee changed from Igor Sfiligoi to Parag Mhashilkar

I have implemented the change.
it is in
v3/5519

The FE config now has a line like this in the config
<idle_vms_total curb="200" max="1000"/>

and the rest of the code knows how to use it.

It is backwards compatible, so it can be upgraded in place.

Please review.

#2 Updated by Igor Sfiligoi over 5 years ago

I have created a new branch
v3/5519_v2
that is branched from the latest branch_v3_2 as of today.

Had to fix a bunch of merge conflicts due to #3967.
Still need to properly test it.

#3 Updated by Parag Mhashilkar over 5 years ago

Ok let me know when you ready for me to review it.

#4 Updated by Igor Sfiligoi over 5 years ago

The merge looks good... please review.

#5 Updated by Parag Mhashilkar over 5 years ago

  • Assignee changed from Parag Mhashilkar to Igor Sfiligoi

Can you please update the sample config doc and describe what each of these parameters do as well? I looked at the code and now I am confused. These settings seemed to be part of group config while the description implies that these new limits are frontend wide. So essentially, different groups can have different limits configured at any time.

#6 Updated by Igor Sfiligoi over 5 years ago

Sure, will add some docs. Any suggestion where?

As for "different groups can have different limits configured at any time", this is correct.
We already have this on other quantities, so I just extended it.
As with the existing knobs, the rationale is that not all groups need the same amount of pushing, and not all of them as important to the global system.

#7 Updated by Parag Mhashilkar over 5 years ago

#8 Updated by Igor Sfiligoi over 5 years ago

OK, found the point in the docs to change... doing it now.

#9 Updated by Igor Sfiligoi over 5 years ago

  • Assignee changed from Igor Sfiligoi to Parag Mhashilkar

Documentation written.
Please review.

#10 Updated by Parag Mhashilkar over 5 years ago

  • Target version changed from v3_2_5 to v3_2_4

#11 Updated by Parag Mhashilkar over 5 years ago

Progress so far - sent feedback to Igor separately.

#12 Updated by Parag Mhashilkar over 5 years ago

  • Status changed from Feedback to Closed
  • Assignee changed from Parag Mhashilkar to Igor Sfiligoi

Merged it back to branch_v3_2 after changes from Igor.



Also available in: Atom PDF