Feature #5519
Add limits on total idle glideins
0%
CMS
Description
The Frontend currently only has limits on how many idle glideins there are per entry, but not how many in total there are.
CMS is currently hurting due to this, as any time the total exceeds about 2k, the system becomes unstable.
With hundreds of entries, there is no good per-entry number that would really be acceptable.
Related issues
History
#1 Updated by Igor Sfiligoi over 6 years ago
- Status changed from Assigned to Feedback
- Assignee changed from Igor Sfiligoi to Parag Mhashilkar
I have implemented the change.
it is in
v3/5519
The FE config now has a line like this in the config
<idle_vms_total curb="200" max="1000"/>
and the rest of the code knows how to use it.
It is backwards compatible, so it can be upgraded in place.
Please review.
#2 Updated by Igor Sfiligoi over 6 years ago
I have created a new branch
v3/5519_v2
that is branched from the latest branch_v3_2 as of today.
Had to fix a bunch of merge conflicts due to #3967.
Still need to properly test it.
#3 Updated by Parag Mhashilkar over 6 years ago
Ok let me know when you ready for me to review it.
#4 Updated by Igor Sfiligoi over 6 years ago
The merge looks good... please review.
#5 Updated by Parag Mhashilkar over 6 years ago
- Assignee changed from Parag Mhashilkar to Igor Sfiligoi
Can you please update the sample config doc and describe what each of these parameters do as well? I looked at the code and now I am confused. These settings seemed to be part of group config while the description implies that these new limits are frontend wide. So essentially, different groups can have different limits configured at any time.
#6 Updated by Igor Sfiligoi over 6 years ago
Sure, will add some docs. Any suggestion where?
As for "different groups can have different limits configured at any time", this is correct.
We already have this on other quantities, so I just extended it.
As with the existing knobs, the rationale is that not all groups need the same amount of pushing, and not all of them as important to the global system.
#7 Updated by Parag Mhashilkar over 6 years ago
This should be a good place to document these parameters.
http://www.uscms.org/SoftwareComputing/Grid/WMS/glideinWMS/doc.prd/frontend/configuration.html
#8 Updated by Igor Sfiligoi over 6 years ago
OK, found the point in the docs to change... doing it now.
#9 Updated by Igor Sfiligoi over 6 years ago
- Assignee changed from Igor Sfiligoi to Parag Mhashilkar
Documentation written.
Please review.
#10 Updated by Parag Mhashilkar over 6 years ago
- Target version changed from v3_2_5 to v3_2_4
#11 Updated by Parag Mhashilkar over 6 years ago
Progress so far - sent feedback to Igor separately.
#12 Updated by Parag Mhashilkar over 6 years ago
- Status changed from Feedback to Closed
- Assignee changed from Parag Mhashilkar to Igor Sfiligoi
Merged it back to branch_v3_2 after changes from Igor.