Project

General

Profile

Support #5692

Frontend should advertise requests in parallel

Added by Igor Sfiligoi over 5 years ago. Updated over 5 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Igor Sfiligoi
Category:
Frontend
Target version:
Start date:
03/18/2014
Due date:
% Done:

0%

Estimated time:
Stakeholders:

CMS

Duration:

Description

The frontend currently advertizes all the requests in a serial mode,
i.e. one factory after the other.
This results in very long advertize times.

Since all of those services are independent, it would make more sense doing it in parallel.


Related issues

Related to GlideinWMS - Support #5691: Frontend should run queries in parallelClosed03/18/2014

History

#1 Updated by Igor Sfiligoi over 5 years ago

  • Stakeholders updated (diff)

This is currently biting CMS AnaOps.
It takes up to 8 minutes to advertise all the requests to the 3 factories.

#2 Updated by Igor Sfiligoi over 5 years ago

I also noticed that the global and request classads are advertised in two different transactions.
This adds unnecessary load to the factory collector when the FE admin stated it wants to use the multiple updates protocol.

Will fix that too as part of this ticket.

#3 Updated by Igor Sfiligoi over 5 years ago

  • Status changed from New to Feedback
  • Assignee changed from Igor Sfiligoi to Parag Mhashilkar

I have implemented the change, and put it in v3/5692.

Had to slightly extend the glideinFrontendInterface.MultiAdvertizeWork in the process.
Not fully backwards compatible, since it now requires explicit loading of the credentials.

#4 Updated by Parag Mhashilkar over 5 years ago

  • Assignee changed from Parag Mhashilkar to Igor Sfiligoi
  • Target version changed from v3_2_5 to v3_2_4

Reviewed. Ok to merge. Bumping it to 3.2.4

#5 Updated by Igor Sfiligoi over 5 years ago

  • Assignee changed from Igor Sfiligoi to Parag Mhashilkar

Turns out some of the code changes in glideinFrontendInterface conflict with #5239.

I have done the straight conflict resolution that I believe will work,
but there may be other places where things need to change.
I am re-assigning to Parag, since he understands better what changed in #5239.

The merged code is in
v3/5692_v2

#6 Updated by Parag Mhashilkar over 5 years ago

  • Assignee changed from Parag Mhashilkar to Igor Sfiligoi

After your conflict resolution, there was a bug because of the changes to the Credentials class.

I think my latest changes in v3/5692_v2 take care of the merge conflicts in proper way. Let me know by tomorrow if you find something strange. If not I will merge it to branch_v3_2

#7 Updated by Parag Mhashilkar over 5 years ago

  • Status changed from Feedback to Closed

Merged v3/5692_v2 to branch_v3_2



Also available in: Atom PDF