Project

General

Profile

Feature #17067

Confirm that factory can start 1500 entries at a time without issues

Added by Parag Mhashilkar over 2 years ago. Updated about 2 years ago.

Status:
Closed
Priority:
High
Assignee:
Category:
-
Target version:
Start date:
06/29/2017
Due date:
% Done:

0%

Estimated time:
Stakeholders:

OSG, CMS

Duration:

Description

This was raised during June 28, 2017 stakeholders meeting. Factory should be able to start without issues even with 1500 entries.
These higher number of entries is going to expose other scaling issues, like slow submission, slow matching in frontend etc. which should be addressed as different tickets in future.

History

#1 Updated by Dennis Box over 2 years ago

  • Status changed from New to Assigned

I was able to run a factory yesterday with 3000 entries (after making the appropriate adjustments to /etc/limits.conf). My submitted jobs never started though so I need to figure out why.

#2 Updated by Dennis Box over 2 years ago

  • Status changed from Assigned to Feedback
  • Assignee changed from Dennis Box to Marco Mambelli

I was able to submit jobs and get them to run on a factory with the modifications in branch v3/17067. My speed tests showed that epoll() was faster than select() under any conditions, and poll() was faster than select under many conditions. Epoll is only implemented for linux, poll() exists for most but not all, so I coded it to try epoll, fail over to poll, then fail over to select even though we only run it on linux as far as I know.

#3 Updated by Marco Mambelli over 2 years ago

  • Assignee changed from Marco Mambelli to Dennis Box

#4 Updated by Dennis Box over 2 years ago

  • Status changed from Feedback to Resolved

tested after feedback changes, merged to branch_v3_2.

#5 Updated by Marco Mambelli about 2 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF