Project

General

Profile

Bug #19338

declared_files_agent is starving...

Added by Marc Mengel over 2 years ago. Updated over 2 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
Target version:
Start date:
03/07/2018
Due date:
% Done:

100%

Estimated time:
First Occurred:
Scope:
Internal
Experiment:
-
Stakeholders:
Duration:

Description

Two problems:

  1. declared_files_agent isn't getting lists of files/jobs from poms webservice 'cause it's timing out
  2. checks against e.g. nova to see if they're declared aren't working

Marking this urgent because this can break workflows that rely on jobs/tasks going Located properly.

History

#1 Updated by Marc Mengel over 2 years ago

already worked on this quite a bit the last two days; should have put it in the tracker already.

#2 Updated by Marc Mengel over 2 years ago

Okay, so reworked this several times.

Back to a simpler query, with a limit/offset so that if we have lots of backlogged files we deliver N at a time, and move the offset up; then we roll it back around.

Looks like the agent can find declared files; I just was seeing it rarely enough that I missed it in the logs...

#3 Updated by Marc Mengel over 2 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

#4 Updated by Anna Mazzacane over 2 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF