Project

General

Profile

Bug #17638

deadlock errors in logs

Added by Marc Mengel about 3 years ago. Updated about 3 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Target version:
Start date:
09/05/2017
Due date:
% Done:

100%

Estimated time:
First Occurred:
Scope:
Internal
Experiment:
-
Stakeholders:
Duration:

Description

Over the weekend we got a lot of deadlock errors in bulk_update, with Nova's 30k jobs queued.

History

#1 Updated by Marc Mengel about 3 years ago

Several attempts at fixing over the weekend; the theory is that the Task locks ought to
be blocking attempts to modify the Jobs and downhill in that task; but we were still getting
deadlock errors updating the jobs. So added locks to the Jobs themselves, too, ordered by
jobsub_job_id, (because the updates otherwise happen in random order...) turned all the locks up to full row locks (turned off the read = True...)

Seems to have cleared up, but then again the load has dropped...

b0798642
de6baed9
b145c872
476d7538

#2 Updated by Marc Mengel about 3 years ago

  • Status changed from New to Resolved
  • Target version set to v2_1_1

There have been no deadlock errors in the last few days.

#3 Updated by Anna Mazzacane about 3 years ago

  • Target version changed from v2_1_1 to v2_2_1

#4 Updated by Anna Mazzacane about 3 years ago

  • % Done changed from 0 to 100

#5 Updated by Anna Mazzacane about 3 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF