deadlock errors in logs
Over the weekend we got a lot of deadlock errors in bulk_update, with Nova's 30k jobs queued.
#1 Updated by Marc Mengel about 3 years ago
Several attempts at fixing over the weekend; the theory is that the Task locks ought to
be blocking attempts to modify the Jobs and downhill in that task; but we were still getting
deadlock errors updating the jobs. So added locks to the Jobs themselves, too, ordered by
jobsub_job_id, (because the updates otherwise happen in random order...) turned all the locks up to full row locks (turned off the read = True...)
Seems to have cleared up, but then again the load has dropped...