Project

General

Profile

Bug #16699

jobs not showing up completed(?)

Added by Marc Mengel over 2 years ago. Updated over 2 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Target version:
Start date:
05/27/2017
Due date:
% Done:

100%

Estimated time:
First Occurred:
Scope:
Internal
Experiment:
-
Stakeholders:
Duration:

Description

Bulk update & jobsub_q_scraper? Weiredness with one of the condor_q servers?

History

#1 Updated by Marc Mengel over 2 years ago

So some jobs weren't showing up completed -- may have been a condor issue, 'cause now jobs are completing...

but I have a job showing up completeted but not located, but all of its files have locations... But nothing is showing up in pending...

JOb id 170 has one output file Output File Names

genfa9fff96-99b8-4a97-a0a7-6fb2612f1b46-e20393434.root

which got through the FTS and is declared with a location... But it does not show up as being declared in the jobs_files table. It should then be showing up in the output_pending_files list for the declared_files_watcher to flag, but it isn't...
pomsdev=> select * from job_files where job_id=170;
job_id | file_name | file_type | created | declared
--------+--------------------------------------------------------+-----------+-------------------------------+-------------------------------
170 | fake_eventgen.exe | input | 2017-05-26 22:36:28.785367-05 |
170 | fa9fff96-99b8-4a97-a0a7-6fb2612f1b46-e.fcl | input | 2017-05-26 22:36:31.453856-05 |
170 | genfa9fff96-99b8-4a97-a0a7-6fb2612f1b46-e20393434.root | output | 2017-05-26 22:41:00.735067-05 | 2017-05-27 08:17:52.901196-05
(3 rows)

Acck! I take it back. It is declared. So all its output files are declared..but its output_files_declared flag is "f".

#2 Updated by Marc Mengel over 2 years ago

So short answer, job should still show up as pending 'cause outut files declared isn't on, even if all its files are declared, 'cause the agent is
the one who currently concludes they should be marked -- right? Or whatever udpates the file to say its declared needs to update the job.

#3 Updated by Marc Mengel over 2 years ago

  • Status changed from New to Resolved

Combinatino of job updates being lost and flag jobs not being reported in output_pending_jobs.

#4 Updated by Marc Mengel over 2 years ago

  • % Done changed from 0 to 100

#5 Updated by Marc Mengel over 2 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF