a Held -> Completed transition is a lie, it should be Removed.
So we need to fix that in bulk_update, or in the agent.
#1 Updated by Marc Mengel almost 3 years ago
- % Done changed from 0 to 70
So attempting this in the jobsub_q_scraper; we now keep a
last_known_status[jobsub_job_id], and if it is "Held" when
we don't see the job anymore, we mark it "Removed" not "Completed"
Now to actually test it on fermicloud045...
#2 Updated by Marc Mengel almost 3 years ago
So This seems to have worked to the first order -- we went from Held to Removed rather than Completed ... but then the thing switched us over to Located when it moved the Task to Located. I'm thinking this was the wrong approach -- we shouldn't drag all the jobs to Located when the Task/Submission completes -- we have a percentage, so we should let the individual Jobs go Located as appropriate, and the Removed ones should stay Removed -- unless we really do see their output files get declared... Nevermind, we actually did do that in 38575928, I just see the Located transition in my test jobs becuase I'm re-running the same files, and their output is already declared :-).