Project

General

Profile

Project py surround

So we have at least 3 similar suites:

name package format job-wrap language
project.py larbatch xml condor_lar.sh bash
submit_nova_art.py NovaGridUtils ini art_sam_wrap.sh bash
fife_launch fife_utils ini fife_wrap python

project.py supports a whole set of non-SAM, directory-based bookkeping
workflows, and support for combining configs for multiple stages of
a workflow into one config file.

Easiest low-hanging fruit is unifying the job-wrap scripts in the
backend.

Might be worthwhile expanding fife_launch to subsume the other two.

Repository URLs:

https://cdcvs.fnal.gov/redmine/projects/larbatch/repository
https://cdcvs.fnal.gov/redmine/projects/novaart/repository/show/trunk/NovaGridUtils/bin
https://cdcvs.fnal.gov/redmine/projects/fife_utils/repository/
(fife_wrap is under "libexec")

project.py:

  • submit jobs for stage
  • makeup (recovery) launch for stage
  • post-submit
    • fetchlog
    • status of stages
    • clean[_one]
    • check results for stage (separate checkana?)
    • audit
  • sam
    • declare (ana)
    • add_locations (ana)
    • clean_locations (ana)
    • define/unefine (ana)