Project

General

Profile

Roadmap

v1.3

15 days late (06/04/2019)

JobSub v1.3

30%

20 issues   (3 closed — 17 open)

Related issues
Bug #16072: Unable to fetch logs owned by experiment production accounts, even with a valid Production proxy
Bug #16603: test server on SL7
Bug #19536: jobsub_fetchlog doesn't allow to download logs for Production jobs using a different Production proxy
Bug #19547: On worker nodes jobs get not valid production proxy
Bug #20289: understand timeout/empty reply from server for dag submission
Bug #20988: For proxy created by using the kcron principle jobsub_client believes it is not valid too early
Bug #21031: jobsub_submit allows more than one --group argument
Bug #22039: improper proxy/role handling in util.py
Bug #22151: --blacklist option doesn't block sites like it's supposed to do
Bug #22174: admin scripts should ignore commented lines in config files
Bug #22178: Review request [commit:b92ca687b7b0e5ff4c506cb13f4da1d81978cbda: If --site or --blacklist are specified in the command line, don't run if the slot's GLIDEIN_Site is undefined]
Bug #22399: change in behavior for (some) clients after jobsub server updated hostcerts
Bug #22428: setup curl dependency in jobsub_client ups file
Bug #22481: misleading documentation and error response from --tar_file_name
Feature #13853: Access to condor_prio features
Feature #20167: Assign user priority to clusters for jobsub project
Feature #21409: incorporate cvmfs rapid code distribution into jobsub submission
Feature #22099: jobsub constraint commands should respect --group even if --constraint doesn't include it: INCLUDING GLOBAL SUPERUSERS
Feature #22164: Upgrade jobsub code to use argparse instead of optparse

v1.3.1

Due in 13 days (07/02/2019)

Jobsub v1.3.1

5%

22 issues   (1 closed — 21 open)

Related issues
Bug #7399: Validate the values of some of the important jobsub_submit options
Bug #12023: jobsub_fetchlog --jobid 888.33 --partial behavior not quite right
Bug #13785: mixing -f and --tar_file_name problems
Bug #13841: shibboleth/sso authentication
Bug #21655: SAM job pre-staging will not work with newer SAM stations
Bug #21831: improve error message when schedd too busy to respond to jobsub_rm
Bug #22242: 'jobsub_submit --line +x=y --dataset z' does not set 'x' on dagman job.
Bug #22408: Jobsub_submit_dag saves multiple copies of files in payload.tgz
Feature #10265: Support -format in jobsub_q
Feature #10814: Additional ifdh log information from jobsub_wrapper
Feature #15257: Provide option to retry or wait for job submission to succeed
Feature #17357: make configurable default sites for groups/roles
Feature #17923: We should add -e IFDH_CP_MAXRETRIES=3 or so on jobs with --expected-lifetime=short
Feature #22347: When we create tarfiles, compress them in place rather than making a tempfile and compressing it
Feature #22417: Remove dependancy on OSG CA certs from Jobsub client
Feature #22614: Review request [commit:60be0f3e88a2bfb631c419b44eb12e4afd54ae3f: Changed error message for too many CN strings to address Managed Proxies case]
Idea #19212: Generic --job-requires comma-separated-list for users
Idea #20498: Refactor jobsub_drobpox_cleanup tool to keep config info as high level as possible
Idea #20970: Add metrics and log collection to jobsub server
Necessary Maintenance #22433: replace pycurl with request library in client

v1.3.2

Due in 48 days (08/06/2019)

Jobsub v1.3.2

6%

17 issues   (0 closed — 17 open)

Related issues
Bug #6243: JobSub rpm(s) do not confer to standards
Bug #8430: errors with python3
Bug #10818: still need a test queue
Bug #11709: jobsub eats "
Bug #21448: maxIdle and maxRunning for DAGS should have configurable defaults
Feature #6552: jobsub_fetchlog should extract the logs without creating intermediate tar file
Feature #6839: Pass arguments from jobsub_* to condor
Feature #7313: Support regex in jobids for certain client commands
Feature #9054: Simplify the specification of usage model
Feature #10903: Would like condor_ssh_to_job functionality
Feature #12598: Teach dagman to ignore exit statuses of jobs
Feature #14195: Add support for condor_qedit-like functionality
Feature #16758: Option to report resident memory usage in jobsub_q
Feature #20165: generate job description language to implement periodic releases
Feature #20477: Move IFDH commands into config file
Feature #22100: Sanitize constraints before passing them to condor
Idea #7888: Job start staggering to reduce instaneous resource demand

v1.3.3

Due in about 3 months (09/03/2019)

jobsub v1.3.3

8%

13 issues   (1 closed — 12 open)

Related issues
Feature #6644: Support dynamic connection lifetime between client and the server
Feature #7305: jobsub_client retry logic
Feature #9058: Tracking who submitted job with role=Production
Feature #11414: Option to provide alias to display for job in jobsub_q instead of command
Feature #12037: Decouple the jobsub server from the condor schedd
Feature #12260: Include ProjectName in submitted jobs
Feature #13847: POMS support
Feature #16631: Modification to job requirements string wrt usage model matching
Feature #19791: Implement a retry policy in Condor to allow jobs that go held for excess memory usage to have their memory increased and released
Feature #20166: Option to report resident memory usage in jobsub_q
Feature #20195: Take out viper config from subpackages for jobsub_dropbox_cleanup tool
Feature #22241: Add whitelist
Idea #17326: RFC: give jobsub_release the ability to adjust job resource requests if needed

v1.3.4

Due in about 4 months (10/08/2019)

Jobsub v1.3.4

0%

10 issues   (0 closed — 10 open)

Related issues
Bug #13269: Minor annoyances with --dataset DAGs...
Bug #20662: Failures when one collector is down
Feature #5906: Support condor_tail equivalent functionality in jobsub
Feature #6342: Allow extra stage(s) in DAG for --dataset_definition
Feature #7283: options should be additive
Feature #7642: jobsub_fetchlog should not ask for --group
Feature #7841: Mechanism to specify different environment variables for multiple jobs in one cluster
Feature #8164: Change auth.py to plugin based architecture
Feature #18984: Consider merging jobsub_submit and it's wrapper script with fife_launch fife_wrap
Idea #22383: Change superuser behavior to not need VOMS authentication