Project

General

Profile

Idea #23558

count of usage by input option for jobsub_submit from 4/11/19 to 11/5/19

Added by Dennis Box about 1 month ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
11/06/2019
Due date:
% Done:

0%

Estimated time:
Stakeholders:
Duration:

Description

I was tasked last week with counting all the usage of input parameters to jobsub_submit to get a handle on whether a jobsub-lite project would save effort.

Playing around with lens is fun, there is a lot of potential here. I was not getting to the information I needed quickly enough, so I did a quick-and-dirty massage of the submit_logs through sed, python, and count.

cat jobsub0*/submit.log* | sed -f sed.for.submit.log | python count.py | sort -n > submit.opt.count

There were 1376577 individual submissions, the 20 most popular input flags are shown below.
I will attach the full submit.opt.count file to this ticket.

mac-128665:jobsub_command_flag_census dbox$ tail -21 submit.opt.count
210513 : --disk
212753 : --use_gftp
257765 : --subgroup
352780 : --append_condor_requirements
372912 : -N
415704 : --role
428980 : -r
429257 : --cmtconfig
429287 : -i
445524 : -L
494760 : -append
848968 : --expected-lifetime
900078 : --memory
1126495 : -d
1215834 : --resource-provides
1230895 : --OS
1376325 : --group
1769958 : -f
2441749 : -e
2845801 : -l
9223372036854775807 number of submits analyzed: 1376577

submit.opt.count (3.24 KB) submit.opt.count Dennis Box, 11/06/2019 12:19 PM
sed.for.submit.log (150 Bytes) sed.for.submit.log Dennis Box, 11/06/2019 12:19 PM
count.py (513 Bytes) count.py Dennis Box, 11/06/2019 12:19 PM


Also available in: Atom PDF