Idea #23558
count of usage by input option for jobsub_submit from 4/11/19 to 11/5/19
0%
Description
I was tasked last week with counting all the usage of input parameters to jobsub_submit to get a handle on whether a jobsub-lite project would save effort.
Playing around with lens is fun, there is a lot of potential here. I was not getting to the information I needed quickly enough, so I did a quick-and-dirty massage of the submit_logs through sed, python, and count.
cat jobsub0*/submit.log* | sed -f sed.for.submit.log | python count.py | sort -n > submit.opt.count
There were 1376577 individual submissions, the 20 most popular input flags are shown below.
I will attach the full submit.opt.count file to this ticket.
mac-128665:jobsub_command_flag_census dbox$ tail -21 submit.opt.count
210513 : --disk
212753 : --use_gftp
257765 : --subgroup
352780 : --append_condor_requirements
372912 : -N
415704 : --role
428980 : -r
429257 : --cmtconfig
429287 : -i
445524 : -L
494760 : -append
848968 : --expected-lifetime
900078 : --memory
1126495 : -d
1215834 : --resource-provides
1230895 : --OS
1376325 : --group
1769958 : -f
2441749 : -e
2845801 : -l
9223372036854775807 number of submits analyzed: 1376577
History
#1 Updated by Dennis Box about 1 year ago
- File count.py count.py added
- File sed.for.submit.log sed.for.submit.log added
- File submit.opt.count submit.opt.count added
#2 Updated by Dennis Box about 1 year ago
- Target version set to v1.3.2
#3 Updated by Dennis Box 11 months ago
- Target version changed from v1.3.2 to v1.4
- Status changed from New to Closed