JobSub

I was tasked last week with counting all the usage of input parameters to jobsub_submit to get a handle on whether a jobsub-lite project would save effort.

Playing around with lens is fun, there is a lot of potential here. I was not getting to the information I needed quickly enough, so I did a quick-and-dirty massage of the submit_logs through sed, python, and count.

cat jobsub0*/submit.log* | sed -f sed.for.submit.log | python count.py | sort -n > submit.opt.count

There were 1376577 individual submissions, the 20 most popular input flags are shown below.
I will attach the full submit.opt.count file to this ticket.

mac-128665:jobsub_command_flag_census dbox$ tail -21 submit.opt.count
210513 : --disk
212753 : --use_gftp
257765 : --subgroup
352780 : --append_condor_requirements
372912 : -N
415704 : --role
428980 : -r
429257 : --cmtconfig
429287 : -i
445524 : -L
494760 : -append
848968 : --expected-lifetime
900078 : --memory
1126495 : -d
1215834 : --resource-provides
1230895 : --OS
1376325 : --group
1769958 : -f
2441749 : -e
2845801 : -l
9223372036854775807 number of submits analyzed: 1376577