Incorporate functionality of cdfcaf into JobSub
Run2 - CDF
Support for CDF CAF is growing thin and the functionality needs to be supported in case some one needs to analyze the CDF data in future. Some of the functionality provided by CDF CAF is same as JobSub. We need to identify the missing functionality and map common functionality to that provided in JobSub. Bo from CDF will help with testing and integration with CDF scripts. Current plan is to port the missing functionality to JobSub and Bo/Joe (?) would modify the the cdf caf submit to can JobSub internally.
#1 Updated by Parag Mhashilkar over 6 years ago
- Due date set to 05/30/2014
Meeting notes from March 07, 2014. Related tasks should be in there own ticket.
Present: Dennis Box, Parag Mhashilkar, Tanya Levshina, Joe Boyd, Mike Kirby, Stephan Lammel
(M) = Mandatory
(P) = Preferred
(N) = Not Required
(*) = higher in each category
--tarFile(M): Input to the job. This needs to be extracted before executing the job. Jobsub supports it or can be made to change.
--outLocation(P): Tar ed up output directory. --depot in jobsub? If output is bigger than certain amount then only dirs are shipped back.
Need to come back to this one later for implementation details and available info
--procType (M): Is job long or short. We need to support in jobsub
--start, --end, --section (M): This is to user's job and for section and dag generation.
--dhaccess(N): How to handle the data handling.
--maxParallelSection(R): Run upto this dag nodes at a time.
--email(P*): Email for job notification. Needs to be passed by wrapper
--farm(N): JobSub equivalent --jobsub-server
--group(R): Already there in JobSub
--os: Already supported in JobSub
--cdfsoft: Moot with with cvmfs
--site: Already supported in Jobsub
experiment wrapper : CAFExe or equivalent wrapper provided by JobSub
#6 Updated by Parag Mhashilkar about 6 years ago
|Pass Kerberos ticket securely||#6541||High Priority|
|Concurrency limit||#6657||High Priority|
|experiment wrapper||No Ticket. CAFExe or equivalent wrapper provided by JobSub||High Priority|
|--procType (M)||No ticket -- Not required||Very low priority|
|--start, --end, --section (M)||#6697||Low priority|
|--maxParallelSection(M)||#6657||This is required when we start supporting DAGs|