Project

General

Profile

jobsub_fetchlog

Return a compressed archive which contains all the condor logs stderr and stdout from the job:

$ jobsub_fetchlog -h
Usage: jobsub_fetchlog [options]

Options:
  --version             show program's version number and exit
  -h, --help            show this help message and exit
  -G <Group/Experiment/Subgroup>, --group=<Group/Experiment/Subgroup>
                        Group/Experiment/Subgroup for priorities and
                        accounting
  -J <Job ID>, --job=<Job ID>, --jobid=<Job ID>
                        Job ID
  --jobsub-server=<JobSub Server>
                        Alternate location of JobSub server to use
  --timeout=<Timeout>   Timeout for the operation in sec
  --dest-dir=<Dest Dir>, --unzipdir=<Dest Dir>, --destdir=<Dest Dir>
                        Directory to automatically unarchive logs into
  --role=<VOMS Role>    VOMS Role for priorities and accounting
  --user=<user>         VOMS Role for priorities and accounting
  --archive-format=<Archive Format>
                        format for downloaded archive:"tar" 
                        (default,compressed) or "zip" 
  --partial             download only the stdout and stderr for this jobid,
                        not the entire sandbox
  --list-sandboxes, --list
                        List all available sandboxes and creation date for
                        given user/group.  If no group specified, list
                        available sandboxes for all groups.
  --debug               show debug info like server contacted, http response,
                        response time

REQUIRED arguments are: ( (--group  AND --jobid) OR (--list) ) . Please direct
questions, comments, or problems to the service desk.

$ 

Example: returning a compressed tar file of a completed job

$ jobsub_fetchlog.py -G nova --jobid 269.0@fifebatch2.fnal.gov --debug

CREDENTIALS    : {'cert': '/tmp/jobsub_x509up_u8531', 'env_key': '/tmp/jobsub_x509up_u8531', 'env_cert': '/tmp/jobsub_x509up_u8531', 'key': '/tmp/jobsub_x509up_u8531'}

SUBMIT_URL     : https://fifebatch2.fnal.gov:8443/jobsub/acctgroups/nova/jobs/269.0@fifebatch2.fnal.gov/sandbox/

Downloaded to 269.0@fifebatch2.fnal.gov.tgz
Remote Submission Processing Time: 0.239305973053 sec

Retrieving clusterid for my submitted job using --list-sandboxes

$jobsub_fetchlog  -G minerva  --list-sandboxes
JobsubJobID,            CreationDate for user dbox in Accounting Group minerva
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2207.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:45 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2202.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:16 2014
2207.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:45 2014
2199.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:08 2014
2201.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:11 2014
2202.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:16 2014
2207.0@fermicloud114.fnal.gov          Thu Oct 23 14:41:45 2014

JOBSUB SERVER CONTACTED     : https://fifebatch-dev.fnal.gov
JOBSUB SERVER RESPONDED     : UNKNOWN
JOBSUB SERVER RESPONSE CODE : 200
JOBSUB CLIENT FQDN          : novagpvm01.fnal.gov
JOBSUB CLIENT SERVICED TIME : 28/Oct/2014 16:31:06
JobsubJobID,            CreationDate for user dbox in Accounting Group minerva
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2773.0@fermicloud396.fnal.gov          Thu Oct 23 15:52:46 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2773.0@fermicloud396.fnal.gov          Thu Oct 23 15:52:46 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2773.0@fermicloud396.fnal.gov          Thu Oct 23 15:52:46 2014
2764.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:07 2014
2766.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:10 2014
2774.0@fermicloud396.fnal.gov          Thu Oct 23 14:41:45 2014
2773.0@fermicloud396.fnal.gov          Thu Oct 23 15:52:46 2014

JOBSUB SERVER CONTACTED     : https://fifebatch-dev.fnal.gov
JOBSUB SERVER RESPONDED     : UNKNOWN
JOBSUB SERVER RESPONSE CODE : 200
JOBSUB CLIENT FQDN          : novagpvm01.fnal.gov
JOBSUB CLIENT SERVICED TIME : 28/Oct/2014 16:31:06
Remote Submission Processing Time: 0.517699956894 sec