Project

General

Profile

New Developers Quick-Start

Clone the source tree from git

  • If you have "Developer" or "Manager" role on the jobsub project in redmine, clone a writable copy of the source:
[dbox@fermicloud042 demo]$ git clone ssh://p-jobsub@cdcvs.fnal.gov/cvs/projects/jobsub
Initialized empty Git repository in /home/dbox/demo/jobsub/.git/
remote: Counting objects: 10719, done.
remote: Compressing objects: 100% (9467/9467), done.
remote: Total 10719 (delta 7151), reused 641 (delta 410)
Receiving objects: 100% (10719/10719), 1.77 MiB | 698 KiB/s, done.
Resolving deltas: 100% (7151/7151), done.
[dbox@fermicloud042 demo]$ 

  • If not, clone a read-only copy:
mac-128665:$ git clone http://cdcvs.fnal.gov/projects/jobsub
Cloning into 'jobsub'...
Checking connectivity... done.
mac-128665:$

Start up a new fermicloud node

Method 1: use provided script in repository

  • create a vm using create_fermicloud_vm.sh
[dbox@fermicloud042 demo]$ cd jobsub/test/server/puppetfiles/modules/
[dbox@fermicloud042 modules]$ ./create_fermicloud_vm.sh 
Connection closed by 131.225.67.176
Waiting for fermicloud374.fnal.gov to boot up 
...VM Information
-------------------
vm name     : dbox-CLI_DynamicIP_SLF6Vanilla
vm_template : CLI_DynamicIP_SLF6Vanilla
vmid   : 42362
fqdn   : fermicloud374.fnal.gov
dn     : 
status      : up
[dbox@fermicloud042 modules]$ 

Method 2: Use web interface

  • Go to https://fermicloud.fnal.gov:8443/
  • Click on Virtual Resources
  • Click on Virtual Machines
  • Click on the green '+'
  • In the 'Create Virtual Machine' Dialog, give it a name like 'my_jobsub_server' and select template CLI_DynamicIP_SLF6Vanilla
  • Press the green 'Create' button and wait for the vm to start
  • Once the vm has progressed to the 'RUNNING' stage, take the displayed IP and convert it to a hostname to use in the next step, example
    mac-128665:~ dbox$ host 131.225.155.111
    111.155.225.131.in-addr.arpa domain name pointer fermicloud374.fnal.gov.
    

Install a jobsub server on the new fermicloud node

[dbox@fermicloud042 modules]$ ./install_jobsub_server.sh fermicloud374.fnal.gov
Notice: Building /home/dbox/demo/jobsub/test/server/puppetfiles/modules/jobsub_server for release
Module built: /home/dbox/demo/jobsub/test/server/puppetfiles/modules/jobsub_server/pkg/dbox-jobsub_server-0.0.1.tar.gz
dbox-jobsub_server-0.0.1.tar.gz                                                                   100%   20KB  20.0KB/s   00:00    
jobsub_host_puppet_apply.sh                                                                       100%  218     0.2KB/s   00:00    
Notice: Preparing to install into /etc/puppetlabs/code/environments/production/modules ...
Notice: Downloading from https://forgeapi.puppetlabs.com ...
Notice: Installing -- do not interrupt ...
/etc/puppetlabs/code/environments/production/modules
โ””โ”€โ”€ dbox-jobsub_server (v0.0.1)
Notice: Compiled catalog for fermicloud374.fnal.gov in environment production in 1.77 seconds
Notice: /Stage[main]/Jobsub_server::Packages/Yumrepo[jobsub]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[epel-release.noarch]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[osg-release.noarch]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Exec[yum-clean-all]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Packages/Exec[yum-clean-all]: Triggered 'refresh' from 1 events
Notice: /Stage[main]/Jobsub_server::Packages/Package[httpd]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[upsupdbootstrap-fnal]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[llrun]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[lcmaps-without-gsi]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[myproxy]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[uberftp]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[globus-ftp-client]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[condor]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[voms-clients-cpp]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Package[jobsub]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[fife]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[rexbatch]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[jenkins]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[dbox]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[sbaht]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[k]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[kpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[e898]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[e898pro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[hcallumi]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[hcallumipro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[accel]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[accelpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[astro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[astropro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[cdms]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[cdmspro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[hypcp]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[hypcppro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[minbn]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[minbnpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[minos]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[minospro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[mipp]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[mipppro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[numi]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[numipro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[test]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[testpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[nova]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[novapro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[auger]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[augerpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[dzero]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[dzeropro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[fermi]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[fermipro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[minerva]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[minervapro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[lbne]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[lbnepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[argoneut]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[argoneutpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[mu2e]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[mu2epro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[map]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[mappro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[icecube]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[icecubepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[uboone]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[uboonepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[gm2]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[gm2pro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[ilc]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[ilcpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[orka]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[orkapro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[seaquest]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[seaquestpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[darkside]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[darksidepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[coupp]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[coupppro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[lar1]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[lar1pro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[lariat]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[lariatpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[belle]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[bellepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[genie]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[geniepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[lsst]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[lsstpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[lar1nd]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[lar1ndpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[numix]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[numixpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[holometer]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[holometerpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[chips]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[chipspro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[marsaccel]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[marsaccelpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[annie]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[anniepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[dune]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[dunepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[gendetrd]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[gendetrdpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[cdf]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[cdfpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[captmnv]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[captmnvpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[redtop]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[redtoppro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[sbnd]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[sbndpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[next]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[nextpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[noble]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[noblepro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[icarus]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[icaruspro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[des]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[despro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/Group[admx]/ensure: created
Notice: /Stage[main]/Jobsub_server::Users/User[admxpro]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/Exec[setupCA]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Files/Exec[makebasedir]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Files/Exec[/etc/grid-security/jobsub]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Files/Exec[jobsub_cert]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Files/Exec[jobsub_key]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/proxies]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/uploads]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/history]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/history/work]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/history/work/create_jobsub_history_db.sql]/ensure: defined content as '{md5}d00dfc2bb9d0fe4cf175ad9300430449'
Notice: /Stage[main]/Jobsub_server::Files/Exec[create_jobsub_history_db]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/history/jobsub_history.db]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/history/jobsub_history.db]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub/tmp]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub/creds]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub/creds/certs]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub/creds/keytabs]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub/creds/krb5cc]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/lib/jobsub/creds/proxies]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/dropbox]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/fife/local/scratch/uploads/job.log]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[jobsublogsdir]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/var/log/jobsub]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File_line[allow_proxy_certs]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File_line[sudoers]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/home/rexbatch/.k5login]/ensure: defined content as '{md5}d157864bf7c11d78e4c1006fa86c41b3'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/sysconfig/iptables]/content: content changed '{md5}9ed907566cccb6a43960b415b6d93702' to '{md5}deffbe244012d8820b51e4791269d472'
Notice: /Stage[main]/Jobsub_server::Files/File[/home/rexbatch/.security]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/home/rexbatch/sync_cmd]/ensure: defined content as '{md5}07498adb710ff0887d40c033d4f4af57'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/condor/config.d/99.local.config]/ensure: defined content as '{md5}eb2fd2faac8f3cba12a484cb159a28bf'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/conf/jobsub.ini]/content: content changed '{md5}8f41a06d3d47b59803808e67e5327953' to '{md5}c875b8bf7c687a968c554517d5d503ec'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/conf/jobsub.ini]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/conf/jobsub.ini]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/var/www/html/cigetcertopts.txt]/ensure: defined content as '{md5}50952893d83d76e33ce32e41dacb9311'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/httpd/conf.d/ssl.conf]/content: content changed '{md5}3de26dd8577cd28b9b1ebf0c6afde42a' to '{md5}da8f859718ecf1c41d4cf6b72441c8e1'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/httpd/conf.d/ssl.conf]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/httpd/conf.d/ssl.conf]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/conf/jobsub_api.conf]/content: content changed '{md5}da4d9934e2c85e580344b0b17103de66' to '{md5}27535ce1704fc81470d9e331502f8bdd'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/conf/jobsub_api.conf]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/conf/jobsub_api.conf]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/httpd/conf.d/jobsub_api.conf]/ensure: ensure changed 'file' to 'link'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/lcmaps.db]/content: content changed '{md5}fd147d5065a354a488bd9b882d02b34b' to '{md5}a1ad17be052da85d84b2b678db90f953'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/grid-security/jobsub]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/grid-security/jobsub]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/grid-security/jobsub/jobsubcert.pem]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/grid-security/jobsub/jobsubcert.pem]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/grid-security/jobsub/jobsubkey.pem]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/grid-security/jobsub/jobsubkey.pem]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/admin/krbrefresh.sh]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/admin/krbrefresh.sh]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/admin/krbrefresh.sh]/mode: mode changed '0755' to '0744'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/admin/jobsub_preen.sh]/owner: owner changed 'root' to 'rexbatch'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/admin/jobsub_preen.sh]/group: group changed 'root' to 'fife'
Notice: /Stage[main]/Jobsub_server::Files/File[/opt/jobsub/server/admin/jobsub_preen.sh]/mode: mode changed '0755' to '0744'
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/lcmaps]/ensure: created
Notice: /Stage[main]/Jobsub_server::Files/File[/etc/lcmaps/lcmaps.db]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Service[httpd]/ensure: ensure changed 'stopped' to 'running'
Notice: /Stage[main]/Jobsub_server::Services/Service[condor]/ensure: ensure changed 'stopped' to 'running'
Notice: /Stage[main]/Jobsub_server::Services/Service[iptables]: Triggered 'refresh' from 1 events
Notice: /Stage[main]/Jobsub_server::Services/Cron[Refresh the kerberos proxies of users in queue that have kerberos principal older than 3600 seconds (default)]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Cron[Copy jobs out of condor history file into jobsub_history database]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Cron[clean jobs out of jobsub_history database older than 30 days]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Cron[Cleanup files for jobs that were last modified 30 days ago, logs to LOG_DIR/jobsub_preen.log]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Cron[clean the dropbox directories of old jobs]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Cron[clean /var/lib/jobsub/tmp of leftover files from failed authentications]/ensure: created
Notice: /Stage[main]/Jobsub_server::Services/Cron[clean /var/lib/jobsub/creds/proxies of expired proxies and cruft from failed authentications]/ensure: created
Notice: /Stage[main]/Jobsub_server::Packages/Jobsub_server::Ups::Product[ups]/Exec[install_ups]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Packages/Jobsub_server::Ups::Product[ups]/Exec[make_current_ups]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Packages/Jobsub_server::Ups::Product[ifdhc]/Exec[install_ifdhc]/returns: executed successfully
Notice: /Stage[main]/Jobsub_server::Packages/Jobsub_server::Ups::Product[ifdhc]/Exec[make_current_ifdhc]/returns: executed successfully
Notice: Applied catalog in 94.77 seconds
/usr/bin/xauth:  file /home/rexbatch/.Xauthority does not exist
[dbox@fermicloud042 modules]$ 

Verify that the server is installed correctly by running an integration test

[dbox@fermicloud042 modules]$ cd ../../../client/
[dbox@fermicloud042 client]$ ./integration_test.sh fermicloud374.fnal.gov
test a verbose job to test output file truncation
successfully submitted job 1.0@fermicloud374.fnal.gov
PASSED
test simple submission
successfully submitted job 2.0@fermicloud374.fnal.gov 3.0@fermicloud374.fnal.gov
PASSED
testing holding and releasing nova jobs owned by dbox
PASSED
testing holding and releasing
PASSED
test submission with role
PASSED successfully submitted job 4.0@fermicloud374.fnal.gov 5.0@fermicloud374.fnal.gov
PASSED
testing holding and releasing with role
PASSED
testing holding and releasing nova jobs owned by novapro
PASSED
testing dag submission

[...... ]

Debugging: log, config, and other files

  • log files are in /var/log/jobsub and /var/log/httpd
    • /var/log/jobsub/debug.log is usually where you start
    • /var/log/httpd/error_log and
    • /var/log/httpd/ssl_error_log sometimes help with authentication problems
  • config files
    • /opt/jobsub/server/conf/jobsub.ini
    • /opt/jobsub/server/conf/jobsub_api.conf -> soft linked to /etc/httpd/conf.d/jobsub_api.conf
    • htcondor config files: condor_config_val -config from the command line