Project

General

Profile

BOSCO submission setup » History » Version 6

« Previous - Version 6/19 (diff) - Next » - Current version
Farrukh Khan, 09/20/2017 02:19 PM


BOSCO submission setup

The wiki contains step by step instructions on how to install and configure BOSCO submission from a glideinWMS factory

Terminology

Term Description
BOSCO_HOST This is the remote login node from which glideins will be submitted to the local batch queue. For example, in the instructions below BOSCO_HOST is 'cori.nersc.gov'
FACTORY_HOST This is the node where glideinWMS factory service has been installed and configured to run. For example, in the instructions below FACTORY_HOST is 'fermifactory01.fnal.gov'
FRONTEND_HOST This is the node where glideinWMS frontend service has been installed and configured to run. For example, in the instructions below FRONTEND_HOST is 'cmssrv279.fnal.gov'

Vanilla installation

  1. Log into any node from where you can SSH into BOSCO_HOST. It is strongly recommended that the architecture and operating system of the host where you set BOSCO up from is similar to the BOSCO_HOST as you may need to copy some libraries over if needed. In the instructions below, the host being used to setup BOSCO is 'lxplus030.cern.ch'.
    [fkhan@dhcp-131-225-82-129 ~]$ ssh fakhan@lxplus030.cern.ch
    Password: 
    Last login: Tue Sep 19 22:44:19 2017 from dhcp-131-225-82-129.dhcp.fnal.gov
    * ********************************************************************
    * Welcome to lxplus030.cern.ch, SLC, 6.9
    * Archive of news is available in /etc/motd-archive
    * Reminder: You have agreed to comply with the CERN computing rules
    * https://cern.ch/ComputingRules
    * Puppet environment: production, Roger state: production
    * Foreman hostgroup: lxplus/nodes/login
    * LXPLUS Public Login Service
    * ********************************************************************
    [fakhan@lxplus030 ~]$
    
  2. Take a look at the FTP server at UW Madison hosting different BOSCO versions here. Select the appropriate version to download and wget the relevant boscoinstaller.tar.gz file. For example for version 1.2.10, fetch the installer as follows:
    [fakhan@lxplus030 ~]$ wget ftp://ftp.cs.wisc.edu/condor/bosco/1.2.10/boscoinstaller.tar.gz 
    --2017-09-19 22:29:10--  ftp://ftp.cs.wisc.edu/condor/bosco/1.2.10/boscoinstaller.tar.gz
               => “boscoinstaller.tar.gz”
    Resolving ftp.cs.wisc.edu... 128.105.2.31
    Connecting to ftp.cs.wisc.edu|128.105.2.31|:21... connected.
    Logging in as anonymous ... Logged in!
    ==> SYST ... done.    ==> PWD ... done.
    ==> TYPE I ... done.  ==> CWD (1) /condor/bosco/1.2.10 ... done.
    ==> SIZE boscoinstaller.tar.gz ... 20480
    ==> PASV ... done.    ==> RETR boscoinstaller.tar.gz ... done.
    Length: 20480 (20K) (unauthoritative)
    
    100%[==================================================================================================================>] 20,480      --.-K/s   in 0.1s    
    
    2017-09-19 22:29:12 (182 KB/s) - “boscoinstaller.tar.gz” saved [20480]
    
  3. Untar the downloaded installer and run it to install BOSCO on the current machine. For example:
    [fakhan@lxplus030 ~]$ tar -xvf boscoinstaller.tar.gz 
    boscoinstaller
    
    [fakhan@lxplus030 ~]$ ./boscoinstaller 
    Downloading BOSCO from ftp://ftp.cs.wisc.edu/condor/bosco/1.2/bosco-1.2-x86_64_RedHat6.tar.gz
    Installing BOSCO in ~/bosco
    Installing Condor from /tmp/fakhan/tmpbEI905/condor-8.6.6-x86_64_RedHat6-stripped to /afs/cern.ch/user/f/fakhan/bosco
    
    Condor has been installed into:
        /afs/cern.ch/user/f/fakhan/bosco
    
    Configured condor using these configuration files:
      global: /afs/cern.ch/user/f/fakhan/bosco/etc/condor_config
      local:  /afs/cern.ch/user/f/fakhan/bosco/local.bosco/condor_config.local
    
    In order for Condor to work properly you must set your CONDOR_CONFIG
    environment variable to point to your Condor configuration file:
    /afs/cern.ch/user/f/fakhan/bosco/etc/condor_config before running Condor
    commands/daemons.
    Created a script you can source to setup your Condor environment
    variables. This command must be run each time you log in or may
    be placed in your login scripts:
       source /afs/cern.ch/user/f/fakhan/bosco/bosco_setenv
    
    Congratulations, you installed BOSCO succesfully!
    
    #

NERSC specific configuration instructions

GlideinWMS frontend configuration

GlideinWMS factory configuration