Project

General

Profile

BOSCO submission setup » History » Version 6

Farrukh Khan, 09/20/2017 02:19 PM

1 1 Farrukh Khan
h1. BOSCO submission setup
2 2 Farrukh Khan
3 2 Farrukh Khan
The wiki contains step by step instructions on how to install and configure BOSCO submission from a glideinWMS factory
4 2 Farrukh Khan
5 2 Farrukh Khan
{{toc}}
6 2 Farrukh Khan
7 3 Farrukh Khan
h2. Terminology
8 3 Farrukh Khan
9 3 Farrukh Khan
| *Term* | *Description* |
10 3 Farrukh Khan
| BOSCO_HOST | This is the remote login node from which glideins will be submitted to the local batch queue. For example, in the instructions below BOSCO_HOST is 'cori.nersc.gov' |
11 3 Farrukh Khan
| FACTORY_HOST | This is the node where glideinWMS factory service has been installed and configured to run. For example, in the instructions below FACTORY_HOST is 'fermifactory01.fnal.gov' |
12 3 Farrukh Khan
| FRONTEND_HOST | This is the node where glideinWMS frontend service has been installed and configured to run. For example, in the instructions below FRONTEND_HOST is 'cmssrv279.fnal.gov' |
13 3 Farrukh Khan
14 2 Farrukh Khan
h2. Vanilla installation
15 1 Farrukh Khan
16 6 Farrukh Khan
# Log into any node from where you can SSH into BOSCO_HOST. It is strongly recommended that the architecture and operating system of the host where you set BOSCO up from is similar to the BOSCO_HOST as you may need to copy some libraries over if needed. In the instructions below, the host being used to setup BOSCO is 'lxplus030.cern.ch'. <pre>
17 4 Farrukh Khan
[fkhan@dhcp-131-225-82-129 ~]$ ssh fakhan@lxplus030.cern.ch
18 4 Farrukh Khan
Password: 
19 4 Farrukh Khan
Last login: Tue Sep 19 22:44:19 2017 from dhcp-131-225-82-129.dhcp.fnal.gov
20 4 Farrukh Khan
* ********************************************************************
21 4 Farrukh Khan
* Welcome to lxplus030.cern.ch, SLC, 6.9
22 4 Farrukh Khan
* Archive of news is available in /etc/motd-archive
23 4 Farrukh Khan
* Reminder: You have agreed to comply with the CERN computing rules
24 4 Farrukh Khan
* https://cern.ch/ComputingRules
25 4 Farrukh Khan
* Puppet environment: production, Roger state: production
26 4 Farrukh Khan
* Foreman hostgroup: lxplus/nodes/login
27 4 Farrukh Khan
* LXPLUS Public Login Service
28 4 Farrukh Khan
* ********************************************************************
29 1 Farrukh Khan
[fakhan@lxplus030 ~]$
30 5 Farrukh Khan
</pre>
31 6 Farrukh Khan
# Take a look at the FTP server at UW Madison hosting different BOSCO versions "here":ftp://ftp.cs.wisc.edu/condor/bosco/. Select the appropriate version to download and wget the relevant boscoinstaller.tar.gz file. For example for version 1.2.10, fetch the installer as follows:<pre>
32 5 Farrukh Khan
[fakhan@lxplus030 ~]$ wget ftp://ftp.cs.wisc.edu/condor/bosco/1.2.10/boscoinstaller.tar.gz 
33 5 Farrukh Khan
--2017-09-19 22:29:10--  ftp://ftp.cs.wisc.edu/condor/bosco/1.2.10/boscoinstaller.tar.gz
34 5 Farrukh Khan
           => “boscoinstaller.tar.gz”
35 5 Farrukh Khan
Resolving ftp.cs.wisc.edu... 128.105.2.31
36 5 Farrukh Khan
Connecting to ftp.cs.wisc.edu|128.105.2.31|:21... connected.
37 5 Farrukh Khan
Logging in as anonymous ... Logged in!
38 5 Farrukh Khan
==> SYST ... done.    ==> PWD ... done.
39 5 Farrukh Khan
==> TYPE I ... done.  ==> CWD (1) /condor/bosco/1.2.10 ... done.
40 5 Farrukh Khan
==> SIZE boscoinstaller.tar.gz ... 20480
41 5 Farrukh Khan
==> PASV ... done.    ==> RETR boscoinstaller.tar.gz ... done.
42 1 Farrukh Khan
Length: 20480 (20K) (unauthoritative)
43 5 Farrukh Khan
44 5 Farrukh Khan
100%[==================================================================================================================>] 20,480      --.-K/s   in 0.1s    
45 5 Farrukh Khan
46 5 Farrukh Khan
2017-09-19 22:29:12 (182 KB/s) - “boscoinstaller.tar.gz” saved [20480]
47 5 Farrukh Khan
</pre>
48 6 Farrukh Khan
# Untar the downloaded installer and run it to install BOSCO on the current machine. For example:<pre>
49 5 Farrukh Khan
[fakhan@lxplus030 ~]$ tar -xvf boscoinstaller.tar.gz 
50 5 Farrukh Khan
boscoinstaller
51 5 Farrukh Khan
52 5 Farrukh Khan
[fakhan@lxplus030 ~]$ ./boscoinstaller 
53 5 Farrukh Khan
Downloading BOSCO from ftp://ftp.cs.wisc.edu/condor/bosco/1.2/bosco-1.2-x86_64_RedHat6.tar.gz
54 5 Farrukh Khan
Installing BOSCO in ~/bosco
55 5 Farrukh Khan
Installing Condor from /tmp/fakhan/tmpbEI905/condor-8.6.6-x86_64_RedHat6-stripped to /afs/cern.ch/user/f/fakhan/bosco
56 5 Farrukh Khan
57 5 Farrukh Khan
Condor has been installed into:
58 5 Farrukh Khan
    /afs/cern.ch/user/f/fakhan/bosco
59 5 Farrukh Khan
60 5 Farrukh Khan
Configured condor using these configuration files:
61 5 Farrukh Khan
  global: /afs/cern.ch/user/f/fakhan/bosco/etc/condor_config
62 5 Farrukh Khan
  local:  /afs/cern.ch/user/f/fakhan/bosco/local.bosco/condor_config.local
63 5 Farrukh Khan
64 5 Farrukh Khan
In order for Condor to work properly you must set your CONDOR_CONFIG
65 5 Farrukh Khan
environment variable to point to your Condor configuration file:
66 1 Farrukh Khan
/afs/cern.ch/user/f/fakhan/bosco/etc/condor_config before running Condor
67 5 Farrukh Khan
commands/daemons.
68 5 Farrukh Khan
Created a script you can source to setup your Condor environment
69 5 Farrukh Khan
variables. This command must be run each time you log in or may
70 5 Farrukh Khan
be placed in your login scripts:
71 5 Farrukh Khan
   source /afs/cern.ch/user/f/fakhan/bosco/bosco_setenv
72 5 Farrukh Khan
73 5 Farrukh Khan
Congratulations, you installed BOSCO succesfully!
74 5 Farrukh Khan
</pre>
75 6 Farrukh Khan
# 
76 4 Farrukh Khan
77 4 Farrukh Khan
h3. NERSC specific configuration instructions
78 2 Farrukh Khan
79 2 Farrukh Khan
h2. GlideinWMS frontend configuration
80 2 Farrukh Khan
81 2 Farrukh Khan
h2. GlideinWMS factory configuration