Project

General

Profile

BOSCO submission setup » History » Version 5

Farrukh Khan, 09/20/2017 02:12 PM

1 1 Farrukh Khan
h1. BOSCO submission setup
2 2 Farrukh Khan
3 2 Farrukh Khan
The wiki contains step by step instructions on how to install and configure BOSCO submission from a glideinWMS factory
4 2 Farrukh Khan
5 2 Farrukh Khan
{{toc}}
6 2 Farrukh Khan
7 3 Farrukh Khan
h2. Terminology
8 3 Farrukh Khan
9 3 Farrukh Khan
| *Term* | *Description* |
10 3 Farrukh Khan
| BOSCO_HOST | This is the remote login node from which glideins will be submitted to the local batch queue. For example, in the instructions below BOSCO_HOST is 'cori.nersc.gov' |
11 3 Farrukh Khan
| FACTORY_HOST | This is the node where glideinWMS factory service has been installed and configured to run. For example, in the instructions below FACTORY_HOST is 'fermifactory01.fnal.gov' |
12 3 Farrukh Khan
| FRONTEND_HOST | This is the node where glideinWMS frontend service has been installed and configured to run. For example, in the instructions below FRONTEND_HOST is 'cmssrv279.fnal.gov' |
13 3 Farrukh Khan
14 2 Farrukh Khan
h2. Vanilla installation
15 1 Farrukh Khan
16 4 Farrukh Khan
1. Log into any node from where you can SSH into BOSCO_HOST. It is strongly recommended that the architecture and operating system of the host where you set BOSCO up from is similar to the BOSCO_HOST as you may need to copy some libraries over if needed. In the instructions below, the host being used to setup BOSCO is 'lxplus030.cern.ch'.
17 4 Farrukh Khan
<pre>
18 4 Farrukh Khan
[fkhan@dhcp-131-225-82-129 ~]$ ssh fakhan@lxplus030.cern.ch
19 4 Farrukh Khan
Password: 
20 4 Farrukh Khan
Last login: Tue Sep 19 22:44:19 2017 from dhcp-131-225-82-129.dhcp.fnal.gov
21 4 Farrukh Khan
* ********************************************************************
22 4 Farrukh Khan
* Welcome to lxplus030.cern.ch, SLC, 6.9
23 4 Farrukh Khan
* Archive of news is available in /etc/motd-archive
24 4 Farrukh Khan
* Reminder: You have agreed to comply with the CERN computing rules
25 4 Farrukh Khan
* https://cern.ch/ComputingRules
26 4 Farrukh Khan
* Puppet environment: production, Roger state: production
27 4 Farrukh Khan
* Foreman hostgroup: lxplus/nodes/login
28 4 Farrukh Khan
* LXPLUS Public Login Service
29 4 Farrukh Khan
* ********************************************************************
30 4 Farrukh Khan
[fakhan@lxplus030 ~]$
31 4 Farrukh Khan
</pre>
32 4 Farrukh Khan
33 4 Farrukh Khan
34 5 Farrukh Khan
1. Take a look at the FTP server at UW Madison hosting different BOSCO versions "here":ftp://ftp.cs.wisc.edu/condor/bosco/. Select the appropriate version to download and wget the relevant boscoinstaller.tar.gz file. For example for version 1.2.10, fetch the installer as follows:
35 5 Farrukh Khan
<pre>
36 5 Farrukh Khan
[fakhan@lxplus030 ~]$ wget ftp://ftp.cs.wisc.edu/condor/bosco/1.2.10/boscoinstaller.tar.gz 
37 5 Farrukh Khan
--2017-09-19 22:29:10--  ftp://ftp.cs.wisc.edu/condor/bosco/1.2.10/boscoinstaller.tar.gz
38 5 Farrukh Khan
           => “boscoinstaller.tar.gz”
39 5 Farrukh Khan
Resolving ftp.cs.wisc.edu... 128.105.2.31
40 5 Farrukh Khan
Connecting to ftp.cs.wisc.edu|128.105.2.31|:21... connected.
41 5 Farrukh Khan
Logging in as anonymous ... Logged in!
42 5 Farrukh Khan
==> SYST ... done.    ==> PWD ... done.
43 5 Farrukh Khan
==> TYPE I ... done.  ==> CWD (1) /condor/bosco/1.2.10 ... done.
44 5 Farrukh Khan
==> SIZE boscoinstaller.tar.gz ... 20480
45 5 Farrukh Khan
==> PASV ... done.    ==> RETR boscoinstaller.tar.gz ... done.
46 5 Farrukh Khan
Length: 20480 (20K) (unauthoritative)
47 5 Farrukh Khan
48 5 Farrukh Khan
100%[==================================================================================================================>] 20,480      --.-K/s   in 0.1s    
49 5 Farrukh Khan
50 5 Farrukh Khan
2017-09-19 22:29:12 (182 KB/s) - “boscoinstaller.tar.gz” saved [20480]
51 5 Farrukh Khan
</pre>
52 5 Farrukh Khan
53 5 Farrukh Khan
1. Untar the downloaded installer and run it to install BOSCO on the current machine. For example:
54 5 Farrukh Khan
<pre>
55 5 Farrukh Khan
[fakhan@lxplus030 ~]$ tar -xvf boscoinstaller.tar.gz 
56 5 Farrukh Khan
boscoinstaller
57 5 Farrukh Khan
58 5 Farrukh Khan
[fakhan@lxplus030 ~]$ ./boscoinstaller 
59 5 Farrukh Khan
Downloading BOSCO from ftp://ftp.cs.wisc.edu/condor/bosco/1.2/bosco-1.2-x86_64_RedHat6.tar.gz
60 5 Farrukh Khan
Installing BOSCO in ~/bosco
61 5 Farrukh Khan
Installing Condor from /tmp/fakhan/tmpbEI905/condor-8.6.6-x86_64_RedHat6-stripped to /afs/cern.ch/user/f/fakhan/bosco
62 5 Farrukh Khan
63 5 Farrukh Khan
Condor has been installed into:
64 5 Farrukh Khan
    /afs/cern.ch/user/f/fakhan/bosco
65 5 Farrukh Khan
66 5 Farrukh Khan
Configured condor using these configuration files:
67 5 Farrukh Khan
  global: /afs/cern.ch/user/f/fakhan/bosco/etc/condor_config
68 5 Farrukh Khan
  local:  /afs/cern.ch/user/f/fakhan/bosco/local.bosco/condor_config.local
69 5 Farrukh Khan
70 5 Farrukh Khan
In order for Condor to work properly you must set your CONDOR_CONFIG
71 5 Farrukh Khan
environment variable to point to your Condor configuration file:
72 5 Farrukh Khan
/afs/cern.ch/user/f/fakhan/bosco/etc/condor_config before running Condor
73 5 Farrukh Khan
commands/daemons.
74 5 Farrukh Khan
Created a script you can source to setup your Condor environment
75 5 Farrukh Khan
variables. This command must be run each time you log in or may
76 5 Farrukh Khan
be placed in your login scripts:
77 5 Farrukh Khan
   source /afs/cern.ch/user/f/fakhan/bosco/bosco_setenv
78 5 Farrukh Khan
79 5 Farrukh Khan
Congratulations, you installed BOSCO succesfully!
80 5 Farrukh Khan
</pre>
81 4 Farrukh Khan
82 4 Farrukh Khan
h3. NERSC specific configuration instructions
83 2 Farrukh Khan
84 2 Farrukh Khan
h2. GlideinWMS frontend configuration
85 2 Farrukh Khan
86 2 Farrukh Khan
h2. GlideinWMS factory configuration