Project

General

Profile

Support #18459

Test loon from cvmfs

Added by Arthur Kreymer almost 2 years ago. Updated almost 2 years ago.

Status:
Work in progress
Priority:
High
Start date:
12/01/2017
Due date:
01/01/2018
% Done:

0%

Estimated time:
6.00 h
Spent time:
Duration: 32

Description

Test use of loon from /cvmfs/minos.opensciencegrid.org

History

#1 Updated by Arthur Kreymer almost 2 years ago

I tested this manually on fermiclous168, using the kreymer account.
In spite of complaints about /grid/fermiapp/products/common/db and Labyrinth,
the job run successfully.

scp minos-data:/grid/fermiapp/minos/scripts/testloon /dev/shm/testloon

scp minos-data:/var/tmp/mindata/test.root /var/tmp/kreymer/test.root

/dev/shm/testloon cvmfs

testloon 20171127 cvmfs run at Mon Nov 27 13:13:55 CST 2017 on fermicloud168.fnal.gov by kreymer
Linux fermicloud168.fnal.gov 2.6.32-696.10.1.el6.x86_64 #1 SMP Tue Aug 22 11:35:19 CDT 2017 x86_64 x86_64 x86_64 GNU/Linux
Scientific Linux Fermi release 6.9 (Ramsey)
 TMPDIR set to /var/tmp/kreymer
 TMPDIR is /var/tmp/kreymer
Linux64bit+2.6-2.12
Linux+2.6-2.12
setup_minossoft_FNALU forcing 64bit build
setup_minossoft_FNALU thinks R3.03.06 (303) doesn't have a --64bit build, force --32bit 
setup_minossoft_FNALU_parser forcing flavor: Linux+2.6-2.12
WARNING:  '/grid/fermiapp/products/common/db' is not a directory
WARNING:  '/grid/fermiapp/products/common/db' is not a directory
WARNING:  '/grid/fermiapp/products/common/db' is not a directory
WARNING:  '/grid/fermiapp/products/common/db' is not a directory
 /cvmfs/minos.opensciencegrid.org/minos/minossoft/releases/boot/bin/generic/srt_environment
  used to hack SRT_ARCH=Linux2.6 to Linux2.6 
MINOSSOFT release "R3.03.06" 
SRT_SUBDIR=Linux2.6-GCC_4_5 ROOT=v5-34-03 EXTERN=v04 CONFIG=v01
gminos_jobs "/cvmfs/minos.opensciencegrid.org/minos/products/prd/GMINOS_JOBS/development" 
/cvmfs/minos.opensciencegrid.org/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup_labyrinth.sh: line 71: /grid/fermiapp/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup/arch: No such file or directory
/cvmfs/minos.opensciencegrid.org/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup_labyrinth.sh: line 83: /grid/fermiapp/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup/minos_host.sh: No such file or directory
setup "test" version of LABYRINTH [ , ]
/cvmfs/minos.opensciencegrid.org/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup_labyrinth.sh: line 94: [: =: unary operator expected
no configuration file for , check setup directory
/cvmfs/minos.opensciencegrid.org/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup_labyrinth.sh: line 112: /grid/fermiapp/minos/products/prd/LABYRINTH/Linux2.6-GCC_4_5/development/labyrinth/setup/setup_minos.sh: No such file or directory
missing 32bit libs from mysql=1 loon=0
running: setup minos_32bit_libs slf6
adjust_tsql.sh reader left alone EXPERIMENT env ():GRID_GROUP env ():GROUP env ():id -g -n (e875)
TYPE LOON
loon is /cvmfs/minos.opensciencegrid.org/minos/minossoft/releases/R3.03.06/bin/Linux2.6-GCC_4_5/loon
-rw-r--r-- 1 kreymer e875 41379 Nov 27 13:11 /var/tmp/kreymer/test.root
loon [0] 
Processing /cvmfs/minos.opensciencegrid.org/minos/scripts/firstlast.C...
Spin(1 in 1 out 0 filt.)
  1) +RawRecCounts::Ana         n=1     (     1/     0) t=(    0.00/    0.00)

RawRecCounts Report: test.root
       root version: v04-02-00

  VldContexts: 
  First:       {   Far|  Data|2005-04-25 16:36:07.621514000Z}
  First Snarl: {Unknow|Unknow|1970-01-01 00:00:00.000000000Z} # -1        
  Last:        {   Far|  Data|2005-04-25 16:36:07.621514000Z}
  Last  Snarl: {Unknow|Unknow|1970-01-01 00:00:00.000000000Z} # -1        
  in 11 records of 0 record sets 

  RawConfigFilesBlock                     7
  RawDaqHeaderBlock                      11
  RawRunCommentBlock                      1
  RawRunConfigBlock                       1
  RawRunEndBlock                          1
  RawRunStartBlock                        1

RawRecCounts done

#2 Updated by Arthur Kreymer almost 2 years ago

The testloon cvmfs test succeeded on a GPGrid worker an on a CMS worker.

The same job submitted to Wisconsin failed with a Segmentation fault,
possibly because that worker ran CentOS Linux release 7.4.1708 (Core)

FERMIGRID

export JOBSUB_GROUP=minos
FAST=' --expected-lifetime=1h --memory=100MB --disk=3GB'
TEST=/grid/fermiapp/minos/scripts/testloon

jobsub_submit -g ${FAST} file://${TEST} cvmfs

CMS

jobsub_submit -g ${FAST} \
--resource-provides=usage_model=OFFSITE --site=FNAL \
file://${TEST} cvmfs

#3 Updated by Arthur Kreymer almost 2 years ago

testloon cvmfs has run successfully at these OSG sites,
having added --OS=SL6 to the submission to avoid SL7 workers.

BNL
Caltech
FNAL
MIT
Nebraska

A job submitted to --site=Stampede remained idle.

Did we ever get the OSG to TACC gateway working ?



Also available in: Atom PDF