Project

General

Profile

CVMFS Tasks

LBNE LArSoft Distribution on OASIS

There are two components of software that are needed to run LArSoft jobs for LBNE. The first and largest component is the base LArSoft packages which are maintained and distributed by the Fermilab Scientific Computing Division LArSoft Project . These packages can be found on the OASIS server in the directory /cvmfs/oasis.opensciencegrid.org/fermilab/products/larsoft/ The second component is the LBNE specific modules that are loaded into the lar executable at run time and are part of the lbnecode Project

The lbnecode needs to be compiled, packaged and distributed separate from the LArSoft code and is the responsibility of the LBNE S&C group.

ssh lbne@lbnegpvm01
source /grid/fermiapp/products/larsoft/setups
/grid/fermiapp/larsoft/home/larsoft/code/laradmin/build_tools/bootstrap_lbne.sh /lbne/app/home/lbne/lbnecode_build_area/ <tag_version>
cd /lbne/app/home/lbne/lbnecode_build_area/lbnecode/<tag_version>/
./build_lbne.sh /lbne/app/home/lbne/lbnecode_build_area/ <tag_version> e4 prof -j3
./build_lbne.sh /lbne/app/home/lbne/lbnecode_build_area/ <tag_version> e4 debug -j3

Then on an SLF6 machine you need to do the follwoing:

ssh lbne@lbnegpvm01
source /grid/fermiapp/products/larsoft/setups
cd /lbne/app/home/lbne/lbnecode_build_area/lbnecode/<tag_version>/
./build_lbne.sh /lbne/app/home/lbne/lbnecode_build_area/ <tag_version> e4 prof -j3
./build_lbne.sh /lbne/app/home/lbne/lbnecode_build_area/ <tag_version> e4 debug -j3

Finally, you should unwind the resulting tarballs in the products area as the user lbne (but only after we have the /grid/fermiapp/products/lbne area setup):

cd /grid/fermiapp/products/lbne/
tar xf /lbne/app/home/lbne/lbnecode_build_area/lbnecode/<tag_version>/lbnecode-<tag_version>-slf5-x86_64-e4-debug.tar.bz2
tar xf /lbne/app/home/lbne/lbnecode_build_area/lbnecode/<tag_version>/lbnecode-<tag_version>-slf5-x86_64-e4-prof.tar.bz2
tar xf /lbne/app/home/lbne/lbnecode_build_area/lbnecode/<tag_version>/lbnecode-<tag_version>-slf6-x86_64-e4-debug.tar.bz2
tar xf /lbne/app/home/lbne/lbnecode_build_area/lbnecode/<tag_version>/lbnecode-<tag_version>-slf6-x86_64-e4-prof.tar.bz2

Finally, in order to get the update copied over to OASIS, run the following commands from your own account since the lbne account doesn't have a grid proxy:

get-cert
voms-proxy-init -noregen -voms lbne:/lbne/Role=Analysis
/grid/fermiapp/larsoft/home/larsoft/code/laradmin/cvmfs/oasis-sync -vrp lbne/lbnecode

That should publish everything to OASIS. If you want more detailed instructions on installing software on OASIS instructions are here