Project

General

Profile

Feature #24407

Support CVMFS and Singularity when none of the 2 is available on the worker node

Added by Marco Mambelli about 2 months ago. Updated 17 days ago.

Status:
New
Priority:
High
Category:
-
Target version:
Start date:
05/13/2020
Due date:
% Done:

0%

Estimated time:
Stakeholders:

CMS

Duration:

Description

Sometimes CVMFS is not available and Singularity neither.

The Glidein should be able to connect to CVMFS and start Singularity from there.
There are some possibility, from Dave:

1. mountrepo/umountrepo only
• requires fusermount; mounts in user space
• map /cvmfs in container with singularity –bind (not run from cvmfs because of path)
2. cvmfsexec on RHEL 7.6 or 7.7
• requires fusermount and additionally unprivileged user namespaces enabled
• maps /cvmfs without singularity, can run singularity under it
• unmounts repos on exit, but not with kill -9
3. cvmfsexec on RHEL >= 7.8
• no fusermount needed, and cleans up mounts even with kill -9
• still needs unprivileged user namespaces enabled; that is default on RHEL 8
4. singcvmfs on any system with singularity >= 3.4.0
• drop-in replacement for singularity; set environment variable with cvmfs repos to mount
• requires container image to already be present (not read from cvmfs)
• requires setuid-root singularity except when RHEL >= 7.8 and and singularity >= 3.6.0

Consider also
  • package building (at reconfig/upgreade)
  • proxy search and setup (WPAD)

Related issues

Related to GlideinWMS - Milestone #19515: Roadmap for Singularity supportNew03/27/2018

Blocked by GlideinWMS - Feature #24546: Add the ability to use CVMFS on sites that do not provide local installationsWork in progress06/18/2020

History

#1 Updated by Marco Mambelli about 2 months ago

#2 Updated by Marco Mambelli about 2 months ago

  • Priority changed from Normal to High
  • Description updated (diff)
  • Subject changed from Support CVMFS and Singularity when none of the 2 is available to Support CVMFS and Singularity when none of the 2 is available on the worker node

#3 Updated by Marco Mambelli 17 days ago

CVMFS support has been moved to [#24546], specified in more detail

#4 Updated by Marco Mambelli 17 days ago

  • Blocked by Feature #24546: Add the ability to use CVMFS on sites that do not provide local installations added


Also available in: Atom PDF