Project

General

Profile

ANNIE SAM Metadata Design

This is an outline of SAM Metadata usage for the ANNIE experiment.

Dimensions

Dimensions are standard metadata names built into the SAM schema.

Other experiments
MINOS
NOVA

List the dimensions available

samweb list-values --help-categories

Available database categories:

data_tiers
    Data tier of a file (raw, simulated, reconstructed, etc)
checksum_types
    Checksum type
run_types
    Type of a run
groups
    Work groups
data_streams
    Data stream names
file_formats
    Format of the file
file_types
    Type (ie general purpose) of a file

Initial dimension values available, 2017/02/15

CATS='data_tiers
checksum_types
run_types groups
data_streams
file_formats
file_types'

for CAT in ${CATS} ; do echo ; echo ${CAT} ; samweb list-values ${CAT} ; done

data_tiers

checksum_types
enstore

run_types

groups
annie
admin_role

data_streams

file_formats
unknown

file_types
unknown

Dimension value summaries

data_tiers

  • raw
  • v5data
  • v6data

checksum_types

  • enstore
    a zero-seeded adler32 sum. Get from 'ecrc' command, or samweb file-checksum <file>
  • adler32
    a valid 1-seeded adler32 sum, from /usr/bin/adler32 which is part of dcache-srmclient.
    Get this from dCache mounted files at DPAT and DFILE with
    cat "${DPAT}/.(get)(${DFILE})(checksum)"
    like
    cat "/pnfs/fs/usr/annie/raw/.(get)(V3DataR248S5p3T1Sep_15_1134.root)(checksum)"

We should consider using just adler32, the correct checksum as used by dCache.
Other options would be md5 or sha1.

run_types
  • beam
  • source
  • cosmic
  • led
  • hefty
  • heftysource
  • soft
  • test

groups

  • annie
  • admin_role

We will likely need only the general annie and admin_role groups

data_streams

file_formats

  • unknown
  • root
  • text

file_types

  • unknown
  • detector
  • simulation

Adding values

samweb add-value <dimension> <value>

samweb add-value  data-tiers raw
samweb add-value  data-tiers v5data
samweb add-value  data-tiers v6data
samweb add-value  file_formats root
samweb add-value  file_formats text
samweb add-value  checksum_types adler32
samweb add-value file_types detector
samweb add-value file_types simulation

Parameters

Parameters are optional, experment specific metadata names.