Project

General

Profile

Feature #3745

Art should not require metadata that sam considers to be optional or non-existent.

Added by Herbert Greenlee over 7 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Low
Category:
Metadata
Target version:
Start date:
Due date:
09/30/2013
% Done:

100%

Estimated time:
4.00 h
Spent time:
Scope:
Internal
Experiment:
-
SSI Package:
art
Duration:

Description

I'm reporting this as a feature request, but I consider it to be a bug in the requirements document.
The requirements document specifies the following "required metadata":
a) application (family, name, version).
b) file type.
c) data tier.
d) stream name.
e) file format (+ era and version).

Sam itself (https://cdcvs.fnal.gov/redmine/projects/sam-web/wiki/Metadata_format) considers the file type to be required metadata. The rest of these metadata fields (except file format era and file format version) are optional according to the sam system. Art should not require metadata that sam considers to be optional. Also, sam does not have any predefined metadata fields such as "file format era" or "file format version," therefore art should not require these non-existent metadata.


Related issues

Related to art - Feature #3743: FileCatalogMetadata service doesn't set file format.Closed09/30/2013

Related to art - Feature #3744: Missing sam metadataClosed09/30/2013

Related to art - Feature #3746: Art should support generating per-file user-specified sam metadata.Closed09/30/2013

Related to art - Feature #4679: Relax FileCatalogOptionsHandler constraint on when SAM metadata are required.Closed

History

#1 Updated by Rob Kutschke over 7 years ago

A comment. I am not a SAM expert so this might be nonsense .... But that's never stopped me before.

Does it make sense for an experiment to require that their jobs supply parameters that SAM considers optional?

If this is a reasonable use case, then I recommend that the solution allow experiments to configure which of the parameters SAM considers optional are required for an art job.

#2 Updated by Christopher Green over 7 years ago

  • Due date set to 09/30/2013
  • Target version set to 1.09.00
  • Start date deleted (04/23/2013)
  • Estimated time set to 4.00 h
  • Scope set to Internal
  • Experiment - added
  • SSI Package art added

Accepted to within changes made at the SAM requirements meeting in May.

#3 Updated by Christopher Green over 7 years ago

  • Status changed from New to Accepted

#4 Updated by Christopher Green almost 7 years ago

  • Target version changed from 1.09.00 to 521

#5 Updated by Christopher Green over 6 years ago

  • Target version changed from 521 to 1.10.00

#6 Updated by Christopher Green over 6 years ago

  • Status changed from Accepted to Assigned

#7 Updated by Christopher Green over 6 years ago

  • Assignee set to Christopher Green

#8 Updated by Christopher Green over 6 years ago

  • % Done changed from 0 to 90
  • Experiment Auger, CDF, CDMS, CMS, COUPP, DES, DONUT, DZero, DarkSide, FOCUS, GammeV, Holometer, HyperCP, g-2 added
  • Experiment deleted (-)

#9 Updated by Christopher Green over 6 years ago

  • Experiment - added
  • Experiment deleted (Auger, CDF, CDMS, CMS, COUPP, DES, DONUT, DZero, DarkSide, FOCUS, GammeV, Holometer, HyperCP, g-2)

#10 Updated by Christopher Green over 6 years ago

  • % Done changed from 90 to 100

Resolved provisionally with the following rules:

If outputs are specified and:
  • SAM input files are specified; or
  • Any of the following items are provided at command line or in FHiCL:
    • --sam-application-family, --sam-app-family, services.FileCatalogMetadata.applicationFamily;
    • --sam-application-version, --sam-app-version, services.FileCatalogMetadata.applicationVersion;
    • --sam-file-type, services.FileCatalogMetadata.fileType;
    • --sam-group, services.FileCatalogMetadata.group

then all of them must be specified except the file type, which will default to "unknown" unless specified on the command line, in FHiCL or directly as the metadata item, file_type.

#11 Updated by Christopher Green over 6 years ago

  • Status changed from Assigned to Resolved

#12 Updated by Christopher Green over 6 years ago

  • Status changed from Resolved to Closed

Also available in: Atom PDF