Project

General

Profile

Support #18971

Products of type "sumdata::RunData" cannot be aggregated.

Added by William Foreman almost 2 years ago. Updated almost 2 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
Start date:
02/12/2018
Due date:
% Done:

100%

Estimated time:
Scope:
Internal
Experiment:
LArIAT
SSI Package:
Duration:

Description

Hi,

In a local area, lariat/app/users/wforeman/lariat_michels2, working off of a feature branch in lariatsoft (remotes/feature/wforeman_OpDetHits), I'm running into this error when I try to run my analysis module (srcs/lariatsoft/LArIATFilterModule/MichelAnaFilter_module.cc) over data. The command is:

lar -c srcs/lariatsoft/JobConfigurations/Michel/Michel_Ana1.fcl -S /pnfs/lariat/scratch/users/wforeman/lariat_michels/run1/reco/files.list

The error is:

-----------------------------------------------------------------------
%MSG-s ArtException: PostEndJob 12-Feb-2018 09:43:48 CST ModuleEndJob
cet::exception caught in art
---- OtherArt BEGIN
---- ProductCannotBeAggregated BEGIN
Products of type "sumdata::RunData" cannot be aggregated.
Please contact .
---- ProductCannotBeAggregated END
---- OtherArt END
%MSG
Art has completed and will exit with status 1.
-----------------------------------------------------------------------

This only happens in newer larsoft versions. Things work fine if I revert to v06_58_00. Here are my active ups products which produce the error:

art v2_09_06 -f Linux64bit+2.6-2.12 -q e15:nu:prof -z /grid/fermiapp/products/larsoft
artdaq_core v3_00_08 -f Linux64bit+2.6-2.12 -q e15:nu:prof:s62 -z /grid/fermiapp/products/larsoft
awscli v1_7_15 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/common/db
boost v1_65_1 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
canvas v3_01_03 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
canvas_root_io v1_00_05 -f Linux64bit+2.6-2.12 -q e15:nu:prof -z /grid/fermiapp/products/larsoft
cetbuildtools v6_01_01 -f NULL -z /grid/fermiapp/products/larsoft
cetlib v3_01_03 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
cetlib_except v1_01_05 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
cetpkgsupport v1_10_02 -f NULL -z /grid/fermiapp/products/lariat/
cigetcert v1_16_1 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/common/db
cigetcertlibs v1_1 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/common/db
clhep v2_3_4_5a -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
cmake v3_9_5 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
cpn v1.7 -f NULL -z /grid/fermiapp/products/common/db
cppunit v1_13_2a -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
cry v1_7i -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
eigen v3_3_3 -f NULL -z /grid/fermiapp/products/larsoft
fftw v3_3_6_pl2 -f Linux64bit+2.6-2.12 -q prof -z /grid/fermiapp/products/larsoft
fhiclcpp v4_06_03 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
g4abla v3_0 -f NULL -z /grid/fermiapp/products/larsoft
g4emlow v6_50 -f NULL -z /grid/fermiapp/products/larsoft
g4neutron v4_5 -f NULL -z /grid/fermiapp/products/larsoft
g4neutronxs v1_4 -f NULL -z /grid/fermiapp/products/larsoft
g4nucleonxs v1_1 -f NULL -z /grid/fermiapp/products/larsoft
g4nuclide v2_1 -f NULL -z /grid/fermiapp/products/larsoft
g4photon v4_3_2 -f NULL -z /grid/fermiapp/products/larsoft
g4pii v1_3 -f NULL -z /grid/fermiapp/products/larsoft
g4radiative v5_1_1 -f NULL -z /grid/fermiapp/products/larsoft
g4surface v1_0 -f NULL -z /grid/fermiapp/products/larsoft
g4tendl v1_3 -f NULL -z /grid/fermiapp/products/larsoft
gcc v6_4_0 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
geant4 v4_10_3_p01b -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
genie v2_12_8c -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
gitflow v1_9_1 -f NULL -z /grid/fermiapp/products/lariat/
git v2_8_2 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/lariat/
gsl v2_4 -f Linux64bit+2.6-2.12 -q prof -z /grid/fermiapp/products/larsoft
ifbeam v2_2_1 -f Linux64bit+2.6-2.12 -q e15:p2714:prof -z /grid/fermiapp/products/larsoft
ifdh_art v2_05_02 -f Linux64bit+2.6-2.12 -q e15:nu:prof:s62 -z /grid/fermiapp/products/larsoft
ifdhc_config v2_3_1 -f NULL -z /grid/fermiapp/products/larsoft
ifdhc v2_3_1 -f Linux64bit+2.6-2.12 -q e15:p2714:prof -z /grid/fermiapp/products/larsoft
jobsub_client v1_2_5 -f NULL -z /grid/fermiapp/products/common/db
jsoncpp v1_7_7a -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
jsonnet v0_9_3a -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larana v06_16_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larbatch v01_36_01 -f NULL -z /grid/fermiapp/products/larsoft
larcorealg v1_17_00 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larcore v06_17_00 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larcoreobj v1_20_00 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
lardata v06_39_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
lardataobj v1_28_00 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
lareventdisplay v06_17_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larevt v06_18_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larexamples v06_10_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
LariatBeamFiles v01_00 -f ANY -z /grid/fermiapp/products/lariat/
LariatFilters v01_02 -f ANY -z /grid/fermiapp/products/lariat/
lariatfragments v06_67_00 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/lariat/
lariatsoft v06_67_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /lariat/app/users/wforeman/lariat_michels2/localProducts_lariatsoft_develop_e15_prof
lariatutil v06_67_00 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/lariat/
larpandoracontent v03_09_04 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larpandora v06_22_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larreco v06_54_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larsim v06_40_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larsoft_data v1_02_01 -f NULL -z /grid/fermiapp/products/larsoft
larsoft v06_67_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
larwirecell v06_10_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
lhapdf v5_9_1i -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
libwda v2_24_0 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
libxml2 v2_9_5 -f Linux64bit+2.6-2.12 -q prof -z /grid/fermiapp/products/larsoft
log4cpp v1_1_3 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
marley v1_0_0b -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
messagefacility v2_01_04 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
mrb v1_14_00 -f NULL -z /grid/fermiapp/products/larsoft
mysql_client v5_5_57 -f Linux64bit+2.6-2.12 -q e15 -z /grid/fermiapp/products/larsoft
ninja v1_6_0b -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/lariat/
nucondb v2_2_1 -f Linux64bit+2.6-2.12 -q e15:p2714:prof -z /grid/fermiapp/products/larsoft
nusimdata v1_09_01 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
nutools v2_17_03 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
pandora v03_07_00a -f Linux64bit+2.6-2.12 -q e15:nu:prof -z /grid/fermiapp/products/larsoft
pdfsets v5_9_1b -f NULL -z /grid/fermiapp/products/larsoft
postgresql v9_6_5 -f Linux64bit+2.6-2.12 -q p2714 -z /grid/fermiapp/products/larsoft
protobuf v3_3_1a -f Linux64bit+2.6-2.12 -q e15 -z /grid/fermiapp/products/larsoft
pycurl v7_16_4 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/common/db
pythia v6_4_28i -f Linux64bit+2.6-2.12 -q gcc640:prof -z /grid/fermiapp/products/larsoft
python v2_7_14 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
range v3_0_3_0 -f NULL -z /grid/fermiapp/products/larsoft
root v6_10_08b -f Linux64bit+2.6-2.12 -q e15:nu:prof -z /grid/fermiapp/products/larsoft
sam_web_client v2_0 -f NULL -z /grid/fermiapp/products/common/db
setpath v1_11 -f NULL -z /grid/fermiapp/products/common/db
sqlite v3_20_01_00 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
tbb v2018_1 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
tensorflow v1_3_0b -f Linux64bit+2.6-2.12 -q e15:p2714:prof -z /grid/fermiapp/products/larsoft
TRACE v3_13_00 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
ups v6_0_7 -f Linux64bit+2.6-2.12 -z /grid/fermiapp/products/larsoft
wirecell v0_6_2a -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
xerces_c v3_1_4b -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft
xrootd v4_7_0 -f Linux64bit+2.6-2.12 -q e15:prof -z /grid/fermiapp/products/larsoft


Related issues

Related to LArSoft - Bug #18943: Problem with sumdata::RunData aggregationClosed02/09/2018

History

#1 Updated by William Foreman almost 2 years ago

Update: This error only seems to occur when I try to open art-root reco files that were reconstructed using older versions. If I produce a new test reco file in the new version (v06_67_01), I can analyze that just fine. So, there must have been a change in a newer art release that makes older reco files incompatible with newer versions?

#2 Updated by William Foreman almost 2 years ago

Here's a minimum working example of how to reproduce the problem, and also demonstrating how newly reconstructed files work fine:

source /grid/fermiapp/lariat/setup_lariat.sh
setup ninja v1_6_0b
mkdir testdir
cd testdir
export MRB_PROJECT=lariatsoft
mrb newDev v develop -q e15:prof
source localProducts_lariatsoft_develop_e15_prof/setup
cd srcs
mrb gitCheckout -t develop lariatsoft
cd lariatsoft
git checkout -b feature/wforeman_OpDetHits
git pull origin feature/wforeman_OpDetHits
cd ../..
mrbsetenv
cd build_slf6.x86_64/
mrb i --generator ninja
cd ..
setup lariatsoft ${LARIATSOFT_VERSION} -q e15:prof
source localProducts_lariatsoft_develop_e15_prof/setup
lar -c Michel_Ana1.fcl -S /pnfs/lariat/scratch/users/wforeman/lariat_michels/run1/reco/files.list
(-
> GET ERROR!)

lar c Michel_Reco1.fcl -S /pnfs/lariat/persistent/users/wforeman/filelists/ser_michel1_1.list -n 30 -o testreco.root
lar -c Michel_Ana1.fcl testreco.root
(-
> NO ERROR!)

#3 Updated by Kyle Knoepfel almost 2 years ago

  • Tracker changed from Bug to Support
  • Status changed from New to Closed
  • % Done changed from 0 to 100

This is an error in the definition of the LArSoft-supported product sumdata::RunData. This issue has already been registered as #18943.

#4 Updated by Kyle Knoepfel almost 2 years ago

  • Related to Bug #18943: Problem with sumdata::RunData aggregation added


Also available in: Atom PDF