Project

General

Profile

NOvA Raw2Root KeepUp Requests

10/15/15

Files failing with error code 65

***
fardet_r00020774_s00_t02.raw

Error message (in .out)

%MSG-s ArtException: PostCloseFile 15-Oct-2015 04:49:00 CDT PostEndRun
cet::exception caught in art
---- StdException BEGIN
The EventProcessor caught a std::exception and converted it to a cet::exception
Previous information:

Function checkReservedForCafe  is Not allowed for version 3.
DataFormatException generated.
Stack trace:
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libRawData.so(_ZN14daqdataformats19DataFormatException16constructMessageEv+0x610) [0x2b0f7564e810]
/grid/fermiapp/products/nova/externals/novadaq/v03_00_09/slf6.x86_64.e7.prof/lib/libDAQDataFormats.so(_ZNK14daqdataformats10RawDAQData20functionIsNotAllowedESsSs+0x314) [0x2b0f7f085b24]
/grid/fermiapp/products/nova/externals/novadaq/v03_00_09/slf6.x86_64.e7.prof/lib/libDAQDataFormats.so(_ZNK14daqdataformats8version112RawNanoSlice20checkReservedForCafeEv+0x4c) [0x2b0f7f0b877c]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libDAQ2RawDigit.so(_ZN7daq2raw12OnlineUnpack16ProcessRawEvent_EPSt6vectorIN7rawdata8RawDigitESaIS3_EEPNS2_10RawTriggerEPNS2_11FlatDAQDataEPNS2_9DAQHeaderE+0xe9f) [0x2b0f88c0a96f]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libDAQ2RawDigit.so(_ZN7daq2raw12OnlineUnpack15ProcessRawEventERN13rawfileparser13RawFileParserEPSt6vectorIN7rawdata8RawDigitESaIS6_EEPNS5_10RawTriggerEPNS5_11FlatDAQDataEPNS5_9DAQHeaderE+0x61) [0x2b0f88c0b051]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libDAQ2RawDigit.so(_ZN7daq2raw18NOvARawInputDriver8readNextERKPN3art12RunPrincipalERKPNS1_15SubRunPrincipalERS3_RS7_RPNS1_14EventPrincipalE+0xfa) [0x2b0f88bf204a]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libNOvARawInputSource_source.so(_ZN3art6SourceIN7daq2raw18NOvARawInputDriverEE9readNext_Ev+0x69) [0x2b0f889cca29]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libNOvARawInputSource_source.so(_ZN3art6SourceIN7daq2raw18NOvARawInputDriverEE12nextItemTypeEv+0x55) [0x2b0f889cd355]
/grid/fermiapp/products/nova/externals/art/v1_13_01/slf6.x86_64.e7.nu.prof/lib/libart_Framework_EventProcessor.so(_ZN3art14EventProcessor10runCommon_Ev+0x6d) [0x2b0f69cf7edd]
/grid/fermiapp/products/nova/externals/art/v1_13_01/slf6.x86_64.e7.nu.prof/lib/libart_Framework_EventProcessor.so(_ZN3art14EventProcessor15runToCompletionEv+0x18) [0x2b0f69cf9278]

---- StdException END
%MSG

Samweb project: http://samweb.fnal.gov:8480/station_monitor/nova/stations/nova/projects/novapro-Raw2Root-S15-03-11-fardet-1_days_ago-20151015_0130
Condor cluster:
Process number: 8

***
fardet_r00020770_s53_DDenergy.raw
(In metadata)
DQ.IsGoodRun: false

Error message (in .out):

%MSG-s ArtException: PostCloseFile 15-Oct-2015 02:18:23 CDT PostEndRun
cet::exception caught in art
---- StdException BEGIN
The EventProcessor caught a std::exception and converted it to a cet::exception
Previous information:

Function checkReservedForCafe  is Not allowed for version 3.
DataFormatException generated.
Stack trace:
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libRawData.so(_ZN14daqdataformats19DataFormatException16constructMessageEv+0x610) [0x2aac8ef2d810]
/grid/fermiapp/products/nova/externals/novadaq/v03_00_09/slf6.x86_64.e7.prof/lib/libDAQDataFormats.so(_ZNK14daqdataformats10RawDAQData20functionIsNotAllowedESsSs+0x314) [0x2aac9ccdbb24]
/grid/fermiapp/products/nova/externals/novadaq/v03_00_09/slf6.x86_64.e7.prof/lib/libDAQDataFormats.so(_ZNK14daqdataformats8version112RawNanoSlice20checkReservedForCafeEv+0x4c) [0x2aac9cd0e77c]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libDAQ2RawDigit.so(_ZN7daq2raw12OnlineUnpack16ProcessRawEvent_EPSt6vectorIN7rawdata8RawDigitESaIS3_EEPNS2_10RawTriggerEPNS2_11FlatDAQDataEPNS2_9DAQHeaderE+0xe9f) [0x2aaca676e96f]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libDAQ2RawDigit.so(_ZN7daq2raw12OnlineUnpack15ProcessRawEventERN13rawfileparser13RawFileParserEPSt6vectorIN7rawdata8RawDigitESaIS6_EEPNS5_10RawTriggerEPNS5_11FlatDAQDataEPNS5_9DAQHeaderE+0x61) [0x2aaca676f051]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libDAQ2RawDigit.so(_ZN7daq2raw18NOvARawInputDriver8readNextERKPN3art12RunPrincipalERKPNS1_15SubRunPrincipalERS3_RS7_RPNS1_14EventPrincipalE+0xfa) [0x2aaca675604a]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libNOvARawInputSource_source.so(_ZN3art6SourceIN7daq2raw18NOvARawInputDriverEE9readNext_Ev+0x69) [0x2aaca6536a29]
/nova/app/home/novasoft/slf6/novasoft/releases/S15-03-11/lib/Linux2.6-GCC-maxopt/libNOvARawInputSource_source.so(_ZN3art6SourceIN7daq2raw18NOvARawInputDriverEE12nextItemTypeEv+0x55) [0x2aaca6537355]
/grid/fermiapp/products/nova/externals/art/v1_13_01/slf6.x86_64.e7.nu.prof/lib/libart_Framework_EventProcessor.so(_ZN3art14EventProcessor10runCommon_Ev+0x6d) [0x2aac87a11edd]
/grid/fermiapp/products/nova/externals/art/v1_13_01/slf6.x86_64.e7.nu.prof/lib/libart_Framework_EventProcessor.so(_ZN3art14EventProcessor15runToCompletionEv+0x18) [0x2aac87a13278]

---- StdException END
%MSG

Samweb project: http://samweb.fnal.gov:8480/station_monitor/nova/stations/nova/projects/novapro-Raw2Root-S15-03-11-fardet-1_days_ago-20151015_0201
Cluster number:
Process: 27

***
Lost file: fardet_r00020769_s60_DDnumu.raw
Was seeing but doesn't show up as completed (having SAM children)

File stuck in FTS due to corrupt metadata

FTS message:

InvalidMetadata: Metadata is invalid:
Invalid parameter value type for 'Online.TriggerPrescaleListIDX'
Invalid parameter value '1444827302,' for true_int parameter 'Online.SubRunStartTime'
Invalid parameter value '628,' for true_int parameter 'Online.TotalEvents'
Invalid parameter value type for 'Online.DataLoggerVersion'
Invalid parameter value '1444817343,' for true_int parameter 'Online.RunStartTime'
Invalid parameter value '10224788,' for true_int parameter 'Online.RunSize'
Invalid parameter value type for 'Online.TriggerListIDX'
Invalid parameter value '1444827469,' for true_int parameter 'Online.SubRunEndTime'
Invalid parameter value '20769,' for true_int parameter 'Online.RunNumber'
Invalid parameter value '1444827469,' for true_int parameter 'Online.RunEndTime'
Invalid parameter value type for 'Online.DataLoggerID'
Invalid parameter value type for 'Online.ConfigIDX'
Invalid parameter value '60,' for true_int parameter 'Online.Subrun'