- Table of contents
- Production 5 (Neutrino 2020 analysis campaign) Reconstruction book keeping
- R19-11-18-prod5reco release series
- Outstanding issues / planned features
- R19-11-18-prod5reco.a
- R19-11-18-prod5reco.b
- R19-11-18-prod5reco.c
- R19-11-18-prod5reco.d
- R19-11-18-prod5reco.e
- R19-11-18-prod5reco.f
- R19-11-18-prod5reco.g
- R19-11-18-prod5reco.h
- R19-11-18-prod5reco.i
- R19-11-18-prod5reco.j
- R19-11-18-prod5reco.k
- R19-11-18-prod5reco.l
- R19-11-18-prod5reco.m
- R19-11-18-prod5reco.n
- R19-11-18-prod5reco.o
- R19-11-18-prod5reco.p
- R19-11-18-prod5reco.q
- R19-11-18-prod5reco.r
- R19-11-18-prod5reco.s
- R19-11-18-prod5reco.t
- R19-11-18-prod5reco.v
- R19-11-18-prod5reco.w
- R19-11-18-prod5reco.x
- R19-11-18-prod5reco.y
- R19-11-18-prod5reco.z
- R19-11-18-prod5reco.za
- R19-11-18-prod5reco.zb
- R19-11-18-prod5reco.zc
Production 5 (Neutrino 2020 analysis campaign) Reconstruction book keeping¶
A record of the new/improved features in the production 5 processing campaign, production philosophy, and bookkeeping of software release history and relevant datasets.
Release notes quasi-up to date as of 27th Nov 2019
- Current production release R19-11-18-prod5reco.f
Production philosophy¶
Production will start from scratch (ie new Event Generation and Simulation) - see the reasons for this at the end of the Prod4Tag Wiki.
Reconstruction Improvements for Prod5¶
Many algorithms were improved for the Production 5 Campaign. Technotes have been written documenting the improvements and training parameters used.- Slicer
- Event CVN
- Prong CVN
- 2D Prong CVN
- Regression CVN
- ReMId
- NuMu Cosmic Rejection
- Nue Cosmic Rejection
R19-11-18-prod5reco release series¶
Outstanding issues / planned features¶
none
R19-11-18-prod5reco.a¶
Notes and bug fixes¶
The first release of the Production 5 campaign. It was cut from develop, as the remove-bpf-vector branch was merged into develop after the MiniProduction campaign was completed.
R19-11-18-prod5reco.b¶
Notes and bug fixes¶
Fixed a bug in the Bad Channel List
R19-11-18-prod5reco.c¶
Notes and bug fixes¶
Large swathe of changes primarily focused on CVN training and evaluation.- Weights directory removed from the CosRej package.
- Fix a broken Var for recording fraction of cluster hits used in map.
- Update Event CVN model files
- Add code to allow three versions of Event CVN to be ran
- Update art code to load in multiple versions of Event CVN with the correct module labels.
R19-11-18-prod5reco.d¶
Notes and bug fixes¶
- Correct the version of cvn (Event CVN) UPS Product to be setup.
- Fix CAFMaker fhicl bugs for CosmicCVN, TrueEnergy, 2D Prong CVN, NC CosRej.
- Removing unnecessary Prong CVN branches which were still hangovers from Prod4.
Relevant datasets¶
- ND Data
- ND Monte Carlo
- FD MC
R19-11-18-prod5reco.e¶
Notes and bug fixes¶
- Bump the version of calibration to v14.05, so that ND P1 Data could be ran over.
- Fix a rare error seen in ND MRDiF processing, to ignore 2D showers.
- Removing unnecessary Prong CVN branches which were still hangovers from Prod4.
- Quiet some logs
R19-11-18-prod5reco.f¶
Notes and bug fixes¶
- Bump the version of calibration to v14.06, to fix a typo in v14.05.
Relevant datasets¶
- ND Data - draining from R19-11-18-prod5reco.d - for Period1 and DiF failures.
R19-11-18-prod5reco.g¶
Notes and bug fixes¶
- A variety of small changes, mostly added fhicl configurations, to support MRBrem and MRDiF processing in the FD.
- Fix CAFMaker diblock masks for cosrej files
- Generally, get FD reco with cosmic filtered files working
R19-11-18-prod5reco.h¶
Notes and bug fixes¶
- Some fixes to MRE
- Bumped calibcsvs to v14.08 (v14.07 was skipped due to unexpected disk quota issue)
R19-11-18-prod5reco.i¶
Notes and bug fixes¶
- Fixes to BadChannels so they will work correctly with cosmic filtered files, specifically initialization when hits aren't found
- New calibcsvs
R19-11-18-prod5reco.j¶
Notes and bug fixes¶
- Merge r40521 from trunk. Add a flag to disable filling the HitNu information used in semantic segmentation. This is a significant speed-up in the ND MC reconstruction.
- Reduce number of CVN outputs to prevent garbage in diff_cafs
R19-11-18-prod5reco.k¶
Notes and bug fixes¶
- New calibrator configurations for light level systematics
- New calibrator configurations for calibration systematics
- Minor fhicl fixes to CAFMaker for FD CRY MC and NuMI data processing
R19-11-18-prod5reco.l¶
Notes and bug fixes¶
- Fixed typo in Calibrator fhicl
- Add calibration shape calibrator configurations
R19-11-18-prod5reco.m¶
Notes and bug fixes¶
- Memory reductions and speed improvements
- Data overlay-related changes
- Support for time variation systematic in calibrator and ImprovedTransport
- Updates to diff_cafs
- Limit CPUs accessed by TensorFlow
- Remove nocosmics network
- Expose PEOnly option for PixelMapProducer to reduce memory
Relevant datasets¶
- Most FD Numi data
R19-11-18-prod5reco.n¶
Notes and bug fixes¶
- Major MRE updates, which cause trouble for numu energy downsteram from here.
R19-11-18-prod5reco.o¶
Notes and bug fixes¶
- FD rock exposure accounting
- Allow CAFMaker to continue with no slices
- Add a filter to check for FLShits
Relevant datasets¶
- FD Rock MC
R19-11-18-prod5reco.p¶
Notes and bug fixes¶
- Bad Channels to v23.0
Relevant datasets¶
- Period 9 FD Numi Data
R19-11-18-prod5reco.q¶
Notes and bug fixes¶
- Bad channels to v24.0
Relevant datasets¶
- Period 10 FD Numi Data
R19-11-18-prod5reco.r¶
Notes and bug fixes¶
- Final MRE timing fixes
- Add positrons in RHC MRE
Relevant datasets¶
- Replacement FD Numi data cafs
- Draining of all FD Numi data
R19-11-18-prod5reco.s¶
Notes and bug fixes¶
- Add extractHDF5Metadata
R19-11-18-prod5reco.t¶
Notes and bug fixes¶
- Get extractHDF5Metadata into bin
R19-11-18-prod5reco.v¶
Notes and bug fixes¶
- Experimental fix to HDF5 metadata json string
- Adding file_name to HDF5Maker_module.cc
R19-11-18-prod5reco.w¶
Notes and bug fixes¶
- Fixing FileType bug in HDF5Maker
R19-11-18-prod5reco.x¶
Notes and bug fixes¶
- Fix for missing DataTier in h5 metadata
R19-11-18-prod5reco.y¶
Notes and bug fixes¶
- Adding a truth continament filter for use in the Single Particle sample.
- Adding the CAFMaker and HDF5Maker modules into the Prod5 SP fhicl.
R19-11-18-prod5reco.z¶
Notes and bug fixes¶
- PEOnly flag to allow making h5 from ben singles pid
R19-11-18-prod5reco.za¶
Notes and bug fixes¶
- Fill wsid for WS CNN output
R19-11-18-prod5reco.zb¶
Notes and bug fixes¶
- Option for running single output wrong sign network
R19-11-18-prod5reco.zc¶
Notes and bug fixes¶
- Adding wscnn to externals setup script