Project

General

Profile

Support #6452

Large memory use by fuzzyCluster

Added by Herbert Greenlee almost 7 years ago. Updated over 6 years ago.

Status:
Closed
Priority:
Normal
Category:
-
Target version:
-
Start date:
06/11/2014
Due date:
% Done:

100%

Estimated time:
Experiment:
-
Co-Assignees:
Duration:

Description

As of larsoft v02_01_00, the fuzzyCluster module seems to be using >1 GB of virtual memory, which is making it difficult to run the reco2D production step.

History

#1 Updated by Gianluca Petrillo almost 7 years ago

  • Status changed from New to Feedback
  • Assignee set to Gianluca Petrillo

Can you give me an example of how you run it: input file and FCL file?

#2 Updated by Gianluca Petrillo almost 7 years ago

  • Status changed from Feedback to Accepted

Received via e-mail from Herbert Greenlee:


Hello,

Here is my test area.

cd /uboone/app/users/greenlee/tstest
lar -c standard_reco_uboone_2D_noopt_nowires_cosmic.fcl -S tpcsim.list

Job fcl file is from uboonecode v02_01_00.
List file is pointing to files in
/uboone/data/users/greenlee/v02_01_00/tpcsim/prodgenie_bnb_nu_cosmic_3window_uboone

e.g.
/uboone/data/users/greenlee/v02_01_00/tpcsim/prodgenie_bnb_nu_cosmic_3window_uboone/16594769_0/prodgenie_bnb_nu_cosmic_3window_uboone_16594762_0_gen_16594766_0_g4_16594769_0_detsim_tpc.root

Herb

#3 Updated by Gianluca Petrillo almost 7 years ago

  • % Done changed from 0 to 50

I have identified the place where all the memory is used, and after a discussion with the author (Ben Carls), his test confirmed a bug in the pre-clustering algorithm.
He has now replaced the pre-clustering algorithm, and validation is ongoing.

#4 Updated by Gianluca Petrillo almost 7 years ago

  • Status changed from Accepted to Assigned

#5 Updated by Gianluca Petrillo over 6 years ago

  • % Done changed from 50 to 100

The bug was fixed by changing the pre-clustering algorithm.
The new algorithm shows a memory leak, described in #6642.

#6 Updated by Gianluca Petrillo over 6 years ago

  • Status changed from Assigned to Resolved

#7 Updated by Lynn Garren over 6 years ago

  • Status changed from Resolved to Closed

Also available in: Atom PDF