Project

General

Profile

Task #17953

Milestone #17921: Profiling LArSoft Code

Ease of use of Profiling tools

Added by Katherine Lato almost 3 years ago. Updated over 2 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
10/18/2017
Due date:
% Done:

100%

Estimated time:
Spent time:
Duration:

Description

Consulting with LArSoft,
- provide Open Speed Shop, IgProf documentation
- Have them available via UPS/UPD

Note, have some words on a redmine page already:
https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/_igprof_profiler

History

#1 Updated by Lynn Garren almost 3 years ago

I note that we attempted to provide igprof some time ago via ups, but were unable to build it on all supported platforms. If this is only desired for some platforms, the problem may be resolvable.

#2 Updated by Soon Jun almost 3 years ago

The exiting ups igprof is working on tev.fnal.gov (Linux 2.6.32-696.1.1.el6.x86_64) with a Geant4 application build with gcc-4.9.2 (tested with igprof v5_9_16 -f Linux64bit+2.6-2.12 -q e10). So, this can be use for profiling memory usages of LArSoft/DUNE.

#3 Updated by Lynn Garren almost 3 years ago

This is the same build that is installed in the larsoft product area. However, I think we will need a new build with the e14 (gcc 6.3.0) qualifier or there will be a conflict.

"igprof" "v5_9_16" "Linux64bit+3.10-2.17" "e10" "" 
"igprof" "v5_9_16" "Linux64bit+2.6-2.12" "e10" "" 

#4 Updated by Soon Jun almost 3 years ago

You are right. I noticed that the version of igprof depends on gcc v4_9_3a (so it worked with the application built with 4_9_2), but wanted to wait until the standard workflow of LArSoft/LUNE is defined for the profiling task - if gcc 6.3.0 is one used for the latest/default version of LArSoft, you may go ahead to install igprof with it. Thanks.

#5 Updated by Lynn Garren almost 3 years ago

Unfortunately, there is a build problem with newer releases of gcc. And there is no release with a newer tag, although there have been some changes in the code since then. Would someone remind me why it is not appropriate to build igprof with the native compiler?

#6 Updated by Soon Jun almost 3 years ago

Good thought. I never tried igprof with a gcc compiler different from one used for target applications for Geant4 profiling tasks. Nevertheless, the igprof with the native gcc may still work if there is no conflicts in involved or dependent libraries - at least, it worked for a "simple" test that I mangled
gcc versions for a simple test code (6.3.0) and igprof (4.8.2).

In the order direction, I also managed to build igprof with gcc 6.3.0 (either by adding -Wno-c++11-compat or modifying lines in src/analyse.cc guided by error messages). Then, the installed igprof works for measurement, but the post analysis (using igprof-analyse) crashes. However, output of igprof is simply ascii files, I could successfully analyze results with the igprof version built with gcc 4.8.2. So, at least we know how to work-around for the problem related to igprof.

So, let's put this issue aside for now until that we actually hit another problem using the existing igprof installed with gcc-4.9.3a on target profiling applications with the latest release of LArTest/Dune build with gcc-6.3.0.

#7 Updated by Lynn Garren almost 3 years ago

  • % Done changed from 0 to 10

I was able to build igprof for SL7 using the same procedure as used by CMS. This is the head of the repository, which is at least a year old. We are using an explicit commit. Because there is no new tag, this release is v5_9_16b.
http://scisoft.fnal.gov/scisoft/packages/igprof/v5_9_16b/

#8 Updated by Soon Jun over 2 years ago

  • % Done changed from 10 to 100

An instruction how to use igprof for typical LarSoft/(Proto)Done work flows is available at
https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/ProtoDUNE_and_DUNE_Far_Detector_simulation_and_reconstruction_workflows_(v06_57_00)

#9 Updated by Soon Jun over 2 years ago

  • Status changed from Assigned to Closed

Katherine Lato wrote:

Consulting with LArSoft,
- provide Open Speed Shop, IgProf documentation
- Have them available via UPS/UPD

Note, have some words on a redmine page already:
https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/_igprof_profiler
and an instruction how to use igprof for typical LarSoft/(Proto)Done work flows is available at
https://cdcvs.fnal.gov/redmine/projects/larsoft/wiki/ProtoDUNE_and_DUNE_Far_Detector_simulation_and_reconstruction_workflows_(v06_57_00)



Also available in: Atom PDF