Histograms in shared memory
I am developing software for monitoring data quality from out DAQ. The process will look at events with a very high duty factor and make sets of summary plots. As the producer job must run with high duty cycle, the application is split into two parts: a producer that makes and fills the histograms and a viewer that shows the histograms to the shifter who views them in the control room. Communication of the histograms between these two is accomplished in my prototype by storing them in shared memory using the ROOT TMapFile class. It would be very convenient if the ART framework provided a mechanism for sharing histograms between two jobs via shared memory or by some other means.
#2 Updated by Mark Messier over 7 years ago
I was wondering if I could get a status update on this? We are actively developing the NOvA online monitoring using ROOT's TMapFile and link to ROOT's -lNew. The interaction between this and ART seems unstable: Updates to the TMapFile regularly seg. fault in the ART context but similar usage in bare ROOT sessions are stable. If this service were available in ART now we would start using it today.
#4 Updated by Christopher Green over 7 years ago
An email I sent 2012/07/02:
On 6/30/12 2:28 PM, Mark Messier wrote:
I was wondering if there has been any progress on sharing root histograms via shared memory (or by any other mechanism). My student and I have been developing the new ART based online monitoring and are at the point where we need this. We tried using roots MemoryMap but linking to libNew reliably causes seg. faults as you warned. Right now we are using disk resident files to exchange histograms but that has very high latency.
Thanks for any info you can provide.
Coincidentally, we had an all-day meeting last week to understand current and outstanding art tasks both for mainstream art and our "artdaq" efforts. After further discussing with Marc, we think that a naive implementation of (eg) TH1's in shared memory would almost certainly have many problems and at the least be very fragile. With that in mind, I think it would be very useful for us to get together and understand exactly what it is that you want from this feature in terms of functionality so we can come up with a solution for you that not only does everything you need it to do, but also isn't fragile or too complex due to having unnecessary features or flexibility.
I have cc:'d the artists list because coming up over the next few weeks are several vacations within our group, some of which overlap: Jim is out this week, I am out from Wed through the end of next week, and Marc leaves toward the end of net week for a couple of weeks. In general, but certainly over Summer, it is to your advantage to correspond with us via the artists or art-users lists or using the issue tracker: that way someone should see and respond to your message.
I have a couple of questions for you to consider until we get to have our meeting to enable us better to work towards something that will satisfy your needs:
- What is the priority of this relative to the EventDisplay work and the ability to decide whether to run an analyzer based on filter results?
- One consumer or multiple?
- Constant access to coherent data or periodic?
- What data do you need to share in this way? Just histograms or other things in addition? Shared memory has severe restrictions on what can be placed there (no pointers, no polymorphic classes, for instance), so almost any ROOT entity will need some kind of special handling, such as serialization. It's possible however, that there is a solution which fits your needs which isn't shared memory in this case.
#5 Updated by Mark Messier over 7 years ago
Here are my answers and a few additional questions:
1. We will need this by about November of this year when we will be bringing up the detector. I would rank it higher than the event display which has been in its current state for so long that we've gotten used to it (although we would still very much like to have real interactive capabilities) and the filter which has work-a-rounds in the current framework.
3. Not sure what this is asking. I guess the answer is periodic, but the frequency of access could be high and the latency must be much better than disk access which is what we are using now as a work-a-round.
4. For the monitoring I would like to push histograms and a small custom ROOT object summarizing the producer status.
I'm open to non-shared memory solutions, but as it happened there was a shared memory solution built into ROOT which we used to be able to use out-of-the-box which met our needs; hence my framing of the feature in terms of shared memory.