Dual image catalog association » History » Version 26
Dual image object association¶
work by Eric Suchyta, Eric Huff, Peter Melchior
In Balrog tests, we found a population of objects, for which the simulated and recovered properties are strongly discrepant, e.g. a simulated galaxy with true magnitude 26 that is measured at mag 22. Using the tile viewer, we could confirm that the brighter object actually does exists. However, the positional offsets between the input coordinates of the mock object and those measured by SExctractor had excursions up to dozens of arcmin. This behavior persists in catalogs even when blends are excluded (flags = 0). So the problem is that distinct objects are associated.
For the coadd catalogs, SExtractor runs in dual image mode, using the riz coadd as detection image. This is different from using the association mode, which requires a reference catalog and performs objects matching in catalog space. Instead, dual image mode simply performs the measurements in the analysis image on the set of pixels (for each object) found in the detection image, basically a sort of forced photometry with a fixed aperture. To be abundantly clear: In dual image mode, no cutoff criterion for object association is considered (such as the default 2 pixels centroid offsets), meaning that potentially very distant objects end up being associated with each other.
Here are the plots for positional offsets between g and r, r and i, r and z from DESDM...
Histograms of differences between g- and i-band positions in Y1A1_coadd_objects table. Catalogs are cut to remove anything with flags_g >0 and flags_i > 0. All three histograms are normalized to integrate to unity. The cumulative distribution, right, shows that ~5% of the Y1A1 coadd objects have astrometric g-i offsets greater than 1".
The figures below provide evidence of the effects on the photometry.
But how can such associations be made? A very old bug in SExtractor results in the presence of disjoint pieces of the segmentation map that are assigned to one object. For instance, the red object in the segmentation map has the same ID 234200 for the big object and the tiny speck below it:
riz detection image from the v4 SV pointed cluster coadd of Bullet, which employed a very setup very similar to DESDM
But since they are obviously not the same object, the dual image mode will force the analysis to utilize pixels that actually belong to two independent objects. This will have undesired consequences for photometry (among other parameters), effectively introducing additional scatter from merging two independent objects. The piece of code in SExtractor that causes the merging is in the clean function. Particularly line 121 in clean.c of the v2.18.10 code base states that the spatial distance for merging is set by 10 times the sum of the semi-major axes of both objects, which can be a very large reach for a big galaxy. Since such galaxies are rare, large offsets should be rare (and considering the plots above: they are).
Regardless of mechanism, the cross-band identification failures indicated by these large positional offsets have significant effects on DES photometry. The plots below show correlations between astrometric offset and magnitude measurements. We chose to compare g- and i-band photometry because g is not included in the riz detection image coadd. For all of the plots below, we have used the entire SVA1 coadd object table, excluded only things with SExtractor flags > 0 in the g or i bands.
Joint distribution of g-i position differences in SVA1_coadd_objects table and measured galaxy g- and i-band model, detmodel, and auto magnitudes. Vertical red lines are drawn at 1" offsets. Similar effects appear in the Y1A1 table.
Joint distribution of g-i position differences in SVA1_coadd_objects table and measured galaxy g-i colors, measured using mag_auto. Red line shows the median g-i color for this sample. Note especially the flare outwards in the envelope of the full distribution once astrometric offsets approach 1". Similar effects appear in the Y1A1 table.
Finally, we show here a map of the mean spatial distribution of g-i astrometric offsets in cells, for everything in SVA1_COADD_OBJECTS; the color scale is log10 (Euclidean, L2 norm) g and i separation on the survey footprint.
Examples of 10 arcmin offsets in the coadd catalogs¶
There's a tiny speck in the z-band at that location that may have been detected, but how SExtractor could have associated these two is really difficult to comprehend.
If we continue to work under the assumption that this is caused by the "disjoint segmentation map bug" then this position actually would only accidentally correspond to an object. Instead, the other fragment from the segmap would move the centroid somewhere along the line between the parent object and the merged fragment. However, this would mean that the fragment needs to be ~20 arcmin away.
I've also seen cases, where the two locations correspond to two real, but certainly distinct objects. Again, without knowing what SExtractor detected, it is not certain what to make of such cases, they could be entirely accidental.
Eli asked a good question, which is whether position offsets we're seeing are actually affecting the magnitude measurements. To test this, I cut to objects with g- and i-band magnitudes both brighter than 22.5 (none of these should be marginal detections). The plot below shows the joint magnitude-offset distribution of objects in this category.
Note that the tail to very high offsets persists.