Project

General

Profile

History

back: des_balrog_y3

Balrog Sanity Check Testing

Seed tests, Grid tests, SOF/MOF in Base Balrog vs. Y3 Gold SOF/MOF

Note that more plots can be found in: /data/des71.a/data/mspletts/balrog_validation_tests/outputs/{name_of_test}/{match_type}/{tile}/{realization}/plots/
where {name_of_test} is, for example, grid_bkg, grid_bkg_noise, etc.; see 'Location' below each heading.

Flag Cuts

The following flags are considered: flags and cm_flags, with exceptions listed below.

For Y3 Gold catalogs, FLAGS_GOLD replaces flags and {SOF/MOF}_CM_FLAGS replaces cm_flags. In addition, the following flags are examined: SEXTRACTOR_FLAGS_{GRIZ}, IMAFLAGS_ISO_{GRIZ}, and, if a Y3 catalog is compared to a MOF catalog, MOF_CM_MOF_FLAGS.

Star truth catalogs do not contain any flags.

Coadd catalogs have a FLAGS header and do not have a cm_flags header (or equivalent).

Error Calculation

Criteria for objects used to calculate error:

1) Objects that have satisfied the above Flag Cuts.
2) Objects in measured catalogs. The error in truth catalogs is not considered; if a truth catalog is used its error is set to zero $(\sigma_{true} = 0)$.
3) Objects with $\Delta M < 3$ where $M$ is magnitude.
4) Objects in bins (bins are described below) containing more than 10 total objects are considered.
5) Eliminate objects with $\Delta M = 37.5$ which corresponds to a negative flux.

The error is computed for each object via $\sigma_{tot_i} = \pm \sqrt{\sigma_{1_i}^2 + \sigma_{2_i}^2}$, where the subscripts refer to the two catalogs used.

  • The error for MOF catalogs and SOF catalogs is calculated for each object using $\sigma_i = 1.08 \times \frac{\sqrt{cm\_flux\_cov\_\{griz\}\_\{griz\}_i}}{cm\_flux\_\{griz\}_i}$
  • The error for Y3 Gold catalogs and coadd catalogs is given by the headers {MOF/SOF}_CM_MAG_ERR_{GRIZ} and MAGERR_AUTO, respectively.

The errors are binned according to the horizontal axis with bins sizes of 0.5 (magnitude).
The minimum and maximum bin bounds are the absolute minimum and maximum of the magnitudes in both catalogs, parsed to integers. If a star truth catalog is used, the bin maximum is forced to 24. If a galaxy truth catalog is used, the bin maximum is forced to 26.
The median of the error in each bin is plotted. This is also the value used for normalization.

Grid Tests

Grid Test no Noise

Location: /data/des61.a/data/kuropat/grid_bkg/

Flags
g: 22/4090
r: 16/4090
i: 16/4090
z: 16/4090

Comments
...

Grid Test with Noise

Location: /data/des61.a/data/kuropat/grid_bkg_noise/

Flags
g: 27/4073
r: 19/4073
i: 20/4073
z: 28/4073

Comments
...

Seed Tests

Seed Test Same Seeds

Location: /data/des61.a/data/kuropat/seed_test_same_seeds/

Flags
g: 58/4681
r: 29/4681:
i: 29/4681
z: 30/4681

Comments
...

Seed Test Same Seeds1

Location: /data/des61.a/data/kuropat/seed_test_same_seeds1/

Flags
g: 60/4681
r: 29/4681
i: 29/4681
z: 30/4681

Comments
...

Seed Test New Seeds

Location: /data/des61.a/data/kuropat/seed_test_new_seeds/

Flags
g: 61/4681
r: 29/4681
i: 29/4681
z: 30/4681

Comments
...

Seed Test Base

Location: /data/des61.a/data/kuropat/seed_test_base/

Flags
g: 60/4681
r: 29/4681
i: 29/4681
z: 30/4681

Comments
...

Base Balrog versus Y3 Gold 2.0

Base SOF vs Y3 Gold 2.0

Location of SOF catalog: /data/des71.a/data/kuropat/des2247-4414_sof/

Note that 'Base' catalogs are not Balrog-injected.

"Base" Balrog versus Y3 Gold 2.2

Note that the Base Balrog catalogs were not saved in /data/des41.b/data/Balrog/COSMOS_HEX/ so we are using the injected catalogs as "Base".

"Base" MOF vs Y3 Gold 2.2

Location of MOF catalogs: /data/des41.b/data/Balrog/COSMOS_HEX/

Single tile: DES0220-0207

Total objects in both catalogs: 39,418
Total objects unique to Balrog-injected MOF: 10,619 (~10,000 injected objects)
Total objects unique to Y3 Gold 2.2: 1,124
'Total' reflects that flagged objects have not been removed from the numbers above.

Number of objects clipped in N-sigma clip / number of objects considered in N-sigma clip:
g-band: 925 / 26,132
r-band: 993 / 26,419
i-band: 969 / 26,420
z-band: 938 / 26,360

Stacked tiles: 55

Total objects in both catalogs: 1,878,452
Total objects unique to Balrog-injected MOF: 568,496 (~550,000 injected objects)
Total objects unique to Y3 Gold 2.2: 52,289
'Total' reflects that flagged objects have not been removed from the numbers above.

Number of objects clipped in N-sigma clip / number of objects considered in N-sigma clip:
g-band: 47,776 / 1,297,865
r-band: 48,337 / 1,313,724
i-band: 47,632 / 1,313,961
z-band: 44,076 / 1,311,147

"Base" SOF vs Y3 Gold 2.2

Location of SOF catalogs: /data/des41.b/data/Balrog/COSMOS_HEX/

Single tile: DES0220-0207

Total objects in both catalogs: 39,418
Total objects unique to Balrog-injected MOF: 10,619 (~10,000 injected objects)
Total objects unique to Y3 Gold 2.2: 1,124
'Total' reflects that flagged objects have not been removed from the numbers above.

Number of objects clipped in N-sigma clip / number of objects considered in N-sigma clip:
g-band: 1,791 / 33,882
r-band: 1,799 / 34,254
i-band: 1,762 / 34,238
z-band: 1,780 / 34,234

Stacked tiles: 55

Total objects in both catalogs: 1,878,452
Total objects unique to Balrog-injected MOF: 568,496 (~550,000 injected objects)
Total objects unique to Y3 Gold 2.2: 52,289
'Total' reflects that flagged objects have not been removed from the numbers above.

Number of objects clipped in N-sigma clip / number of objects considered in N-sigma clip:
g-band: 84,929 / 1,631,201
r-band: 84,479 / 1,650,141
i-band: 83,155 / 1,650,288
z-band: 80,555 / 1,647,518