Residual Test for the Third Gravitational-Wave Transient Catalog
Pith reviewed 2026-05-18 16:05 UTC · model grok-4.3
The pith
Subtracting best-fit waveforms from third gravitational-wave catalog events leaves residuals consistent with instrumental noise.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By subtracting the best-fit waveform from the data and applying goodness-of-fit tests including the Kolmogorov-Smirnov test, the Anderson-Darling test and the chi-squared test, the residuals of events in the third gravitational-wave transient catalog show no statistically significant deviation from the instrumental noise.
What carries the argument
The residual signal after subtracting the best-fit theoretical waveform template from the observed data, tested for consistency with noise using statistical goodness-of-fit tests.
If this is right
- The waveform templates used for detection match the observed signals well for the tested events.
- The catalog events do not show evidence of unaccounted signals or noise mismatches in their residuals.
- The test provides a computationally inexpensive way to validate fits without needing multiple detectors.
Where Pith is reading between the lines
- This approach could be routinely applied to new loud events to quickly verify template accuracy.
- Extensions might include testing for specific types of deviations, such as those from alternative gravity theories.
- If applied to future, more sensitive detectors, it could help identify when waveform models need improvement for higher signal-to-noise ratios.
Load-bearing premise
The best-fit waveform template accurately captures the true gravitational wave signal so that any mismatch appears in the residuals.
What would settle it
Finding a statistically significant deviation from the expected noise distribution in the residuals of one or more loud events would indicate inconsistency between the data and the templates.
read the original abstract
The residual test is commonly used to check the agreement between the gravitational wave signal and the theoretical waveform template. The basic idea of the residual test is to subtract the best-fit waveform from the data and then check whether the remaining data (i.e., the residuals) are consistent with the instrumental noise or not. We apply the Kolmogorov-Smirnov test, the Anderson-Darling test and the chi-squared test as goodness-of-fit test to examine the residuals of events in the third gravitational-wave transient catalog and find no statistically significant deviation from the noise. Although our method is sensitive only to the loud events, it does not rely on the cross-correlation between detectors. A single-detector event suffices for our residual analysis, and the test is simple and computationally inexpensive.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript applies a residual test to events from the third gravitational-wave transient catalog (GWTC-3). Best-fit waveform templates are subtracted from the strain data, after which Kolmogorov-Smirnov, Anderson-Darling, and chi-squared goodness-of-fit tests are performed on the residuals to assess consistency with instrumental noise. The authors report no statistically significant deviations and note that the approach works for single-detector events and is computationally inexpensive.
Significance. If the goodness-of-fit tests are correctly calibrated, the work supplies a straightforward, cross-correlation-independent consistency check between observed signals and theoretical templates. This is potentially useful for validating loud events in future catalogs. The method's simplicity and single-detector applicability are clear strengths.
major comments (1)
- [description of the residual test and statistical analysis] The central claim that the residuals show no statistically significant deviation from noise rests on the direct application of the KS, AD, and chi-squared tests. These tests assume a fixed model, yet the best-fit waveform is obtained by maximizing the likelihood over the same data, reducing the effective degrees of freedom. The manuscript provides no Monte Carlo calibration of the null distribution, no adjusted critical values, and no discussion of this effect. This issue is load-bearing for the reported p-values and conclusion.
minor comments (2)
- [abstract and methods] The abstract and methods should explicitly state the event selection criteria, the noise model assumed for each detector, and how non-stationary noise segments are handled.
- [methods] Clarify whether the tests are applied to whitened residuals or raw residuals and specify the frequency band or time window used for each event.
Simulated Author's Rebuttal
We thank the referee for their careful reading and constructive criticism of our manuscript. We address the single major comment below.
read point-by-point responses
-
Referee: The central claim that the residuals show no statistically significant deviation from noise rests on the direct application of the KS, AD, and chi-squared tests. These tests assume a fixed model, yet the best-fit waveform is obtained by maximizing the likelihood over the same data, reducing the effective degrees of freedom. The manuscript provides no Monte Carlo calibration of the null distribution, no adjusted critical values, and no discussion of this effect. This issue is load-bearing for the reported p-values and conclusion.
Authors: We agree that the standard critical values and p-value interpretations for the KS, AD, and chi-squared tests are derived under the assumption of a fixed model with no estimated parameters. Because the waveform template is obtained by maximizing the likelihood on the same data, the effective number of degrees of freedom is reduced and the null distribution of the test statistics is altered. The original manuscript applied the tests without explicit calibration or discussion of this point. In the revised manuscript we will add a dedicated subsection that (i) states this limitation explicitly, (ii) reports the results of Monte Carlo simulations in which synthetic signals are injected into realistic noise, the best-fit parameters are recovered, and the residuals are then subjected to the three tests, and (iii) provides either adjusted critical values or a mapping from observed test statistics to calibrated p-values. These additions will make the statistical interpretation of our results more rigorous while preserving the original finding that no significant deviations are observed. revision: yes
Circularity Check
No circularity: direct application of standard statistical tests to residuals
full rationale
The paper performs an empirical residual analysis by subtracting the best-fit waveform template from GW strain data and then applying the Kolmogorov-Smirnov, Anderson-Darling, and chi-squared goodness-of-fit tests to check consistency with instrumental noise. No derivation chain exists that reduces a claimed result to its own inputs by construction, nor are any predictions or first-principles outputs equivalent to fitted parameters. The procedure relies on external, well-established statistical tests whose null distributions are independent of the present work; the central claim is simply the outcome of these tests on catalog events. No self-citations, ansatzes, or uniqueness theorems are invoked in a load-bearing way. This matches the default expectation of a self-contained empirical study with no circularity.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Instrumental noise is stationary and can be modeled as Gaussian for the purpose of the chosen goodness-of-fit tests
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We apply the Kolmogorov-Smirnov test, the Anderson-Darling test and the chi-squared test as goodness-of-fit test to examine the residuals of events in the third gravitational-wave transient catalog and find no statistically significant deviation from the noise.
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
A. G. Abacet al.(LIGO Scientific, VIRGO, KAGRA), (2025), arXiv:2508.18080 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[2]
B. P. Abbottet al.(LIGO Scientific, Virgo), Phys. Rev. X9, 031040 (2019), arXiv:1811.12907 [astro-ph.HE]
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[3]
R. Abbottet al.(LIGO Scientific, Virgo), Phys. Rev. X11, 021053 (2021), arXiv:2010.14527 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2021
-
[4]
R. Abbottet al.(LIGO Scientific, VIRGO), Phys. Rev. D109, 022001 (2024), arXiv:2108.01045 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[5]
R. Abbottet al.(KAGRA, VIRGO, LIGO Scientific), Phys. Rev. X13, 041039 (2023), arXiv:2111.03606 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2023
- [6]
-
[7]
D. Daviset al.(LIGO), Class. Quant. Grav.38, 135014 (2021), arXiv:2101.11673 [astro-ph.IM]
-
[8]
S. Soniet al.(LIGO), Class. Quant. Grav.42, 085016 (2025), arXiv:2409.02831 [astro-ph.IM]
-
[9]
J. Powell, Class. Quant. Grav.35, 155017 (2018), arXiv:1803.11346 [astro-ph.IM]
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[10]
Mitigation of the instrumental noise transient in gravitational-wave data surrounding GW170817
C. Pankowet al., Phys. Rev. D98, 084016 (2018), arXiv:1808.03619 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2018
- [11]
-
[12]
J. Merritt, B. Farr, R. Hur, B. Edelman, and Z. Doctor, Phys. Rev. D104, 102004 (2021), arXiv:2108.12044 [gr-qc]
- [13]
-
[14]
S. Hourihane, K. Chatziioannou, M. Wijngaarden, D. Davis, T. Littenberg, and N. Cornish, Phys. Rev. D106, 042006 (2022), arXiv:2205.13580 [gr-qc]
- [15]
- [16]
-
[17]
H. Narolaet al., Phys. Rev. D112, 024079 (2025), arXiv:2411.15506 [gr-qc]
-
[18]
Foundations of an effective-one-body model for coalescing binaries on eccentric orbits
T. Hinderer and S. Babak, Phys. Rev. D96, 104048 (2017), arXiv:1707.08426 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[19]
Z. Cao and W.-B. Han, Phys. Rev. D96, 044028 (2017), arXiv:1708.00166 [gr-qc] . – 8 –
work page internal anchor Pith review Pith/arXiv arXiv 2017
- [20]
- [21]
- [22]
- [23]
-
[24]
A. Ramos-Buades, A. Buonanno, M. Khalil, and S. Ossokine, Phys. Rev. D105, 044035 (2022), arXiv:2112.06952 [gr-qc]
-
[25]
H. Wang, Y.-C. Zou, and Y. Liu, Phys. Rev. D107, 124061 (2023), arXiv:2302.11227 [gr-qc]
- [26]
-
[27]
Evidence for eccentricity in the population of binary black holes observed by LIGO-Virgo-KAGRA
N. Gupteet al., (2024), arXiv:2404.14286 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[28]
J. Trenado, T. Andrade, A. Climent, and M. A. Ferrer, (2025), arXiv:2509.05269 [gr-qc]
-
[29]
The influence of the hydrodynamic drag from an accretion torus on extreme mass-ratio inspirals
E. Barausse and L. Rezzolla, Phys. Rev. D77, 104027 (2008), arXiv:0711.4558 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2008
- [30]
- [31]
- [32]
- [33]
- [34]
- [35]
-
[36]
Gravitational waveforms for 2- and 3-body gravitating systems
Y. Torigoe, K. Hattori, and H. Asada, Phys. Rev. Lett.102, 251101 (2009), arXiv:0906.1448 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2009
-
[37]
Gravitational Waves from Periodic Three-Body Systems
V. Dmitraˇ sinovi´ c, M.ˇSuvakov, and A. Hudomal, Phys. Rev. Lett.113, 101102 (2014), arXiv:1501.03405 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2014
-
[38]
About gravitational-wave generation by a three-body system
M. Bonetti, E. Barausse, G. Faye, F. Haardt, and A. Sesana, Class. Quant. Grav.34, 215004 (2017), arXiv:1707.04902 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2017
- [39]
- [40]
-
[41]
A. Samajdar, J. Janquart, C. Van Den Broeck, and T. Dietrich, Phys. Rev. D104, 044003 (2021), arXiv:2102.07544 [gr-qc]
-
[42]
P. Relton and V. Raymond, Phys. Rev. D104, 084039 (2021), arXiv:2103.16225 [gr-qc]
-
[43]
A. Antonelli, O. Burke, and J. R. Gair, Mon. Not. Roy. Astron. Soc.507, 5069 (2021), arXiv:2104.01897 [gr-qc]
- [44]
- [45]
-
[46]
V. A. Kosteleck´ y and M. Mewes, Phys. Lett. B757, 510 (2016), arXiv:1602.04782 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[47]
Signals for Lorentz violation in gravitational waves
M. Mewes, Phys. Rev. D99, 104062 (2019), arXiv:1905.00409 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2019
- [48]
- [49]
- [50]
- [51]
- [52]
-
[53]
Polarizations of gravitational waves in $f(R)$ gravity
D. Liang, Y. Gong, S. Hou, and Y. Liu, Phys. Rev. D95, 104034 (2017), arXiv:1701.05998 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[54]
S. Hou, Y. Gong, and Y. Liu, Eur. Phys. J. C78, 378 (2018), arXiv:1704.01899 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2018
- [55]
-
[56]
Y. Gong, S. Hou, D. Liang, and E. Papantonopoulos, Phys. Rev. D97, 084040 (2018), arXiv:1801.03382 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[57]
S. Capozziello, M. Capriolo, and L. Caso, Eur. Phys. J. C80, 156 (2020), arXiv:1912.12469 [gr-qc]
- [58]
-
[59]
Y.-Q. Dong, Y.-Q. Liu, and Y.-X. Liu, Phys. Rev. D109, 044013 (2024), arXiv:2310.11336 [gr-qc]
-
[60]
Y.-Q. Dong, X.-B. Lai, Y.-Q. Liu, and Y.-X. Liu, Eur. Phys. J. C85, 645 (2025), arXiv:2409.11838 [gr-qc] . – 10 –
-
[61]
N. J. Cornish and T. B. Littenberg, Class. Quant. Grav.32, 135012 (2015), arXiv:1410.3835 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[62]
B. P. Abbottet al.(LIGO Scientific, Virgo), Phys. Rev. Lett.116, 221101 (2016), [Erratum: Phys.Rev.Lett. 121, 129902 (2018)], arXiv:1602.03841 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[63]
B. P. Abbottet al.(LIGO Scientific, Virgo), Phys. Rev. D100, 104036 (2019), arXiv:1903.04467 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[64]
R. Abbottet al.(LIGO Scientific, Virgo), Astrophys. J. Lett.896, L44 (2020), arXiv:2006.12611 [astro-ph.HE]
work page internal anchor Pith review Pith/arXiv arXiv 2020
-
[65]
Abbottet al.(LIGO Scientific, Virgo), Astrophys
R. Abbottet al.(LIGO Scientific, Virgo), Astrophys. J. Lett.900, L13 (2020), arXiv:2009.01190 [astro-ph.HE]
-
[66]
R. Abbottet al.(LIGO Scientific, Virgo), Phys. Rev. D103, 122002 (2021), arXiv:2010.14529 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2021
-
[67]
Tests of General Relativity with GWTC-3
R. Abbottet al.(LIGO Scientific, VIRGO, KAGRA), (2021), arXiv:2112.06861 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2021
-
[68]
M. A. Green and J. W. Moffat, Phys. Lett. B784, 312 (2018), arXiv:1711.00347 [astro-ph.IM]
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[69]
A. B. Nielsen, A. H. Nitz, C. D. Capano, and D. A. Brown, JCAP02, 019 (2019), arXiv:1811.04071 [astro-ph.HE]
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[70]
P. Marcoccia, F. Fredriksson, A. B. Nielsen, and G. Nardini, JCAP11, 043 (2020), arXiv:2008.12663 [gr-qc]
-
[71]
Residuals for Binary Black Hole Events in GWTC-1 Using Chi-squared Tests,
D. Liang, J. Kanner, A. J. Weinstein, S. Ghonge, and Y. Gong, “Residuals for Binary Black Hole Events in GWTC-1 Using Chi-squared Tests,” (2020), LIGO-P2000464
work page 2020
-
[72]
Multiresolution techniques for the detection of gravitational-wave bursts
S. Chatterji, L. Blackburn, G. Martin, and E. Katsavounidis, Class. Quant. Grav.21, S1809 (2004), arXiv:gr-qc/0412119
work page internal anchor Pith review Pith/arXiv arXiv 2004
-
[73]
S. K. Chatterji,The search for gravitational wave bursts in data from the second LIGO science run, Ph.D. thesis, Massachusetts Institute of Technology (2005)
work page 2005
-
[74]
The LSC Glitch Group : Monitoring Noise Transients during the fifth LIGO Science Run
L. Blackburnet al., Class. Quant. Grav.25, 184004 (2008), arXiv:0804.0800 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2008
-
[75]
L. Vazsonyi and D. Davis, Class. Quant. Grav.40, 035008 (2023), arXiv:2208.12338 [astro-ph.IM]
-
[76]
Trovato (Ligo Scientific, Virgo), PoSAsterics2019, 082 (2020)
A. Trovato (Ligo Scientific, Virgo), PoSAsterics2019, 082 (2020)
work page 2020
-
[77]
G. Prattenet al., Phys. Rev. D103, 104056 (2021), arXiv:2004.06503 [gr-qc]
work page internal anchor Pith review Pith/arXiv arXiv 2021
-
[78]
D. M. Macleod, J. S. Areeda, S. B. Coughlin, T. J. Massinger, and A. L. Urban, SoftwareX13, 100657 (2021)
work page 2021
-
[79]
An, Giorn Dell’inst Ital Degli Att4, 89 (1933)
K. An, Giorn Dell’inst Ital Degli Att4, 89 (1933)
work page 1933
-
[80]
Smirnov, The annals of mathematical statistics19, 279 (1948)
N. Smirnov, The annals of mathematical statistics19, 279 (1948)
work page 1948
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.