REVIEW 32 cited by
Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
AIMS. The maximum-likelihood method is the standard approach to obtain model fits to observational data and the corresponding confidence regions. We investigate possible sources of bias in the log-likelihood function and its subsequent analysis, focusing on estimators of the inverse covariance matrix. Furthermore, we study under which circumstances the estimated covariance matrix is invertible. METHODS. We perform Monte-Carlo simulations to investigate the behaviour of estimators for the inverse covariance matrix, depending on the number of independent data sets and the number of variables of the data vectors. RESULTS. We find that the inverse of the maximum-likelihood estimator of the covariance is biased, the amount of bias depending on the ratio of the number of bins (data vector variables), P, to the number of data sets, N. This bias inevitably leads to an -- in extreme cases catastrophic -- underestimation of the size of confidence regions. We report on a method to remove this bias for the idealised case of Gaussian noise and statistically independent data vectors. Moreover, we demonstrate that marginalisation over parameters introduces a bias into the marginalised log-likelihood function. Measures of the sizes of confidence regions suffer from the same problem. Furthermore, we give an analytic proof for the fact that the estimated covariance matrix is singular if P>N.
Forward citations
Cited by 32 Pith papers
-
Primordial Physics in the Nonlinear Universe: Revealing the oscillating halo bias from cosmological collider models
A binning-based IC method yields the first N-body measurements of oscillating halo bias from cosmological collider bispectra, with mass- and assembly-dependent phases fit by peak-background-split theory.
-
Fewer simulations, sharper covariances: Reducing mock covariance noise with Zeldovich approximation control variates
Control variates with Zeldovich mocks reduce covariance matrix variance by up to an order of magnitude on large scales in DESI-like mocks.
-
Nearest Neighbour-Based Statistics for 21cm-Galaxy Cross-Correlations in the Epoch of Reionization
kNN CDF statistics detect 21cm-galaxy cross-correlations more effectively than two-point methods and distinguish reionization models at fixed ionized fraction even with noise and foregrounds.
-
Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis
A data-vector-level systematic covariance from HOD variations is proposed for DESI full-shape fits, validated against parameter-level methods, and found to have minimal impact on DESI DR1 cosmological posteriors.
-
Weighted Webs: Morphology-Informed Marked Fields
Morphology-based marks (tidal shear and local fractal dimension) add a modest but complementary ~10% Fisher-information gain over density-only marked power spectra for cosmological parameters.
-
Testing the Isotropy of the Universe with the CHIME/FRB Catalog I
A 536-burst CHIME FRB sample shows no statistically significant directional anisotropy, though the test's constraining power is limited.
-
Climbing the $N$-point Ladder Part I: Information in the Higher-Order Configuration-Space Clustering of Dark Matter Halos
On Quijote halos the config-space 3PCF supplies most higher-order Fisher information (especially on σ8 and Mν) while the connected 4PCF adds a robust further ~1.4–1.5× tightening.
-
Multipolar structure of the local expansion rate from incomplete sky data
CF4 data yield a 3.3σ excess dipole in the local expansion-rate fluctuation field at (l,b)=(290°,-4°)±5°, sourced mainly by z∈[0.03,0.05], with quadrupole/octupole consistent with ΛCDM and no multipole-vector alignments.
-
The 3D clustering of Lyman Alpha Emitters measured with DESI
DESI LAE clustering measurements give a linear bias of 2.31-2.62 with constraints on radiative transfer effects and halo occupation from correlation functions and power spectra.
-
(The) Wiggles going non-linear
N-body simulations calibrate a one-parameter damping model that predicts the non-linear matter power spectrum from wiggly primordial spectra to sub-percent accuracy when wiggle frequency is high enough.
-
DESI DR2 Baryon Acoustic Oscillations from the Lyman Alpha Forest Multipoles
A Legendre-multipole BAO analysis of the DESI DR2 Lyα forest yields αiso=0.9997±0.0096 and αAP=0.9986±0.0276, consistent with the baseline, using an unsmoothed positive-definite covariance.
-
SPT-3G D1: A Measurement of Secondary Cosmic Microwave Background Anisotropy Power
SPT-3G's 2019–2020 spectra at ell=1700–11000 give D_tSZ=4.91±0.37 μK^2 and D_kSZ=1.75±0.86 μK^2 at ell=3000 (free-CIB model) and a 95% limit Δz_re<3.8 on the reionization duration.
-
Parity-odd Four-Point Correlation Function from DESI Data Release 1 Luminous Red Galaxy Sample
The parity-odd four-point correlation function measured in DESI DR1 LRGs is consistent with zero after correcting for survey-induced covariance mismatches.
-
Cosmic Shear constraints from HSC Year 3 with clustering calibration of the tomographic redshift distributions from DESI
Reanalysis of HSC Y3 cosmic shear with DESI clustering redshift calibration yields S8 = 0.805 ± 0.018, a 1.8× error reduction and upward shift toward Planck cosmology.
-
The Compressed 3D Lyman-Alpha Forest Bispectrum
The Lyman-alpha forest bispectrum can be compressed into 26 skew spectra, including a new shifted variant, with tree-level EFT predictions matching simulations at 1-2 sigma up to k≈0.17 h/Mpc.
-
Probing the limits of cosmological information from the Lyman-$\alpha$ forest 2-point correlation functions
Using idealized synthetic data, knowing the true continuum in Lyα forest auto- and cross-correlations reduces uncertainties on the AP parameter and Ω_m by ~10%, with extension to 240 h^{-1}Mpc scales adding up to ~15%...
-
Planck constraints on the scale dependence of isotropic cosmic birefringence
Planck polarization data favor a constant cosmic birefringence angle (β≈0.3°) across multipoles, with scale dependence consistent with zero at up to 1.8σ.
-
Cosmology and Source Redshift Constraints from Galaxy Clustering and Tomographic Weak Lensing with HSC Y3 and SDSS using the Point-Mass Correction Model
Galaxy clustering plus weak lensing from HSC Y3 and SDSS gives S8 = 0.780 ± 0.030 and lensing-only redshift offsets Δz3 = -0.112, Δz4 = -0.185.
-
CMB-S4: Foreground-Cleaning Pipeline Comparison for Measuring Primordial Gravitational Waves
For simulated CMB-S4 South Pole observations, three foreground-cleaning pipelines give comparable r constraints on simple foregrounds, but extended residual marginalization is needed to remove complex-foreground biase...
-
Tuning the cosmic instrument: robust cosmology through combined probes
Low-redshift large-scale structure data pull the dark-energy equation-of-state posterior toward a cosmological constant and yield S8=0.777±0.017.
-
Window convolution of the galaxy clustering bispectrum
A full window-convolution pipeline for the galaxy bispectrum in the TripoSH basis, implemented as a single window matrix and validated against DESI DR1 mocks.
-
DESI 2024 V: Full-Shape Galaxy Clustering from Galaxies and Quasars
DESI DR1 full-shape galaxy clustering constrains Omega_m = 0.296 ± 0.010, H0 = 68.63 ± 0.79 km/s/Mpc, and sigma_8 = 0.841 ± 0.034, consistent with LambdaCDM and Planck.
-
Constraints on local primordial non-Gaussianity with 3d Velocity Reconstruction from the Kinetic Sunyaev-Zeldovich Effect
The first 3D kSZ velocity reconstruction yields a 7.2-sigma galaxy-velocity cross-correlation and a constraint fNL = -90 +210 -350, still consistent with zero.
-
Modeling and measuring the anisotropic halo 3-point correlation function: a coordinated study
Novel implementation of anisotropic 3PCF model and estimator tested on 298 halo catalogs shows degeneracy breaking between f and b1 in 3PCF-only analysis but limited added value in joint 2PCF+3PCF due to tree-level mo...
-
Toward a robust inference method for the galaxy bispectrum: likelihood function and model selection
For dark matter halos at z=1, a tree-level three-parameter bias model with Poissonian shot noise describes the halo bispectrum up to k about 0.08 h/Mpc, and Bayesian model selection disfavours local Eulerian and Lagra...
-
meer21cm: an Analysis Pipeline and Comprehensive Toolkit for HI Intensity Mapping
meer21cm is a publicly available Python toolkit for post-calibration analysis of single-dish HI intensity mapping surveys, achieving percent-level accuracy on simulated MeerKAT data in the k range 0.02-0.2 h/Mpc.
-
Cosmology-dependent covariance in galaxy cluster number counts: consequences for parameter inference
Fixing the covariance at an incorrect cosmology in cluster count analyses leaves Ω_c, σ_8, and w estimates unbiased but distorts their uncertainties, driven by S_8 amplitude effects; a single update at the recovered b...
-
Revisiting the 'Lensing is Low' Problem with UNIONS
New UNIONS galaxy-galaxy lensing data around CMASS galaxies indicates no significant lensing is low problem, with joint HOD fits to GGL and GC favoring a slightly lower matter power spectrum amplitude than Planck.
-
Counting voids and filaments: Betti Curves as a Powerful Probe for Cosmology
Betti curves from persistent homology of large-scale structure provide complementary cosmological constraints on ns, sigma8, and Om, with tighter bounds when analyzed jointly with the power spectrum.
-
Modelling Galaxy Clustering and Tomographic Galaxy-Galaxy Lensing with HSC Y3 and SDSS using the Point-Mass Correction Model and Redshift Self-Calibration
Combining SDSS clustering with HSC Y3 galaxy-galaxy lensing, with a point-mass correction down to 2 Mpc/h, gives S8 = 0.804 ± 0.051 and self-calibrated redshift shifts for the two highest source bins.
-
Constraints on primordial non-Gaussianity from Quaia
Reports f_NL = -20.5^{+19.0}_{-18.1} (68% CL) from combined Quaia quasar auto-correlation and CMB lensing cross-correlation assuming p_phi=1, or -28.7^{+26.1}_{-24.6} for p_phi=1.6.
-
Tracing Large-scale Structure with the MeerKLASS On-the-Fly Survey: Angular Clustering of Radio Sources at 816 MHz
First measurement of angular clustering w(theta) for radio sources at 816 MHz over 800 deg2 yields positive signal and effective bias 1.53-2.0 depending on N(z) prior.
Discussion (0). Continue with ORCID to comment.