pith. sign in

arxiv: 1710.02903 · v1 · pith:YDXVF4IRnew · submitted 2017-10-09 · 🧮 math.ST · cs.IT· math.IT· math.PR· stat.TH

Finite Size Corrections and Likelihood Ratio Fluctuations in the Spiked Wigner Model

classification 🧮 math.ST cs.ITmath.ITmath.PRstat.TH
keywords modelratiospikeconstantenergyfluctuationsfreegaussian
0
0 comments X
read the original abstract

In this paper we study principal components analysis in the regime of high dimensionality and high noise. Our model of the problem is a rank-one deformation of a Wigner matrix where the signal-to-noise ratio (SNR) is of constant order, and we are interested in the fundamental limits of detection of the spike. Our main goal is to gain a fine understanding of the asymptotics for the log-likelihood ratio process, also known as the free energy, as a function of the SNR. Our main results are twofold. We first prove that the free energy has a finite-size correction to its limit---the replica-symmetric formula---which we explicitly compute. This provides a formula for the Kullback-Leibler divergence between the planted and null models. Second, we prove that below the reconstruction threshold, where it becomes impossible to reconstruct the spike, the log-likelihood ratio has fluctuations of constant order and converges in distribution to a Gaussian under both the planted and (under restrictions) the null model. As a consequence, we provide a general proof of contiguity between these two distributions that holds up to the reconstruction threshold, and is valid for an arbitrary separable prior on the spike. Formulae for the total variation distance, and the Type-I and Type-II errors of the optimal test are also given. Our proofs are based on Gaussian interpolation methods and a rigorous incarnation of the cavity method, as devised by Guerra and Talagrand in their study of the Sherrington--Kirkpatrick spin-glass model.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Potential Hessian Ascent III: Sampling the Sherrington--Kirkpatrick Model at Beta < 1/2

    math.PR 2026-05 unverdicted novelty 7.0

    A polynomial-time algorithm samples the SK model Gibbs measure with o(1) TVD error for β < 1/2 by combining potential Hessian ascent, stochastic localization, Jarzynski equality, and Glauber dynamics.

  2. Potential Hessian Ascent III: Sampling the Sherrington--Kirkpatrick Model at Beta < 1/2

    math.PR 2026-05 unverdicted novelty 7.0

    Polynomial-time algorithm samples the Sherrington-Kirkpatrick Gibbs measure at beta < 1/2 with o(1) TVD error by combining potential Hessian ascent, stochastic localization, covariance estimates, and Jarzynski equalit...

  3. Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratio

    math.ST 2019-07 unverdicted novelty 6.0

    The low-degree likelihood ratio method predicts computational hardness of hypothesis testing problems, with new connections to spectral methods and a lower bound for tensor PCA.