Pith. sign in

REVIEW 3 cited by

Information-theoretic bounds for exact recovery in weighted stochastic block models using the Renyi divergence

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1509.06418 v1 pith:L7D65NLD submitted 2015-09-21 cs.IT cs.SImath.ITmath.STstat.TH

classification cs.ITcs.SImath.ITmath.STstat.TH
keywords divergencerenyiedgeblockdistributionslikelihoodmaximummodels
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

We derive sharp thresholds for exact recovery of communities in a weighted stochastic block model, where observations are collected in the form of a weighted adjacency matrix, and the weight of each edge is generated independently from a distribution determined by the community membership of its endpoints. Our main result, characterizing the precise boundary between success and failure of maximum likelihood estimation when edge weights are drawn from discrete distributions, involves the Renyi divergence of order $\frac{1}{2}$ between the distributions of within-community and between-community edges. When the Renyi divergence is above a certain threshold, meaning the edge distributions are sufficiently separated, maximum likelihood succeeds with probability tending to 1; when the Renyi divergence is below the threshold, maximum likelihood fails with probability bounded away from 0. In the language of graphical channels, the Renyi divergence pinpoints the information-theoretic capacity of discrete graphical channels with binary inputs. Our results generalize previously established thresholds derived specifically for unweighted block models, and support an important natural intuition relating the intrinsic hardness of community estimation to the problem of edge classification. Along the way, we establish a general relationship between the Renyi divergence and the probability of success of the maximum likelihood estimator for arbitrary edge weight distributions. Finally, we discuss consequences of our bounds for the related problems of censored block models and submatrix localization, which may be seen as special cases of the framework developed in our paper.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Feature Learning in Linear-Width Two-Layer Networks: Two vs. One Step of Gradient Descent

    stat.ML 2026-05 unverdicted novelty 7.0 of 10

    Two steps of gradient descent on first-layer weights in linear-width two-layer networks produce a spiked random matrix with floor(alpha2/(1/2-alpha1)) outliers, each a learned direction, and batch reuse allows capturi...

  2. Community Detection for Contextual-LSBM: Theoretical Limitations of Misclassification Rate and Efficient Algorithms

    stat.ML 2025-01 conditional novelty 6.0 of 10

    For the contextual labeled stochastic block model, any community detection algorithm must misclassify at least about n exp(-nD) nodes in expectation, where D combines network and attribute divergences, and the propose...

  3. Community Detection with Heterogeneous Block Covariance Model

    stat.ML 2024-12 conditional novelty 6.0 of 10

    The paper proposes a degree-corrected, signed block covariance model for feature clustering, with a variational EM algorithm and a proof that community memberships are consistently estimable.

Pith tools