REVIEW 6 cited by
Survey on Algorithms for multi-index models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We review the literature on algorithms for estimating the index space in a multi-index model. The primary focus is on computationally efficient (polynomial-time) algorithms in Gaussian space, the assumptions under which consistency is guaranteed by these methods, and their sample complexity. In many cases, a gap is observed between the sample complexity of the best known computationally efficient methods and the information-theoretical minimum. We also review algorithms based on estimating the span of gradients using nonparametric methods, and algorithms based on fitting neural networks using gradient descent
Forward citations
Cited by 6 Pith papers
-
Approximate Message Passing with Random Initialization for Phase Retrieval
Randomly initialized Bayes-optimal AMP provably achieves the weak-recovery threshold δ=1/2 and arbitrarily accurate recovery for δ>1.13 in proportional-regime noiseless phase retrieval.
-
Feature Learning for the High Dimensional Stationary Sch\"odinger Equation with Deep Ritz Method
Gradient descent on single-index and two-neuron models provably recovers feature directions of the Schrödinger equation source term in the deep Ritz framework.
-
Limitations of SGD for Multi-Index Models Beyond Statistical Queries
Vanilla SGD provably fails to learn periodic and low-information-exponent single/multi-index targets unless the input dimension is small or the number of iterations is large.
-
AI4SLT: Empirical Processes in Lean 4 for Formal Statistical Learning Theory
The authors built a roughly 30,000-line Lean 4 library formalizing Gaussian Lipschitz concentration, Dudley's entropy integral, and localized least-squares regression rates.
-
The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Models
For any Gaussian multi-index model, the generative leap exponent k⋆ sharply characterizes the sample complexity of efficient subspace recovery as Θ(d^(1∨k⋆/2)).
-
Joint Learning in the Gaussian Single Index Model
In Gaussian single-index models, joint gradient flow over direction and link function converges to the true regression function from either sign of initial alignment, with rate governed by the information exponent.
Discussion (0). Continue with ORCID to comment.