Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation

Francesco Camilli; Jean Barbier; Mauro Pastore; Minh-Toan Nguyen; Rudy Skerk

REVIEW 3 major objections 4 minor 221 references

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation

T0 review · 3 major / 4 minor · reviewed 2026-08-04 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Statistical physics can now compute the Bayes-optimal learning limit of a deep neural network with width proportional to its input, in the interpolation regime.

desk verdict A serious, mostly honest attack on a hard open problem, with an exactness claim that currently outruns the proof — especially for generic activations with a second Hermite component. read the letter →

arxiv 2510.24616 v5 pith:WOOKY7V5 submitted 2025-10-28 stat.ML cond-mat.dis-nncond-mat.stat-mechcs.ITcs.LGmath.IT

Jean Barbier , Francesco Camilli , Minh-Toan Nguyen , Mauro Pastore , Rudy Skerk This is my paper · ORCID

classification stat.MLcond-mat.dis-nncond-mat.stat-mechcs.ITcs.LGmath.IT MSC 82B4468T07

keywords multi-layerperceptroninterpolationregimeBayes-optimalgeneralizationreplicamethodHCIZintegralfeaturelearningspecialisationtransitionstatisticalphysicsof

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that the optimal (Bayes-optimal) learning of a multi-layer perceptron in the interpolation regime — where widths are proportional to the input dimension and the number of samples is proportional to the square of it — is governed by a replica-symmetric free entropy formula built from a small set of functional overlaps between teacher and student weights. If correct, the theory exactly predicts the minimum achievable generalization error, the amount of data needed to reach it, and the sequence of 'specialisation' transitions through which hidden units align with target features. The analysis covers shallow networks with generic activation functions, two-layer networks with odd activations, and deeper networks under a restricted activation class, and it explains why feature learning outperforms kernels and random features: non-linear terms beyond the linear and quadratic components can only be exploited once the student specialises. A rich phenomenology follows, including layer-wise specialisation propagating from inner to outer layers, neuron-wise inhomogeneity driven by readout amplitudes, and metastable states that trap practical training algorithms.

What carries the argument

The central objects are (i) the Gaussian ansatz on replicated post-activations, which reduces the energetic part to a low-dimensional covariance K*; (ii) the replacement of the conditional law of the quadratic composite S_2 = W^⊤ diag(v0) W by a generalized Wishart prior with an exponential tilt, whose Lagrange multiplier is fixed by matching the moment E[v² Q(v)²] + γ v̄² — this step is the crux that allows the theory to handle matrices that lack rotational invariance; and (iii) the use of HCIZ spherical integrals (and their rectangular counterpart for L=2) to evaluate the entropy of the matrix order parameters. The order parameters themselves — functional overlaps Q(v), Q1(v^(2)), Q2(v, v^

What would settle it

Run a large-d Bayesian sampling (e.g., HMC) of a shallow MLP in the interpolation regime with a generic activation (µ2 ≠ 0) and measure the moment generating function of the student's post-activations on test inputs, as in the paper's FIG. 4. If the relative error between the empirical and theoretical Gaussian MGF does not vanish as d grows — e.g., stays above O(1/√d) — the Gaussian hypothesis (11) is violated and Result 1 cannot hold exactly.

Watch

Extended reading notes

Core claim

Under the Gaussian hypothesis (11) — that the replicated post-activations of teacher and student converge to a jointly Gaussian law with covariance K* — combined with a measure simplification (31) that replaces the true conditional law of the quadratic sufficient statistics by a generalized Wishart prior with exponential tilt fixed by moment matching, the paper derives replica-symmetric formulas (Results 1, 3, 4) for the limiting free entropy of an MLP with L hidden layers in the proportional-width, quadratic-sample regime. The formulas express the free entropy as a variational problem over a few functional order parameters: overlaps labelled by readout amplitudes (and, for L=2, by effective

Load-bearing premise

The load-bearing premise is the Gaussian ansatz (11) — that the replicated post-activations of teacher and student converge to a jointly Gaussian vector with covariance K* — supplemented by the moment-matching replacement of the conditional law of S_2 (31); if either fails, the replica formulas do not follow.

Editorial extensions

If this is right

The Bayes-optimal generalization error for proportional-width MLPs in the interpolation regime is computable by maximizing a low-dimensional RS potential (Results 1–4), giving sharp limits that any algorithm trained on the same data cannot beat.
Feature learning beats kernels and random features because higher-order components of the teacher can only be exploited once the student's weights align (specialise) with those of the target; kernels never specialise, which explains the performance gap shown in FIG. 2.
Specialisation transitions are generically present and can be partial: sub-populations of neurons connected to larger readout amplitudes specialise first, and for L≥2 the transitions are layer-wise, propagating from inner to outer layers.
Deeper targets are harder: the overlap of the l-th layer decreases with layer index, and more data per layer is needed as L grows (FIG. 19).
Algorithms such as HMC, GAMP-RIE and ADAM get trapped in metastable states predicted by the theory; over-parameterisation (wider students) can recover part of the gap but the specialised equilibrium remains exponentially hard to reach in some cases.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

If the Gaussian ansatz extends to mismatched teacher-student settings (as the authors suggest), the same variational formulas could predict how much data a network needs to learn from a different function class, a step toward quantitative scaling laws.
The shallow-to-deep specialisation ordering implies a testable transfer-learning prediction: representations from early layers of a trained network should transfer to new tasks with smaller data budgets than those from deeper layers, because deeper layers need more data to specialise.
The formalism's success suggests that other extensive-rank matrix inference problems lacking rotational invariance, beyond the matrix-sensing problems the paper explicitly names, might be treated by the same replica-plus-HCIZ blend.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The sharpest thing to know: this is a serious attempt at a long-open problem, and it is the first framework I know that puts all four properties P1-P4 together. But the exactness claim for generic shallow activations is not established. Read it as a well-validated conjecture plus explicit hypotheses, not as a theorem, and note that the mu_2 != 0 case has a concrete open question the authors themselves identify.

What is actually new is real. The replica/HCIZ combination is a genuine step beyond matrix-denoising and quadratic-activation settings, and the order parameters they introduce — functional overlaps indexed by readout amplitudes and effective readouts, including the two-argument Q_2(v,v^(2)) — are a useful way to organize the problem. No constants are fitted to data; the saddle-point equations derive from the priors. The numerical validation is extensive and mostly convincing: HMC, Metropolis, GAMP-RIE, and ADAM all line up with the theory across a wide parameter range, and the layer-wise specialisation transitions are a nice, interpretable payoff. For activations with mu_2 = 0, where the matrix integrals drop out, the case is stronger and there is even a partial proof in App. B6. The paper is also unusually honest about its own assumptions.

The soft spots are proportionate to how load-bearing they are. The Gaussian hypothesis (11) is unproved but plausible and directly tested; the diagonal-concentration assumptions (27)-(28) are in the same family as standard Wishart facts, though not proven for posterior samples. The real issue is the measure replacement in Eq. (31): the conditional law of S_2 is replaced by a generalized Wishart measure with one moment-matching condition. That is not derived, and if it fails, Result 1 fails. Remark 4 makes the tension concrete: for sigma(x)=x^2 with PW=N(0,1), which is inside the domain of Result 1, numerical maximization of the RS potential appears to select Q(v)>0 for gamma <= 1, while the rigorous equations of [95] give Q(v)=0 for all parameters. The authors' reply — free-entropy difference under 1% and a flat potential — does not dissolve the problem, because a small free-energy error can shift the maximizer and change predicted specialisation transitions. So the strongest defensible claim is the one the paper itself makes for mu_2 = 0: conjectured exact with strong evidence. For generic activations, exactness should be flagged as open rather than asserted.

Who is this for: statistical physicists working on learning, and ML theorists interested in feature learning at interpolation. It deserves a serious referee — send it out — but the referees should require the generic-activation statements to be softened and the mu_2 != 0 question to be left explicitly open. I would cite it.

Referee Report

3 major / 4 minor

Summary. The paper develops a replica-symmetric statistical physics theory for Bayes-optimal learning of a teacher MLP by a matched student MLP in the proportional-width, interpolation scaling d,k_l,n → ∞ with k_l/d → γ_l and n/d^2 → α. The central results are formulas for the limiting free entropy and order parameters for shallow MLPs (Result 1), two-hidden-layer MLPs (Result 3), and arbitrary-depth MLPs under restrictive hypotheses (Result 4). These formulas determine the Bayes-optimal generalization error (Result 2) and predict layer-wise and neuron-wise specialization transitions. The theory is tested extensively against HMC, Metropolis, GAMP-RIE, and ADAM, and the paper identifies the Gaussian ansatz on replicated post-activations (Eq. (11)) and a moment-matched generalized-Wishart replacement (Eq. (31)) as the main unproved ingredients, with partial proofs for special cases.

Significance. If correct, the paper would be a significant step toward a quantitative theory of feature learning in fully trained, finite-width MLPs in the interpolation regime, going beyond kernel, random-feature, and mean-field limits. The identification of functional order parameters indexed by readout amplitudes and effective readouts gives a concrete, falsifiable picture of how specialization propagates across layers and neurons. Strengths include the absence of fitted constants, the breadth of numerical validation with multiple algorithm families, the direct test of the Gaussian hypothesis in Fig. 4, and the partial proof in App. B6 for μ2 = 0. The phenomenological predictions — e.g., shallow-to-deep propagation of specialization and the difficulty of reaching the specialized state — are interesting and well supported by the simulations. However, the exactness claim for generic shallow activations is not established, and the paper itself documents a concrete tension with a rigorous quadratic-activation result. The safest and most defensible core is the μ2 = 0 shallow case and the deep results under (H2)/(H3), where matrix-integral approximations are absent or less central.

major comments (3)

[Result 1 and Remark 4] Result 1 is stated for arbitrary shallow activations with μ0 = 0, but for μ2 ≠ 0 its derivation relies on replacing the true conditional measure (30) by the moment-matched generalized-Wishart measure (31). This replacement is not derived, and a single moment condition does not determine the large-deviation rate function needed to select the equilibrium order parameters. The paper itself, in Remark 4, reports that for σ(x)=x², which satisfies the hypotheses of Result 1, numerical maximization of the RS potential selects Q(v)>0 for γ≲1 whereas the rigorous equations of [95] give Q(v)=0 for all (α,γ). The response that the free-entropy difference is ≤1% and the potential is flat does not resolve the issue: a small free-energy error can shift the location of the maximizing Q and change the predicted specialization transitions. Since σ=x² is inside the stated domain, Result 1 is not exact as
[Eqs. (27)–(28) and (31)] The diagonal-concentration assumptions on Hadamard powers (27)–(28) and the measure simplification (31) are load-bearing for the entropic potential, not merely technical. The paper states these are assumptions and validates them only a posteriori through the same learning curves the theory is meant to predict. This circularity is particularly acute for the μ2 ≠ 0 shallow case, where the HCIZ integral is evaluated under the simplified measure. The manuscript should either provide a direct test of (27)–(28) at the level of the large-deviation functional (not just of the resulting generalization error), or clearly mark the μ2 ≠ 0 formula as conjectural. Without this, Results 1 and 2 for generic activations such as ReLU cannot be regarded as established.
[Results 3 and 4 / App. C1] The deep-layer results also rely on unproved simplifications, although matrix integrals are absent for L≥3. For L=2, the entropic contribution is evaluated using a relaxation of the conditional law of W^(2:1) with an exponential tilt fixed by moment matching (App. C1). The rectangular spherical integral then gives the result. This is a further instance of the same moment-matching issue: a single overlap moment is matched, but the full measure is replaced by a Gaussian-product base measure. The numerical agreement is good, but the claims of exactness in Remarks 4 and the text for L≥2 should be softened unless a proof strategy or a rigorous check of the measure equivalence is supplied. The paper has a partial proof only for the shallow μ2 = 0 case (App. B6).

minor comments (4)

[Notation around Eq. (10) and Eq. (16)] The symbol K* is used both for the asymptotic off-diagonal covariance in the Gaussian hypothesis and for the evaluated function K(R2*,Q*). This is a potential source of confusion; consider using K∞ for the object in (10).
[Section II A, τ(Q) in Eq. (14)] The definition of τ(Q) via mmse^{-1}_S is terse; the reader must consult App. B1 to see that this is the Lagrange multiplier enforcing the moment condition. A one-sentence intuitive explanation would help.
[Remark 4] The claim that 'the free-entropy difference never exceeds ≈1%' is not documented with a figure or table. Given that the paper makes a quantitative claim about the size of the error, this statement should be backed by a plot of the RS potential versus Q in the problematic γ≲1 regime.
[App. B6] The partial proof for μ2 = 0 is a strength, but the precise hypotheses under which it applies (e.g., bounded activation, finite Hermite support) are not stated in the main text. Please state them explicitly.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: Results 1-4 are explicitly conditional on stated hypotheses, and no fitted quantity is relabeled as a prediction.

full rationale

The paper's central derivations are conditional on two transparently labeled assumptions, and neither reduces to the target quantities. The Gaussian hypothesis (11) is introduced as "our main assumption" and later called "an ansatz we cannot prove"; all replica formulas are stated as consequences of this hypothesis, with the covariance K* obtained self-consistently from saddle-point equations rather than from data. The measure replacement in Eq. (31) is presented as "the simplification we consider," with the Lagrange multiplier tau fixed by the moment-matching condition (32) to the true conditional measure; the resulting saddle-point solution for R2 and Q is not forced to equal that matched moment, and no empirical constant is inserted into the RS potential (15). The numerical validation of the Gaussian ansatz in Sec. III (e.g., Fig. 4) is a self-consistency check rather than a parameter fit to the predicted learning curves; this is an epistemic limitation, not a circular reduction. Remark 4 explicitly concedes a discrepancy with the rigorous quadratic-activation result [95] for the case mu2 != 0 and declines to claim exactness there, while App. B2b flags the HCIZ steps as "possibly approximative." These admissions show that the authors do not treat the ansatz's conclusion as defining its inputs. There is no load-bearing self-citation chain, no imported uniqueness theorem, no fitted input relabeled as a prediction, and no renaming of a known result. Unproved assumptions are correctness/rigor risks, not circularity.

Assumptions & free parameters 0 free parameters · 6 assumptions · 1 invented entities

The ledger shows the central result is not a free fit: no constants are fitted to data, since the priors, activation Hermite coefficients, and scaling ratios are inputs. But the derivation rests on several ansatze internal to the paper, most importantly the Gaussian ansatz and the measure replacement. These are the price paid for tractability; numerical agreement is the only independent check.

assumptions (6)

domain assumption Joint Gaussianity of replicated post-activations (Gaussian ansatz)
Equation (11) assumes (λ_test(θ^a))_a converge to a jointly Gaussian vector with covariance K*. All replica free-entropy formulas rely on this; the paper states it cannot be proved but is validated a posteriori.
domain assumption Diagonal concentration of Hadamard powers of overlap matrices
Equations (27)-(28) assume (Ω^{ab}_{ij})^ℓ ≈ δ_ij Q^{ab}(v)^ℓ for ℓ≥3, discarding off-diagonal terms. This is needed to reduce infinitely many overlap tensors to the few functional order parameters.
ad hoc to paper Measure replacement by generalized Wishart with moment matching
Equation (31) replaces the true conditional law of S_2^a by independent generalized Wishart priors P_S with exponential tilt τ(Q), justified only by matching one moment. This is an ansatz, not derived, and it enables the HCIZ step.
domain assumption Replica symmetry (RS ansatz)
The replica limit s→0 is evaluated under a replica-symmetric ansatz on the order parameters. The paper cites Bayes-optimality/Nishimori identities as justification, but no rigorous proof is given.
domain assumption For L=2, recursive Gaussianity of pre-activations and exact recovery of effective readouts
Section IV B assumes pairs of pre-activations are jointly Gaussian for Mehler expansions, and that the O(k_1) effective readout components v^{(2)} are exactly reconstructible with Θ(d^2) data. Both are structural to the L=2 formulas.
domain assumption For L≥3, activations with µ0=µ1=µ2=0 and recursive diagonal concentration
Hypothesis (H3) and Section IV C assume no linear or quadratic Hermite components, making only full specialization possible, and impose diagonal concentration of g^{(l)}(Ω^{(l)}) at every layer. This excludes standard activations for L≥3.

invented entities (1)

Generalized Wishart matrix S_2^a = W^{a⊤} diag(v0) W^a / √k with effective prior P_S
purpose: Proxy for the true conditional law of quadratic feature tensors; permits HCIZ spherical integration in the replica calculation.
The replacement (31) is an invented tractable measure; its only support is moment matching and subsequent numerical agreement, with no external falsifiable handle.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation." pith.science (2026). https://pith.science/paper/WOOKY7V5

@misc{pith2026251024616,
  author       = {Pith},
  title        = {Pith review of: Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WOOKY7V5}},
  note         = {Machine review of arXiv:2510.24616}
}

read the original abstract

For four decades statistical physics has been providing a framework to analyse neural networks. A long-standing question remained on its capacity to tackle deep learning models capturing rich feature learning effects, thus going beyond the narrow networks or kernel methods analysed until now. We positively answer through the study of the supervised learning of a multi-layer perceptron. Importantly, (i) its width scales as the input dimension, making it more prone to feature learning than ultra wide networks, and more expressive than narrow ones or ones with fixed embedding layers; and (ii) we focus on the challenging interpolation regime where the number of trainable parameters and data are comparable, which forces the model to adapt to the task. We consider the matched teacher-student setting. Therefore, we provide the fundamental limits of learning random deep neural network targets and identify the sufficient statistics describing what is learnt by an optimally trained network as the data budget increases. A rich phenomenology emerges with various learning transitions. With enough data, optimal performance is attained through the model's "specialisation" towards the target, but it can be hard to reach for training algorithms which get attracted by sub-optimal solutions predicted by the theory. Specialisation occurs inhomogeneously across layers, propagating from shallow towards deep ones, but also across neurons in each layer. Furthermore, deeper targets are harder to learn. Despite its simplicity, the Bayes-optimal setting provides insights on how the depth, non-linearity and finite (proportional) width influence neural networks in the feature learning regime that are potentially relevant in much more general settings.

Figures

Figures reproduced from arXiv: 2510.24616 by the authors.

**Figure 1.** FIG. 1. Classification of models of fully connected feed-forward neural networks analysed in the theoretical literature (see [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗

**Figure 2.** FIG. 2. Bayes-optimal mean-square generalisation error [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗

**Figure 3.** FIG. 3. The teacher-student scenario for the case of two hid [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗

Figures from the paper (25 more)

**Figure 4.** Figure 4: FIG. 4. Experimental evidence for the Gaussian hypothe [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]

**Figure 5.** Figure 5: FIG. 5. Theoretical prediction (solid curves) of the Bayes-optimal mean-square generalisation error (with the irreducible error [PITH_FULL_IMAGE:figures/full_fig_p015_5.png]

**Figure 6.** Figure 6: FIG. 6. Theoretical prediction (solid curves) of the Bayes [PITH_FULL_IMAGE:figures/full_fig_p016_6.png]

**Figure 7.** Figure 7: FIG. 7. Theoretical prediction (solid curves) for the equilib [PITH_FULL_IMAGE:figures/full_fig_p017_7.png]

**Figure 8.** Figure 8: FIG. 8. Half Gibbs error of HMC from random initialisa [PITH_FULL_IMAGE:figures/full_fig_p018_8.png]

**Figure 10.** Figure 10: FIG. 10. Generalisation error of different estimators, ini [PITH_FULL_IMAGE:figures/full_fig_p019_10.png]

**Figure 12.** Figure 12: FIG. 12 [PITH_FULL_IMAGE:figures/full_fig_p020_12.png]

**Figure 13.** Figure 13: FIG. 13. Theoretical prediction (green solid curve) of the Bayes-optimal mean-square generalisation error for [PITH_FULL_IMAGE:figures/full_fig_p021_13.png]

**Figure 14.** Figure 14: FIG. 14. Solid and dotted curves represent, respectively, the [PITH_FULL_IMAGE:figures/full_fig_p021_14.png]

**Figure 15.** Figure 15: FIG. 15. Theoretical predictions (solid curves) for the [PITH_FULL_IMAGE:figures/full_fig_p022_15.png]

**Figure 16.** Figure 16: FIG. 16. Heat-maps of all the theoretical equilibrium over [PITH_FULL_IMAGE:figures/full_fig_p023_16.png]

**Figure 18.** Figure 18: FIG. 18. Generalisation errors, computed empirically from [PITH_FULL_IMAGE:figures/full_fig_p024_18.png]

**Figure 19.** Figure 19: FIG. 19. Theoretical predictions for deep NNs with the activation on every layer given by [PITH_FULL_IMAGE:figures/full_fig_p025_19.png]

**Figure 20.** Figure 20: FIG. 20. Hamiltonian Monte Carlo dynamics of the overlaps [PITH_FULL_IMAGE:figures/full_fig_p027_20.png]

**Figure 21.** Figure 21: FIG. 21. Trajectories of [PITH_FULL_IMAGE:figures/full_fig_p043_21.png]

**Figure 22.** Figure 22: FIG. 22. Different theoretical curves and numerical results for ReLU( [PITH_FULL_IMAGE:figures/full_fig_p055_22.png]

**Figure 23.** Figure 23: FIG. 23. Generalisation error for ReLU activation and Rademacher readout prior [PITH_FULL_IMAGE:figures/full_fig_p056_23.png]

**Figure 24.** Figure 24: FIG. 24. Theoretical prediction (solid curves) of the Bayes-optimal mean-square generalisation error for [PITH_FULL_IMAGE:figures/full_fig_p059_24.png]

**Figure 25.** Figure 25: FIG. 25. Semilog ( [PITH_FULL_IMAGE:figures/full_fig_p061_25.png]

**Figure 26.** Figure 26: FIG. 26. Same as in FIG [PITH_FULL_IMAGE:figures/full_fig_p062_26.png]

**Figure 27.** Figure 27: FIG. 27. Trajectories of the generalisation error of neural networks trained with ADAM at fixed batch size [PITH_FULL_IMAGE:figures/full_fig_p062_27.png]

**Figure 28.** Figure 28: FIG. 28. Trajectories of the overlap [PITH_FULL_IMAGE:figures/full_fig_p063_28.png]

**Figure 29.** Figure 29: FIG. 29. Semilog ( [PITH_FULL_IMAGE:figures/full_fig_p064_29.png]

**Figure 30.** Figure 30: FIG. 30 [PITH_FULL_IMAGE:figures/full_fig_p068_30.png]

**Figure 31.** Figure 31: FIG. 31 [PITH_FULL_IMAGE:figures/full_fig_p069_31.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

221 extracted references · 71 canonical work pages

[95]

Xu , author A

author author Y. Xu , author A. Maillard , author L. Zdeborov\'a ,\ and\ author F. Krzakala ,\ https://proceedings.mlr.press/v291/xu25a.html title Fundamental limits of matrix sensing: Exact asymptotics, universality, and applications ( year 2025 ) NoStop

2025
[1]

author author P. L. \ Bartlett , author A. Montanari ,\ and\ author A. Rakhlin ,\ title title Deep learning: a statistical viewpoint ,\ https://doi.org/10.1017/S0962492921000027 journal journal Acta Numerica \ volume 30 ,\ pages 87 ( year 2021 ) NoStop

doi:10.1017/s0962492921000027 2021
[2]

LeCun , author Y

author author Y. LeCun , author Y. Bengio ,\ and\ author G. Hinton ,\ title title Deep learning ,\ https://doi.org/10.1038/nature14539 journal journal Nature \ volume 521 ,\ pages 436 ( year 2015 ) NoStop

doi:10.1038/nature14539 2015
[3]

author author D. J. \ Amit , author H. Gutfreund ,\ and\ author H. Sompolinsky ,\ title title Spin-glass models of neural networks ,\ https://doi.org/10.1103/PhysRevA.32.1007 journal journal Phys. Rev. A \ volume 32 ,\ pages 1007 ( year 1985 ) NoStop

doi:10.1103/physreva.32.1007 1985
[4]

author author E. Gardner ,\ title title The space of interactions in neural network models ,\ https://doi.org/10.1088/0305-4470/21/1/030 journal journal Journal of Physics A: Mathematical and General \ volume 21 ,\ pages 257 ( year 1988 ) NoStop

doi:10.1088/0305-4470/21/1/030 1988
[5]

Gardner \ and\ author B

author author E. Gardner \ and\ author B. Derrida ,\ title title Three unfinished works on the optimal storage capacity of networks ,\ https://doi.org/10.1088/0305-4470/22/12/004 journal journal Journal of Physics A: Mathematical and General \ volume 22 ,\ pages 1983 ( year 1989 ) NoStop

doi:10.1088/0305-4470/22/12/004 1983
[6]

author author H. S. \ Seung , author M. Opper ,\ and\ author H. Sompolinsky ,\ title title Query by committee ,\ in\ https://doi.org/10.1145/130385.130417 booktitle Proceedings of the Fifth Annual Workshop on Computational Learning Theory ,\ series and number COLT '92 \ ( publisher Association for Computing Machinery ,\ address New York, NY, USA ,\ year 1...

arXiv 1992
[7]

Engel , author H

author author A. Engel , author H. M. \ K\"ohler , author F. Tschepke , author H. Vollmayr ,\ and\ author A. Zippelius ,\ title title Storage capacity and learning algorithms for two-layer neural networks ,\ https://doi.org/10.1103/PhysRevA.45.7590 journal journal Phys. Rev. A \ volume 45 ,\ pages 7590 ( year 1992 ) NoStop

work page doi:10.1103/physreva.45.7590 1992

Show all 221 references

[8]

Kang , author J.-H

author author K. Kang , author J.-H. \ Oh , author C. Kwon ,\ and\ author Y. Park ,\ title title Generalization in a two-layer neural network ,\ https://doi.org/10.1103/PhysRevE.48.4805 journal journal Phys. Rev. E \ volume 48 ,\ pages 4805 ( year 1993 ) NoStop

1993 doi
[9]

O'Kane \ and\ author O

author author D. O'Kane \ and\ author O. Winther ,\ title title Learning to classify in large committee machines ,\ https://doi.org/10.1103/PhysRevE.50.3201 journal journal Phys. Rev. E \ volume 50 ,\ pages 3201 ( year 1994 ) NoStop

1994 doi
[10]

Schwarze \ and\ author J

author author H. Schwarze \ and\ author J. Hertz ,\ title title Generalization in fully connected committee machines ,\ https://doi.org/10.1209/0295-5075/21/7/012 journal journal Europhysics Letters \ volume 21 ,\ pages 785 ( year 1993 ) NoStop

1993 doi
[11]

author author R. Urbanczik ,\ title title Storage capacity of the fully-connected committee machine ,\ https://doi.org/10.1088/0305-4470/30/11/007 journal journal Journal of Physics A: Mathematical and General \ volume 30 ,\ pages L387 ( year 1997 ) NoStop

1997 doi
[12]

Winther , author B

author author O. Winther , author B. Lautrup ,\ and\ author J.-B. \ Zhang ,\ title title Optimal learning in multilayer neural networks ,\ https://doi.org/10.1103/PhysRevE.55.836 journal journal Phys. Rev. E \ volume 55 ,\ pages 836 ( year 1997 ) NoStop

1997 doi
[13]

Schwarze \ and\ author J

author author H. Schwarze \ and\ author J. Hertz ,\ title title Generalization in a large committee machine ,\ https://doi.org/10.1209/0295-5075/20/4/015 journal journal Europhysics Letters \ volume 20 ,\ pages 375 ( year 1992 ) NoStop

1992 doi
[14]

Schwarze , author M

author author H. Schwarze , author M. Opper ,\ and\ author W. Kinzel ,\ title title Generalization in a two-layer neural network ,\ https://doi.org/10.1103/PhysRevA.46.R6185 journal journal Phys. Rev. A \ volume 46 ,\ pages R6185 ( year 1992 ) NoStop

1992 doi
[15]

Mato \ and\ author N

author author G. Mato \ and\ author N. Parga ,\ title title Generalization properties of multilayered neural networks ,\ https://doi.org/10.1088/0305-4470/25/19/017 journal journal Journal of Physics A: Mathematical and General \ volume 25 ,\ pages 5047 ( year 1992 ) NoStop

1992 doi
[16]

Monasson \ and\ author R

author author R. Monasson \ and\ author R. Zecchina ,\ title title Weight space structure and internal representations: A direct approach to learning and generalization in multilayer neural networks ,\ https://doi.org/10.1103/PhysRevLett.75.2432 journal journal Phys. Rev. Lett...

1995 doi
[17]

author author B. Schottky ,\ title title Phase transitions in the generalization behaviour of multilayer neural networks ,\ https://doi.org/10.1088/0305-4470/28/16/010 journal journal Journal of Physics A: Mathematical and General \ volume 28 ,\ pages 4515 ( year 1995 ) NoStop

1995 doi
[18]

author author A. Engel ,\ title title Correlation of internal representations in feed-forward neural networks ,\ https://doi.org/10.1088/0305-4470/29/13/003 journal journal Journal of Physics A: Mathematical and General \ volume 29 ,\ pages L323 ( year 1996 ) NoStop

1996 doi
[19]

Malzahn , author A

author author D. Malzahn , author A. Engel ,\ and\ author I. Kanter ,\ title title Storage capacity of correlated perceptrons ,\ https://doi.org/10.1103/PhysRevE.55.7369 journal journal Phys. Rev. E \ volume 55 ,\ pages 7369 ( year 1997 ) NoStop

1997 doi
[20]

Malzahn \ and\ author A

author author D. Malzahn \ and\ author A. Engel ,\ title title Correlations between hidden units in multilayer neural networks and replica symmetry breaking ,\ https://doi.org/10.1103/PhysRevE.60.2097 journal journal Phys. Rev. E \ volume 60 ,\ pages 2097 ( year 1999 ) NoStop

doi
[21]

Sompolinsky , author N

author author H. Sompolinsky , author N. Tishby ,\ and\ author H. S. \ Seung ,\ title title Learning from examples in large neural networks ,\ https://doi.org/10.1103/PhysRevLett.65.1683 journal journal Phys. Rev. Lett. \ volume 65 ,\ pages 1683 ( year 1990 ) NoStop

1990 doi
[22]

Gy\"orgyi ,\ title title First-order transition to perfect generalization in a neural network with binary synapses ,\ https://doi.org/10.1103/PhysRevA.41.7097 journal journal Phys

author author G. Gy\"orgyi ,\ title title First-order transition to perfect generalization in a neural network with binary synapses ,\ https://doi.org/10.1103/PhysRevA.41.7097 journal journal Phys. Rev. A \ volume 41 ,\ pages 7097 ( year 1990 ) NoStop

1990 doi
[23]

Meir \ and\ author J

author author R. Meir \ and\ author J. F. \ Fontanari ,\ title title Learning from examples in weight-constrained neural networks ,\ https://doi.org/10.1088/0305-4470/25/5/021 journal journal Journal of Physics A: Mathematical and General \ volume 25 ,\ pages 1149 ( year 1992 ) NoStop

1992 doi
[24]

author author D. M. L. \ Barbato \ and\ author J. F. \ Fontanari ,\ title title The effects of lesions on the generalization ability of a perceptron ,\ https://doi.org/10.1088/0305-4470/26/8/013 journal journal Journal of Physics A: Mathematical and General \ volume 26 ,\ page...

1993 doi
[25]

Engel \ and\ author L

author author A. Engel \ and\ author L. Reimers ,\ title title Reliability of replica symmetry for the generalization problem of a toy multilayer neural network ,\ https://doi.org/10.1209/0295-5075/28/7/013 journal journal Europhysics Letters \ volume 28 ,\ pages 531 ( year 19...

1994 doi
[26]

author author G. J. \ Bex , author R. Serneels ,\ and\ author C. Van den Broeck ,\ title title Storage capacity and generalization error for the reversed-wedge I sing perceptron ,\ https://doi.org/10.1103/PhysRevE.51.6309 journal journal Phys. Rev. E \ volume 51 ,\ pages 6309 ...

1995 doi
[27]

Barkai , author D

author author E. Barkai , author D. Hansel ,\ and\ author H. Sompolinsky ,\ title title Broken symmetries in multilayered perceptrons ,\ https://doi.org/10.1103/PhysRevA.45.4146 journal journal Phys. Rev. A \ volume 45 ,\ pages 4146 ( year 1992 ) NoStop

1992 doi
[28]

author author H. Schwarze ,\ title title Learning a rule in a multilayer neural network ,\ https://doi.org/10.1088/0305-4470/26/21/017 journal journal Journal of Physics A: Mathematical and General \ volume 26 ,\ pages 5781 ( year 1993 ) NoStop

1993 doi
[29]

Engel \ and\ author C

author author A. Engel \ and\ author C. Van den Broeck ,\ https://doi.org/10.1017/CBO9781139164542 title Statistical mechanics of learning \ ( publisher Cambridge University Press ,\ year 2001 ) NoStop

2001 doi
[30]

author author H. Cui ,\ title title High-dimensional learning of narrow neural networks ,\ https://doi.org/10.1088/1742-5468/adb1d6 journal journal Journal of Statistical Mechanics: Theory and Experiment \ volume 2025 ,\ pages 023402 ( year 2025 ) NoStop

2025 doi
[31]

Bruna \ and\ author D

author author J. Bruna \ and\ author D. Hsu ,\ title title Survey on Algorithms for Multi-Index Models ,\ https://doi.org/10.1214/25-STS993 journal journal Statistical Science \ volume 40 ,\ pages 378 ( year 2025 ) NoStop

2025 doi
[32]

author author G. B. \ Arous , author R. Gheissari ,\ and\ author A. Jagannath ,\ title title Online stochastic gradient descent on non-convex losses from high-dimensional inference ,\ journal journal J. Mach. Learn. Res. \ volume 22 ,\ https://doi.org/10.5555/3546258.3546364 1...

2021
[33]

Damian , author L

author author A. Damian , author L. Pillaud-Vivien , author J. Lee ,\ and\ author J. Bruna ,\ title title Computational-statistical gaps in G aussian single-index models (extended abstract) ,\ in\ https://proceedings.mlr.press/v247/damian24a.html booktitle Proceedings of Thirt...

2024
[34]

Abbe , author E

author author E. Abbe , author E. Boix-Adsera , author M. Brennan , author G. Bresler ,\ and\ author D. Nagaraj ,\ title title The staircase property: how hierarchical structure can guide deep learning ,\ in\ https://doi.org/10.5555/3540261.3542328 booktitle Proceedings of the...

2021
[35]

Abbe , author E

author author E. Abbe , author E. B. \ Adser \`a ,\ and\ author T. Misiakiewicz ,\ title title SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics ,\ in\ https://proceedings.mlr.press/v195/abbe23a.html booktitle Proceedings of Thirty Sixth Conference...

2023
[36]

Troiani , author Y

author author E. Troiani , author Y. Dandi , author L. Defilippis , author L. Zdeborova , author B. Loureiro ,\ and\ author F. Krzakala ,\ title title Fundamental computational limits of weak learnability in high-dimensional multi-index models ,\ in\ https://proceedings.mlr.pr...

2025
[37]

author author R. M. \ Neal ,\ title Priors for infinite networks ,\ in\ https://doi.org/10.1007/978-1-4612-0745-0_2 booktitle Bayesian Learning for Neural Networks \ ( publisher Springer New York ,\ address New York, NY ,\ year 1996 )\ pp.\ pages 29--53 NoStop

1996 doi
[38]

author author C. Williams ,\ title title Computing with infinite networks ,\ in\ https://proceedings.neurips.cc/paper/1996/file/ae5e3ce40e0404a45ecacaaf05e5f735-Paper.pdf booktitle Advances in Neural Information Processing Systems ,\ Vol. volume 9 ,\ editor edited by\ editor M...

1996
[39]

Lee , author J

author author J. Lee , author J. Sohl-dickstein , author J. Pennington , author R. Novak , author S. Schoenholz ,\ and\ author Y. Bahri ,\ title title Deep neural networks as G aussian processes ,\ in\ https://openreview.net/forum?id=B1EA-M-0Z booktitle International Conferenc...

2018
[40]

author author A. G. D. G. \ Matthews , author J. Hron , author M. Rowland , author R. E. \ Turner ,\ and\ author Z. Ghahramani ,\ title title Gaussian process behaviour in wide deep neural networks ,\ in\ https://openreview.net/forum?id=H1-nGgWC- booktitle International Confer...

2018
[41]

author author B. Hanin ,\ title title Random neural networks in the infinite width limit as Gaussian processes ,\ https://doi.org/10.1214/23-AAP1933 journal journal The Annals of Applied Probability \ volume 33 ,\ pages 4798 ( year 2023 ) NoStop

2023 doi
[42]

Yoon \ and\ author J.-H

author author H. Yoon \ and\ author J.-H. \ Oh ,\ title title Learning of higher-order perceptrons with tunable complexities ,\ https://doi.org/10.1088/0305-4470/31/38/012 journal journal Journal of Physics A: Mathematical and General \ volume 31 ,\ pages 7771 ( year 1998 ) NoStop

1998 doi
[43]

Dietrich , author M

author author R. Dietrich , author M. Opper ,\ and\ author H. Sompolinsky ,\ title title Statistical mechanics of support vector networks ,\ https://doi.org/10.1103/PhysRevLett.82.2975 journal journal Phys. Rev. Lett. \ volume 82 ,\ pages 2975 ( year 1999 ) NoStop

1999 doi
[44]

Gerace , author B

author author F. Gerace , author B. Loureiro , author F. Krzakala , author M. Mézard ,\ and\ author L. Zdeborová ,\ title title Generalisation error in learning with random features and the hidden manifold model ,\ https://doi.org/10.1088/1742-5468/ac3ae6 journal journal Journ...

2021 doi
[45]

Bordelon , author A

author author B. Bordelon , author A. Canatar ,\ and\ author C. Pehlevan ,\ title title Spectrum dependent learning curves in kernel regression and wide neural networks ,\ in\ https://proceedings.mlr.press/v119/bordelon20a.html booktitle Proceedings of the 37th International C...

2020
[46]

Canatar , author B

author author A. Canatar , author B. Bordelon ,\ and\ author C. Pehlevan ,\ title title Spectral bias and task-model alignment explain generalization in kernel regression and infinitely wide neural networks ,\ https://doi.org/10.1038/s41467-021-23103-1 journal journal Nature C...

2021 doi
[47]

Xiao , author H

author author L. Xiao , author H. Hu , author T. Misiakiewicz , author Y. M. \ Lu ,\ and\ author J. Pennington ,\ title title Precise learning curves and higher-order scaling limits for dot-product kernel regression ,\ https://doi.org/10.1088/1742-5468/ad01b7 journal journal J...

2023 doi
[48]

Ghorbani , author S

author author B. Ghorbani , author S. Mei , author T. Misiakiewicz ,\ and\ author A. Montanari ,\ title title Linearized two-layers neural networks in high dimension ,\ https://doi.org/10.1214/20-AOS1990 journal journal The Annals of Statistics \ volume 49 ,\ pages 1029 ( year...

2021 doi
[49]

Rahimi \ and\ author B

author author A. Rahimi \ and\ author B. Recht ,\ title title Random features for large-scale kernel machines ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2007/file/013a006f03dbc5392effeb8f18fda755-Paper.pdf booktitle Advances in Neural Information Processing System...

2007
[50]

Jacot , author F

author author A. Jacot , author F. Gabriel ,\ and\ author C. Hongler ,\ title title Neural tangent kernel: Convergence and generalization in neural networks ,\ in\ https://proceedings.neurips.cc/paper/2018/file/5a4be1fa34e62bb8a6ec6b91d2462f5a-Paper.pdf booktitle Advances in N...

2018
[51]

Chizat , author E

author author L. Chizat , author E. Oyallon ,\ and\ author F. Bach ,\ title title On lazy training in differentiable programming ,\ in\ https://proceedings.neurips.cc/paper/2019/file/ae614c557843b1df326cb29c57225459-Paper.pdf booktitle Advances in Neural Information Processing...

2019
[52]

Ghorbani , author S

author author B. Ghorbani , author S. Mei , author T. Misiakiewicz ,\ and\ author A. Montanari ,\ title title When do neural networks outperform kernel methods? ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2020/file/a9df2255ad642b923d95503b9a7958d8-Paper.pdf booktit...

2020
[53]

Refinetti , author S

author author M. Refinetti , author S. Goldt , author F. Krzakala ,\ and\ author L. Zdeborova ,\ title title Classifying high-dimensional G aussian mixtures: Where kernel methods fail and neural networks succeed ,\ in\ https://proceedings.mlr.press/v139/refinetti21b.html bookt...

2021
[54]

Dyer \ and\ author G

author author E. Dyer \ and\ author G. Gur-Ari ,\ title title Asymptotics of wide networks from F eynman diagrams ,\ in\ https://openreview.net/forum?id=S1gFvANKDS booktitle International Conference on Learning Representations \ ( year 2020 ) NoStop

2020
[55]

author author S. Yaida ,\ title title Non- G aussian processes and neural networks at finite widths ,\ in\ https://proceedings.mlr.press/v107/yaida20a.html booktitle Proceedings of The First Mathematical and Scientific Machine Learning Conference ,\ series Proceedings of Machi...

2020
[56]

Zavatone-Veth , author A

author author J. Zavatone-Veth , author A. Canatar , author B. Ruben ,\ and\ author C. Pehlevan ,\ title title Asymptotics of representation learning in finite B ayesian neural networks ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2021/file/cf9dc5e4e194fc21f397b4cac...

2021
[57]

author author K. T. \ Grosvenor \ and\ author R. Jefferson ,\ title title The edge of chaos: quantum field theory and deep neural networks ,\ https://doi.org/10.21468/SciPostPhys.12.3.081 journal journal SciPost Phys. \ volume 12 ,\ pages 081 ( year 2022 ) NoStop

2022 doi
[58]

Fischer , author J

author author K. Fischer , author J. Lindner , author D. Dahmen , author Z. Ringel , author M. Kr\" a mer ,\ and\ author M. Helias ,\ title title Critical feature learning in deep neural networks ,\ in\ https://proceedings.mlr.press/v235/fischer24a.html booktitle Proceedings o...

2024
[59]

Banta , author T

author author I. Banta , author T. Cai , author N. Craig ,\ and\ author Z. Zhang ,\ title title Structures of neural network effective theories ,\ https://doi.org/10.1103/PhysRevD.109.105007 journal journal Phys. Rev. D \ volume 109 ,\ pages 105007 ( year 2024 ) NoStop

2024 doi
[60]

Guillen , author P

author author M. Guillen , author P. Misof ,\ and\ author J. E. \ Gerken ,\ https://arxiv.org/abs/2508.11522 title Finite-width neural tangent kernels from F eynman diagrams ( year 2025 ),\ https://arxiv.org/abs/2508.11522 arXiv:2508.11522 [cs.LG] NoStop

2025
[61]

Bahri , author B

author author Y. Bahri , author B. Hanin , author A. Brossollet , author V. Erba , author C. Keup , author R. Pacelli ,\ and\ author J. B. \ Simon ,\ title title Les H ouches lectures on deep learning at large and infinite width* ,\ https://doi.org/10.1088/1742-5468/ad2dd3 jou...

2024 doi
[62]

Ringel , author N

author author Z. Ringel , author N. Rubin , author E. Mor , author M. Helias ,\ and\ author I. Seroussi ,\ https://arxiv.org/abs/2502.18553 title Applications of statistical field theory in deep learning ( year 2025 ),\ https://arxiv.org/abs/2502.18553 arXiv:2502.18553 [stat.M...

2025 arXiv
[63]

Mei , author A

author author S. Mei , author A. Montanari ,\ and\ author P.-M. \ Nguyen ,\ title title A mean field view of the landscape of two-layer neural networks ,\ https://doi.org/10.1073/pnas.1806579115 journal journal Proceedings of the National Academy of Sciences \ volume 115 ,\ pa...

2018 doi
[64]

Mei , author T

author author S. Mei , author T. Misiakiewicz ,\ and\ author A. Montanari ,\ title title Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit ,\ in\ https://proceedings.mlr.press/v99/mei19a.html booktitle Proceedings of the Thirty-Second Conf...

2019
[65]

Yang \ and\ author E

author author G. Yang \ and\ author E. J. \ Hu ,\ title title Tensor programs IV : Feature learning in infinite-width neural networks ,\ in\ https://proceedings.mlr.press/v139/yang21c.html booktitle Proceedings of the 38th International Conference on Machine Learning ,\ series...

2021
[66]

Rotskoff \ and\ author E

author author G. Rotskoff \ and\ author E. Vanden-Eijnden ,\ title title Trainability and accuracy of artificial neural networks: An interacting particle system approach ,\ https://doi.org/https://doi.org/10.1002/cpa.22074 journal journal Communications on Pure and Applied Mat...

2022 doi
[67]

Sirignano \ and\ author K

author author J. Sirignano \ and\ author K. Spiliopoulos ,\ title title Mean field analysis of neural networks: A central limit theorem ,\ https://doi.org/https://doi.org/10.1016/j.spa.2019.06.003 journal journal Stochastic Processes and their Applications \ volume 130 ,\ page...

2019 doi
[68]

Bordelon \ and\ author C

author author B. Bordelon \ and\ author C. Pehlevan ,\ title title Self-consistent dynamical field theory of kernel evolution in wide neural networks ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2022/file/d027a5c93d484a4312cc486d399c62c1-Paper-Conference.pdf booktit...

2022
[69]

\ Nguyen \ and\ author H

author author P.-M. \ Nguyen \ and\ author H. T. \ Pham ,\ title title A rigorous framework for the mean field limit of multilayer neural networks ,\ https://doi.org/10.4171/msl/42 journal journal Mathematical Statistics and Learning \ volume 6 ,\ pages 201 ( year 2023 ) NoStop

2023 doi
[70]

Bassetti , author M

author author F. Bassetti , author M. Gherardi , author A. Ingrosso , author M. Pastore ,\ and\ author P. Rotondo ,\ title title Feature learning in finite-width B ayesian deep linear networks with multiple outputs and convolutional layers ,\ http://jmlr.org/papers/v26/24-1158...

2025
[71]

Rubin , author Z

author author N. Rubin , author Z. Ringel , author I. Seroussi ,\ and\ author M. Helias ,\ title title A unified approach to feature learning in B ayesian neural networks ,\ in\ https://openreview.net/forum?id=ZmOSJ2MV2R booktitle High-dimensional Learning Dynamics 2024: The E...

2024
[72]

van Meegen \ and\ author H

author author A. van Meegen \ and\ author H. Sompolinsky ,\ title title Coding schemes in neural networks learning classification tasks ,\ https://doi.org/10.1038/s41467-025-58276-6 journal journal Nature Communications \ volume 16 ,\ pages 3354 ( year 2025 ) NoStop

2025 doi
[73]

Lauditi , author B

author author C. Lauditi , author B. Bordelon ,\ and\ author C. Pehlevan ,\ https://arxiv.org/abs/2502.07998 title Adaptive kernel predictors from feature-learning infinite limits of neural networks ( year 2025 ),\ https://arxiv.org/abs/2502.07998 arXiv:2502.07998 [cs.LG] NoStop

2025 arXiv
[74]

author author A. X. \ Yang , author M. Robeyns , author E. Milsom , author B. Anson , author N. Schoots ,\ and\ author L. Aitchison ,\ title title A theory of representation learning gives a deep generalisation of kernel methods ,\ in\ https://proceedings.mlr.press/v202/yang23...

2023
[75]

Rubin , author I

author author N. Rubin , author I. Seroussi ,\ and\ author Z. Ringel ,\ title title Grokking as a first order phase transition in two layer networks ,\ in\ https://openreview.net/forum?id=3ROGsTX3IR booktitle The Twelfth International Conference on Learning Representations \ (...

2024
[76]

author author A. M. \ Saxe , author J. McClelland ,\ and\ author S. Ganguli ,\ title title Exact solutions to the nonlinear dynamics of learning in deep linear neural networks ,\ in\ https://doi.org/10.48550/arXiv.1312.6120 booktitle Proceedings of the International Conference...

2014 doi arXiv
[77]

Li \ and\ author H

author author Q. Li \ and\ author H. Sompolinsky ,\ title title Statistical mechanics of deep linear neural networks: The backpropagating kernel renormalization ,\ https://doi.org/10.1103/PhysRevX.11.031059 journal journal Phys. Rev. X \ volume 11 ,\ pages 031059 ( year 2021 ) NoStop

2021 doi
[78]

author author L. Aitchison ,\ title title Why bigger is not always better: on finite and infinite neural networks ,\ in\ https://arxiv.org/abs/1910.08013 booktitle International Conference on Machine Learning \ ( organization PMLR ,\ year 2020 )\ pp.\ pages 156--164 NoStop

1910 arXiv
[79]

Hanin \ and\ author A

author author B. Hanin \ and\ author A. Zlokapa ,\ title title Bayesian interpolation with deep linear networks ,\ https://doi.org/10.1073/pnas.2301345120 journal journal Proceedings of the National Academy of Sciences \ volume 120 ,\ pages e2301345120 ( year 2023 ) NoStop

2023 doi
[80]

author author J. A. \ Zavatone-Veth , author W. L. \ Tong ,\ and\ author C. Pehlevan ,\ title title Contrasting random and learned features in deep B ayesian linear regression ,\ https://doi.org/10.1103/PhysRevE.105.064118 journal journal Phys. Rev. E \ volume 105 ,\ pages 064...

2022 doi
[81]

Neyshabur , author R

author author B. Neyshabur , author R. Tomioka ,\ and\ author N. Srebro ,\ title title Norm-based capacity control in neural networks ,\ in\ https://proceedings.mlr.press/v40/Neyshabur15.html booktitle Proceedings of The 28th Conference on Learning Theory ,\ series Proceedings...

2015
[82]

Pesme \ and\ author N

author author S. Pesme \ and\ author N. Flammarion ,\ title title Saddle-to-saddle dynamics in diagonal linear networks ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2023/file/17a9ab4190289f0e1504bbb98d1d111a-Paper-Conference.pdf booktitle Advances in Neural Informat...

2023
[83]

Soudry , author E

author author D. Soudry , author E. Hoffer , author M. S. \ Nacson , author S. Gunasekar ,\ and\ author N. Srebro ,\ title title The implicit bias of gradient descent on separable data ,\ http://jmlr.org/papers/v19/18-188.html journal journal Journal of Machine Learning Resear...

2018
[84]

Pesme , author L

author author S. Pesme , author L. Pillaud-Vivien ,\ and\ author N. Flammarion ,\ title title Implicit bias of SGD for diagonal linear networks: a provable benefit of stochasticity ,\ in\ https://openreview.net/forum?id=vvi7KqHQiA booktitle Advances in Neural Information Proce...

2021
[85]

Berthier ,\ title title Incremental learning in diagonal linear networks ,\ journal journal J

author author R. Berthier ,\ title title Incremental learning in diagonal linear networks ,\ journal journal J. Mach. Learn. Res. \ volume 24 ,\ https://doi.org/10.5555/3648699.3648870 10.5555/3648699.3648870 ( year 2023 ) NoStop

2023
[86]

Labarrière , author C

author author H. Labarrière , author C. Molinari , author L. Rosasco , author S. Villa ,\ and\ author C. Vega ,\ https://arxiv.org/abs/2412.16765 title Optimization insights into deep diagonal linear networks ( year 2025 ),\ https://arxiv.org/abs/2412.16765 arXiv:2412.16765 [c...

2025
[87]

Du \ and\ author J

author author S. Du \ and\ author J. Lee ,\ title title On the power of over-parametrization in neural networks with quadratic activation ,\ in\ https://proceedings.mlr.press/v80/du18a.html booktitle Proceedings of the 35th International Conference on Machine Learning ,\ serie...

2018
[88]

Soltanolkotabi , author A

author author M. Soltanolkotabi , author A. Javanmard ,\ and\ author J. D. \ Lee ,\ title title Theoretical insights into the optimization landscape of over-parameterized shallow neural networks ,\ https://doi.org/10.1109/TIT.2018.2854560 journal journal IEEE Transactions on I...

2018
[89]

Venturi , author A

author author L. Venturi , author A. S. \ Bandeira ,\ and\ author J. Bruna ,\ title title Spurious valleys in one-hidden-layer neural network optimization landscapes ,\ http://jmlr.org/papers/v20/18-674.html journal journal Journal of Machine Learning Research \ volume 20 ,\ p...

2019
[90]

Sarao Mannelli , author E

author author S. Sarao Mannelli , author E. Vanden-Eijnden ,\ and\ author L. Zdeborov\' a ,\ title title Optimization and generalization of shallow neural networks with quadratic activation functions ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2020/file/9b8b50fb590...

2020
[91]

Gamarnik , author E

author author D. Gamarnik , author E. C. \ K z lda g ,\ and\ author I. Zadik ,\ title title Stationary points of a shallow neural network with quadratic activations and the global optimality of the gradient descent algorithm ,\ https://doi.org/10.1287/moor.2021.0082 journal jo...

2021
[92]

Martin , author F

author author S. Martin , author F. Bach ,\ and\ author G. Biroli ,\ title title On the impact of overparameterization on the training of a shallow neural network in high dimensions ,\ in\ https://proceedings.mlr.press/v238/martin24a.html booktitle Proceedings of The 27th Inte...

2024
[93]

Arjevani , author J

author author Y. Arjevani , author J. Bruna , author J. Kileel , author E. Polak ,\ and\ author M. Trager ,\ https://arxiv.org/abs/2501.06074 title Geometry and optimization of shallow polynomial networks ( year 2025 ),\ https://arxiv.org/abs/2501.06074 arXiv:2501.06074 [cs.LG] NoStop

2025
[94]

Maillard , author E

author author A. Maillard , author E. Troiani , author S. Martin , author L. Zdeborov\' a ,\ and\ author F. Krzakala ,\ title title Bayes-optimal learning of an extensive-width neural network from quadratically many samples ,\ in\ https://proceedings.neurips.cc/paper_files/pap...

2024
[96]

Erba , author E

author author V. Erba , author E. Troiani , author L. Zdeborová ,\ and\ author F. Krzakala ,\ https://arxiv.org/abs/2505.17958 title The nuclear route: Sharp asymptotics of erm in overparameterized quadratic networks ( year 2025 a ),\ https://arxiv.org/abs/2505.17958 arXiv:250...

2025
[97]

Ben Arous , author M

author author G. Ben Arous , author M. A. \ Erdogdu , author N. M. \ Vural ,\ and\ author D. Wu ,\ https://arxiv.org/abs/2508.03688 title Learning quadratic neural networks in high dimensions: SGD dynamics and scaling laws ( year 2025 ),\ https://arxiv.org/abs/2508.03688 arXiv...

2025
[98]

Barbier , author F

author author J. Barbier , author F. Krzakala , author N. Macris , author L. Miolane ,\ and\ author L. Zdeborová ,\ title title Optimal errors and phase transitions in high-dimensional generalized linear models ,\ https://doi.org/10.1073/pnas.1802705116 journal journal Proceed...

2019 doi
[99]

Barbier \ and\ author N

author author J. Barbier \ and\ author N. Macris ,\ title title Statistical limits of dictionary learning: Random matrix theory and the spectral replica method ,\ https://doi.org/10.1103/PhysRevE.106.024136 journal journal Phys. Rev. E \ volume 106 ,\ pages 024136 ( year 2022 ) NoStop

2022 doi
[100]

Maillard , author F

author author A. Maillard , author F. Krzakala , author M. Mézard ,\ and\ author L. Zdeborová ,\ title title Perturbative construction of mean-field equations in extensive-rank matrix factorization and denoising ,\ https://doi.org/10.1088/1742-5468/ac7e4c journal journal Journ...

2022 doi
[101]

Pourkamali , author J

author author F. Pourkamali , author J. Barbier ,\ and\ author N. Macris ,\ title title Matrix inference in growing rank regimes ,\ https://doi.org/10.1109/TIT.2024.3422263 journal journal IEEE Transactions on Information Theory \ volume 70 ,\ pages 8133 ( year 2024 ) NoStop

2024
[102]

author author G. Semerjian ,\ title title Matrix denoising: B ayes-optimal estimators via low-degree polynomials ,\ https://doi.org/10.1007/s10955-024-03359-9 journal journal Journal of Statistical Physics \ volume 191 ,\ pages 139 ( year 2024 ) NoStop

2024 doi
[103]

Pacelli , author S

author author R. Pacelli , author S. Ariosto , author M. Pastore , author F. Ginelli , author M. Gherardi ,\ and\ author P. Rotondo ,\ title title A statistical mechanics framework for B ayesian deep neural networks beyond the infinite-width limit ,\ https://doi.org/10.1038/s4...

2023 arXiv
[104]

Baglioni , author R

author author P. Baglioni , author R. Pacelli , author R. Aiudi , author F. Di Renzo , author A. Vezzani , author R. Burioni ,\ and\ author P. Rotondo ,\ title title Predictive power of a B ayesian effective action for fully connected one hidden layer neural networks in the pr...

2024 doi
[105]

Ingrosso , author R

author author A. Ingrosso , author R. Pacelli , author P. Rotondo ,\ and\ author F. Gerace ,\ title title Statistical mechanics of transfer learning in fully connected networks in the proportional limit ,\ https://doi.org/10.1103/PhysRevLett.134.177301 journal journal Phys. Re...

2025 doi
[106]

Cui , author F

author author H. Cui , author F. Krzakala ,\ and\ author L. Zdeborova ,\ title title B ayes-optimal learning of deep random networks of extensive-width ,\ in\ https://proceedings.mlr.press/v202/cui23b.html booktitle Proceedings of the 40th International Conference on Machine L...

2023
[107]

Camilli , author D

author author F. Camilli , author D. Tieplova ,\ and\ author J. Barbier ,\ title title Fundamental limits of overparametrized shallow neural networks for supervised learning ,\ journal journal Bollettino dell'Unione Matematica Italiana \ https://doi.org/10.1007/s40574-025-0050...

2025 doi
[108]

Camilli , author D

author author F. Camilli , author D. Tieplova , author E. Bergamin ,\ and\ author J. Barbier ,\ title title Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime ,\ in\ https://proceedings.mlr.press/v291/camilli25a...

2025
[109]

Naveh \ and\ author Z

author author G. Naveh \ and\ author Z. Ringel ,\ title title A self consistent theory of G aussian processes captures feature learning effects in finite CNN s ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2021/file/b24d21019de5e59da180f1661904f49a-Paper.pdf booktitl...

2021
[110]

Seroussi , author G

author author I. Seroussi , author G. Naveh ,\ and\ author Z. Ringel ,\ title title Separation of scales and a thermodynamic description of feature learning in some CNN s ,\ https://doi.org/10.1038/s41467-023-36361-y journal journal Nature Communications \ volume 14 ,\ pages 9...

2023 arXiv
[111]

Aiudi , author R

author author R. Aiudi , author R. Pacelli , author P. Baglioni , author A. Vezzani , author R. Burioni ,\ and\ author P. Rotondo ,\ title title Local kernel renormalization as a mechanism for feature learning in overparametrized convolutional neural networks ,\ https://doi.or...

2025 arXiv
[112]

author author H. Yoshino ,\ title title From complex to simple: hierarchical free-energy landscape renormalized in deep neural networks ,\ https://doi.org/10.21468/SciPostPhysCore.2.2.005 journal journal SciPost Phys. Core \ volume 2 ,\ pages 005 ( year 2020 ) NoStop

2020 doi
[113]

Yoshino ,\ title title Spatially heterogeneous learning by a deep student machine ,\ https://doi.org/10.1103/PhysRevResearch.5.033068 journal journal Phys

author author H. Yoshino ,\ title title Spatially heterogeneous learning by a deep student machine ,\ https://doi.org/10.1103/PhysRevResearch.5.033068 journal journal Phys. Rev. Res. \ volume 5 ,\ pages 033068 ( year 2023 ) NoStop

2023 doi
[114]

Huang , author L

author author G. Huang , author L. S. \ Chan , author H. Yoshino , author G. Zhang ,\ and\ author Y. Jin ,\ https://arxiv.org/abs/2506.06789 title Liquid and solid layers in a thermal deep learning machine ( year 2025 ),\ https://arxiv.org/abs/2506.06789 arXiv:2506.06789 [cond...

2025 arXiv
[115]

Yao , author Y

author author J. Yao , author Y. Yacoby , author B. Coker , author W. Pan ,\ and\ author F. Doshi-Velez ,\ https://doi.org/10.48550/arXiv.2211.09184 title An empirical analysis of the advantages of finite- v.s. infinite-width B ayesian neural networks ( year 2022 ) NoStop

2022 doi arXiv
[116]

Lee , author S

author author J. Lee , author S. S. \ Schoenholz , author J. Pennington , author B. Adlam , author L. Xiao , author R. Novak ,\ and\ author J. Sohl-Dickstein ,\ title title Finite versus infinite neural networks: an empirical study ,\ in\ https://doi.org/10.5555/3495724.349699...

2020
[117]

author author L. Zdeborov \'a ,\ title title Understanding deep learning is also a job for physicists ,\ https://doi.org/10.1038/s41567-020-0929-2 journal journal Nature Physics \ volume 16 ,\ pages 602 ( year 2020 ) NoStop

2020 doi
[118]

Bahri , author J

author author Y. Bahri , author J. Kadmon , author J. Pennington , author S. S. \ Schoenholz , author J. Sohl-Dickstein ,\ and\ author S. Ganguli ,\ title title Statistical mechanics of deep learning ,\ https://doi.org/10.1146/annurev-conmatphys-031119-050745 journal journal A...

2020 doi
[119]

Hoffmann , author S

author author J. Hoffmann , author S. Borgeaud , author A. Mensch , author E. Buchatskaya , author T. Cai , author E. Rutherford , author D. de Las Casas , author L. A. \ Hendricks , author J. Welbl , author A. Clark , author T. Hennigan , author E. Noland , author K. Millican...

2022
[120]

Lan , author P

author author M. Lan , author P. Torr , author A. Meek , author A. Khakzar , author D. Krueger ,\ and\ author F. Barez ,\ https://arxiv.org/abs/2410.06981 title Quantifying feature space universality across large language models via sparse autoencoders ( year 2025 ),\ https://...

2025 arXiv
[121]

Li , author C

author author Z. Li , author C. Fan ,\ and\ author T. Zhou ,\ https://arxiv.org/abs/2506.21551 title Grokking in LLM pretraining? M onitor memorization-to-generalization without test ( year 2025 ),\ https://arxiv.org/abs/2506.21551 arXiv:2506.21551 [cs.LG] NoStop

2025
[122]

Mondelli \ and\ author A

author author M. Mondelli \ and\ author A. Montanari ,\ title title On the connection between learning two-layer neural networks and tensor decomposition ,\ in\ https://proceedings.mlr.press/v89/mondelli19a.html booktitle Proceedings of the Twenty-Second International Conferen...

2019
[123]

Mezard , author G

author author M. Mezard , author G. Parisi ,\ and\ author M. Virasoro ,\ https://doi.org/10.1142/0271 title Spin Glass Theory and Beyond \ ( publisher World Scientific ,\ year 1986 ) NoStop

1986 doi
[124]

Itzykson \ and\ author J

author author C. Itzykson \ and\ author J. Zuber ,\ title title The planar approximation. II ,\ https://doi.org/10.1063/1.524438 journal journal Journal of Mathematical Physics \ volume 21 ,\ pages 411 ( year 1980 ) NoStop

1980 doi
[125]

author author A. Matytsin ,\ title title On the large- N limit of the I tzykson- Z uber integral ,\ https://doi.org/10.1016/0550-3213(94)90471-5 journal journal Nuclear Physics B \ volume 411 ,\ pages 805 ( year 1994 ) NoStop

1994 doi
[126]

Guionnet \ and\ author O

author author A. Guionnet \ and\ author O. Zeitouni ,\ title title Large deviations asymptotics for spherical integrals ,\ https://doi.org/10.1006/jfan.2001.3833 journal journal Journal of Functional Analysis \ volume 188 ,\ pages 461 ( year 2002 ) NoStop

2001
[127]

author author A. Guionnet ,\ title title First order asymptotics of matrix integrals; a rigorous approach towards the understanding of matrix models ,\ https://doi.org/10.1007/s00220-003-0992-4 journal journal Communications in Mathematical Physics \ volume 244 ,\ pages 527 ( ...

2004 doi
[128]

author author J.-B. \ Zuber ,\ title title The large- N limit of matrix integrals over the orthogonal group ,\ https://doi.org/10.1088/1751-8113/41/38/382001 journal journal Journal of Physics A: Mathematical and Theoretical \ volume 41 ,\ pages 382001 ( year 2008 ) NoStop

2008 doi
[129]

author author V. A. \ Kazakov ,\ https://arxiv.org/abs/hep-th/0003064 title Solvable matrix models ( year 2000 ),\ https://arxiv.org/abs/hep-th/0003064 arXiv:hep-th/0003064 [hep-th] NoStop

2000 arXiv
[130]

Br \'e zin , author S

author author E. Br \'e zin , author S. Hikami , et al. ,\ @noop title Random matrix theory with an external source \ ( publisher Springer ,\ year 2016 ) NoStop

2016
[131]

Anninos \ and\ author B

author author D. Anninos \ and\ author B. Mühlmann ,\ title title Notes on matrix models (matrix musings) ,\ https://doi.org/10.1088/1742-5468/aba499 journal journal Journal of Statistical Mechanics: Theory and Experiment \ volume 2020 ,\ pages 083109 ( year 2020 ) NoStop

2020 doi
[132]

Bun , author J

author author J. Bun , author J. P. \ Bouchaud , author S. N. \ Majumdar ,\ and\ author M. Potters ,\ title title Instanton approach to large N Harish-Chandra-Itzykson-Zuber integrals ,\ https://doi.org/10.1103/PhysRevLett.113.070201 journal journal Phys. Rev. Lett. \ volume 1...

2014 doi
[133]

Potters \ and\ author J.-P

author author M. Potters \ and\ author J.-P. \ Bouchaud ,\ @noop title A first course in random matrix theory: for physicists, engineers and data scientists \ ( publisher Cambridge University Press ,\ year 2020 ) NoStop

2020
[134]

Husson \ and\ author J

author author J. Husson \ and\ author J. Ko ,\ title title Spherical integrals of sublinear rank ,\ https://doi.org/10.1007/s00440-025-01402-8 journal journal Probability Theory and Related Fields \ volume 193 ,\ pages 1 ( year 2025 ) NoStop

2025 doi
[135]

Parisi \ and\ author M

author author G. Parisi \ and\ author M. Potters ,\ title title Mean-field equations for spin models with orthogonal interaction matrices ,\ https://doi.org/10.1088/0305-4470/28/18/016 journal journal Journal of Physics A: Mathematical and General \ volume 28 ,\ pages 5267 ( y...

1995 doi
[136]

Opper \ and\ author O

author author M. Opper \ and\ author O. Winther ,\ title title Adaptive and self-averaging T houless- A nderson- P almer mean-field theory for probabilistic modeling ,\ https://doi.org/10.1103/PhysRevE.64.056131 journal journal Phys. Rev. E \ volume 64 ,\ pages 056131 ( year 2...

2001 doi
[137]

Opper , author B

author author M. Opper , author B. C akmak ,\ and\ author O. Winther ,\ title title A theory of solving TAP equations for I sing models with general invariant random matrices ,\ https://doi.org/10.1088/1751-8113/49/11/114002 journal journal Journal of Physics A: Mathematical a...

2016 doi
[138]

Fan , author Y

author author Z. Fan , author Y. Li ,\ and\ author S. Sen ,\ https://arxiv.org/abs/2202.09325 title TAP equations for orthogonally invariant spin glasses at high temperature ( year 2022 ),\ https://arxiv.org/abs/2202.09325 arXiv:2202.09325 [math.PR] NoStop

2022 arXiv
[139]

Barbier \ and\ author M

author author J. Barbier \ and\ author M. S \'a enz ,\ title title Marginals of a spherical spin glass model with correlated disorder ,\ https://doi.org/10.1214/22-ECP489 journal journal Electronic Communications in Probability \ volume 27 ,\ pages 1 ( year 2022 ) NoStop

2022 doi
[140]

Fan \ and\ author Y

author author Z. Fan \ and\ author Y. Wu ,\ title title The replica-symmetric free energy for I sing spin glasses with orthogonally invariant couplings ,\ https://doi.org/10.1007/s00440-024-01309-w journal journal Probability Theory and Related Fields \ volume 190 ,\ pages 1 (...

2024 doi
[141]

author author Y. Kabashima ,\ title title Inference from correlated patterns: a unified theory for perceptron learning and linear vector channels ,\ https://doi.org/10.1088/1742-6596/95/1/012001 journal journal Journal of Physics: Conference Series \ volume 95 ,\ pages 012001 ...

2008 doi
[142]

Gabri\' e , author A

author author M. Gabri\' e , author A. Manoel , author C. Luneau , author J. Barbier , author N. Macris , author F. Krzakala ,\ and\ author L. Zdeborov\' a ,\ title title Entropy and mutual information in models of deep neural networks ,\ in\ https://proceedings.neurips.cc/pap...

2018
[143]

Takeda , author S

author author K. Takeda , author S. Uda ,\ and\ author Y. Kabashima ,\ title title Analysis of CDMA systems that are characterized by eigenvalue spectrum ,\ https://doi.org/10.1209/epl/i2006-10380-5 journal journal Europhysics Letters \ volume 76 ,\ pages 1193 ( year 2006 ) NoStop

2006 doi
[144]

Tulino , author G

author author A. Tulino , author G. Caire , author S. Shamai ,\ and\ author S. Verdú ,\ title title Support recovery with sparsely sampled free random matrices ,\ in\ https://doi.org/10.1109/ISIT.2011.6033978 booktitle 2011 IEEE International Symposium on Information Theory Pr...

2011
[146]

Barbier , author F

author author J. Barbier , author F. Camilli , author Y. Xu ,\ and\ author M. Mondelli ,\ title title Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise ,\ https://doi.org/10.1103/PhysRevResearch.7.013081 journal journal Ph...

2025 doi
[147]

Rangan , author P

author author S. Rangan , author P. Schniter ,\ and\ author A. K. \ Fletcher ,\ title title Vector approximate message passing ,\ https://doi.org/10.1109/TIT.2019.2916359 journal journal IEEE Transactions on Information Theory \ volume 65 ,\ pages 6664 ( year 2019 ) NoStop

2019
[148]

Ma \ and\ author L

author author J. Ma \ and\ author L. Ping ,\ title title Orthogonal AMP ,\ https://doi.org/10.1109/ACCESS.2017.2653119 journal journal IEEE Access \ volume 5 ,\ pages 2020 ( year 2017 ) NoStop

2017
[149]

Maillard , author L

author author A. Maillard , author L. Foini , author A. L. \ Castellanos , author F. Krzakala , author M. Mézard ,\ and\ author L. Zdeborová ,\ title title High-temperature expansions and message passing algorithms ,\ https://doi.org/10.1088/1742-5468/ab4bbb journal journal Jo...

2019 doi
[150]

Liu , author S

author author L. Liu , author S. Huang ,\ and\ author B. M. \ Kurkoski ,\ title title Memory AMP ,\ https://doi.org/10.1109/TIT.2022.3186166 journal journal IEEE Transactions on Information Theory \ volume 68 ,\ pages 8015 ( year 2022 ) NoStop

2022
[151]

author author K. Takeuchi ,\ title title On the convergence of orthogonal/vector AMP : Long-memory message-passing strategy ,\ in\ https://doi.org/10.1109/ISIT50566.2022.9834373 booktitle 2022 IEEE International Symposium on Information Theory (ISIT) \ ( year 2022 )\ pp.\ page...

2022
[152]

Takahashi \ and\ author Y

author author T. Takahashi \ and\ author Y. Kabashima ,\ title title Macroscopic analysis of vector approximate message passing in a model-mismatched setting ,\ https://doi.org/10.1109/TIT.2022.3163342 journal journal IEEE Transactions on Information Theory \ volume 68 ,\ page...

2022
[153]

author author Z. Fan ,\ title title Approximate Message Passing algorithms for rotationally invariant matrices ,\ https://doi.org/10.1214/21-AOS2101 journal journal The Annals of Statistics \ volume 50 ,\ pages 197 ( year 2022 ) NoStop

2022 doi
[154]

Barbier , author N

author author J. Barbier , author N. Macris , author A. Maillard ,\ and\ author F. Krzakala ,\ title title The mutual information in random linear estimation beyond i.i.d. matrices ,\ in\ https://doi.org/10.1109/ISIT.2018.8437522 booktitle 2018 IEEE International Symposium on ...

2018
[155]

Gerbelot , author A

author author C. Gerbelot , author A. Abbara ,\ and\ author F. Krzakala ,\ title title Asymptotic errors for high-dimensional convex penalized linear regression beyond G aussian matrices ,\ in\ https://proceedings.mlr.press/v125/gerbelot20a.html booktitle Proceedings of Thirty...

2020
[156]

Gerbelot , author A

author author C. Gerbelot , author A. Abbara ,\ and\ author F. Krzakala ,\ title title Asymptotic errors for teacher-student convex generalized linear models (or: How to prove K abashima’s replica formula) ,\ https://doi.org/10.1109/TIT.2022.3222913 journal journal IEEE Transa...

2022
[157]

Dudeja , author Y

author author R. Dudeja , author Y. M. Lu ,\ and\ author S. Sen ,\ title title Universality of approximate message passing with semirandom matrices ,\ https://doi.org/10.1214/23-AOP1628 journal journal The Annals of Probability \ volume 51 ,\ pages 1616 ( year 2023 ) NoStop

2023 doi
[158]

Barbier , author F

author author J. Barbier , author F. Camilli , author M. Mondelli ,\ and\ author M. Sáenz ,\ title title Fundamental limits in structured principal component analysis and how to reach them ,\ https://doi.org/10.1073/pnas.2302028120 journal journal Proceedings of the National A...

2023 doi
[159]

Dudeja , author S

author author R. Dudeja , author S. Liu ,\ and\ author J. Ma ,\ https://arxiv.org/abs/2405.18081 title Optimality of approximate message passing algorithms for spiked matrix models with rotationally invariant noise ( year 2025 ),\ https://arxiv.org/abs/2405.18081 arXiv:2405.18...

2025 arXiv
[160]

Ledoit \ and\ author S

author author O. Ledoit \ and\ author S. P \'e ch \'e ,\ title title Eigenvectors of some large sample covariance matrix ensembles ,\ https://doi.org/10.1007/s00440-010-0298-3 journal journal Probability Theory and Related Fields \ volume 151 ,\ pages 233 ( year 2011 ) NoStop

2011 doi
[161]

Bun , author R

author author J. Bun , author R. Allez , author J.-P. \ Bouchaud ,\ and\ author M. Potters ,\ title title Rotational invariant estimator for general noisy matrices ,\ https://doi.org/10.1109/TIT.2016.2616132 journal journal IEEE Transactions on Information Theory \ volume 62 ,...

2016
[162]

Pourkamali \ and\ author N

author author F. Pourkamali \ and\ author N. Macris ,\ title title Rectangular rotational invariant estimator for general additive noise matrices ,\ in\ https://doi.org/10.1109/ISIT54713.2023.10206784 booktitle 2023 IEEE International Symposium on Information Theory (ISIT) \ (...

2023
[163]

Troiani , author V

author author E. Troiani , author V. Erba , author F. Krzakala , author A. Maillard ,\ and\ author L. Zdeborova ,\ title title Optimal denoising of rotationally invariant rectangular matrices ,\ in\ https://proceedings.mlr.press/v190/troiani22a.html booktitle Proceedings of Ma...

2022
[164]

author author H. C. \ Schmidt ,\ title Statistical physics of sparse and dense models in optimization and inference ,\ http://www.theses.fr/2018SACLS366 Ph.D. thesis ,\ school IPHT - Institut de Physique Théorique ( year 2018 ) NoStop

2018
[165]

Sakata \ and\ author Y

author author A. Sakata \ and\ author Y. Kabashima ,\ title title Statistical mechanics of dictionary learning ,\ https://doi.org/10.1209/0295-5075/103/28008 journal journal Europhysics Letters \ volume 103 ,\ pages 28008 ( year 2013 ) NoStop

2013 doi
[166]

Kabashima , author F

author author Y. Kabashima , author F. Krzakala , author M. Mézard , author A. Sakata ,\ and\ author L. Zdeborová ,\ title title Phase transitions and sample complexity in B ayes-optimal matrix factorization ,\ https://doi.org/10.1109/TIT.2016.2556702 journal journal IEEE Tran...

2016
[167]

Erba , author E

author author V. Erba , author E. Troiani , author L. Biggio , author A. Maillard ,\ and\ author L. Zdeborov\'a ,\ title title Bilinear sequence regression: A model for learning from long sequences of high-dimensional tokens ,\ https://doi.org/10.1103/l4p2-vrxt journal journal...

2025 doi
[168]

Barbier , author F

author author J. Barbier , author F. Camilli , author J. Ko ,\ and\ author K. Okajima ,\ title title Phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance ,\ https://doi.org/10.1103/PhysRevX.15.021085 journal journal Phys. Rev. X \ volume 15 ,...

2025 doi
[169]

Ren , author E

author author Y. Ren , author E. Nichani , author D. Wu ,\ and\ author J. D. \ Lee ,\ https://arxiv.org/abs/2504.19983 title Emergence and scaling laws in SGD learning of shallow neural networks ( year 2025 ),\ https://arxiv.org/abs/2504.19983 arXiv:2504.19983 [cs.LG] NoStop

2025
[170]

Bodin \ and\ author N

author author A. Bodin \ and\ author N. Macris ,\ title title Gradient flow on extensive-rank positive semi-definite matrix denoising ,\ in\ https://arxiv.org/abs/2303.09474 booktitle 2023 IEEE Information Theory Workshop (ITW) \ ( organization IEEE ,\ year 2023 )\ pp.\ pages ...

2023 arXiv
[171]

Barbier , author F

author author J. Barbier , author F. Camilli , author M.-T. \ Nguyen , author M. Pastore ,\ and\ author R. Skerk ,\ @noop howpublished https://github.com/Minh-Toan/statphys-deep-NN ( year 2025 c ) NoStop

2025
[172]

author author H. Nishimori ,\ https://doi.org/10.1093/acprof:oso/9780198509417.001.0001 title Statistical Physics of Spin Glasses and Information Processing: An Introduction \ ( publisher Oxford University Press ,\ year 2001 ) NoStop

2001
[173]

Zdeborová \ and\ author F

author author L. Zdeborová \ and\ author F. K. \ and ,\ title title Statistical physics of inference: thresholds and algorithms ,\ https://doi.org/10.1080/00018732.2016.1211393 journal journal Advances in Physics \ volume 65 ,\ pages 453 ( year 2016 ) NoStop

2016
[174]

Guo , author S

author author D. Guo , author S. Shamai ,\ and\ author S. Verd\'u ,\ title title Mutual information and minimum mean-square error in G aussian channels ,\ https://doi.org/10.1109/TIT.2005.844072 journal journal IEEE Transactions on Information Theory \ volume 51 ,\ pages 1261 ...

2005
[175]

Guionnet \ and\ author J

author author A. Guionnet \ and\ author J. Huang ,\ title title Asymptotics of rectangular spherical integrals ,\ https://doi.org/10.1016/j.jfa.2023.110144 journal journal Journal of Functional Analysis \ volume 285 ,\ pages 110144 ( year 2023 ) NoStop

2023
[176]

Barbier \ and\ author D

author author J. Barbier \ and\ author D. Panchenko ,\ title title Strong replica symmetry in high-dimensional optimal B ayesian inference ,\ https://doi.org/10.1007/s00220-022-04387-w journal journal Communications in Mathematical Physics \ volume 393 ,\ pages 1199 ( year 202...

2022 doi
[177]

author author J. T. \ Parker , author P. Schniter ,\ and\ author V. Cevher ,\ title title Bilinear generalized approximate message passing— P art I : Derivation ,\ https://doi.org/10.1109/TSP.2014.2357776 journal journal IEEE Transactions on Signal Processing \ volume 62 ,\ pa...

2014
[178]

Krzakala , author M

author author F. Krzakala , author M. Mézard ,\ and\ author L. Zdeborová ,\ title title Phase diagram and approximate message passing for blind calibration and dictionary learning ,\ in\ https://doi.org/10.1109/ISIT.2013.6620308 booktitle 2013 IEEE International Symposium on I...

2013
[179]

Aubin , author A

author author B. Aubin , author A. Maillard , author J. Barbier , author F. Krzakala , author N. Macris ,\ and\ author L. Zdeborov\' a ,\ title title The committee machine: Computational to statistical gaps in learning a two-layers neural network ,\ in\ https://proceedings.neu...

2018
[180]

Baldassi , author E

author author C. Baldassi , author E. M. \ Malatesta ,\ and\ author R. Zecchina ,\ title title Properties of the geometry of solutions and capacity of multilayer neural networks with rectified linear unit activations ,\ https://doi.org/10.1103/PhysRevLett.123.170602 journal jo...

2019 doi
[181]

Barbier , author F

author author J. Barbier , author F. Gerace , author A. Ingrosso , author C. Lauditi , author E. M. \ Malatesta , author G. Nwemadji ,\ and\ author R. P. \ Ortiz ,\ https://arxiv.org/abs/2507.00629 title Generalization performance of narrow one-hidden layer networks in the tea...

2025
[182]

author author J. Barbier ,\ title title Overlap matrix concentration in optimal B ayesian inference ,\ https://doi.org/10.1093/imaiai/iaaa008 journal journal Information and Inference: A Journal of the IMA \ volume 10 ,\ pages 597 ( year 2020 ) NoStop

2020 doi
[183]

Maillard , author E

author author A. Maillard , author E. Troiani , author S. Martin , author F. Krzakala ,\ and\ author L. Zdeborov\'a ,\ @noop title Github repository ExtensiveWidthQuadraticSamples ,\ howpublished https://github.com/SPOC-group/ExtensiveWidthQuadraticSamples ( year 2024 b ) NoStop

2024
[184]

Tao \ and\ author V

author author T. Tao \ and\ author V. Vu ,\ title title Random matrices: Universality of local eigenvalue statistics up to the edge ,\ https://doi.org/10.1007/s00220-010-1044-5 journal journal Communications in Mathematical Physics \ volume 298 ,\ pages 549 ( year 2010 ) NoStop

2010 doi
[185]

author author D. P. \ Kingma \ and\ author J. Ba ,\ https://arxiv.org/abs/1412.6980 title Adam: A method for stochastic optimization ( year 2017 ),\ https://arxiv.org/abs/1412.6980 arXiv:1412.6980 [cs.LG] NoStop

2017 arXiv
[186]

Hennick \ and\ author S

author author M. Hennick \ and\ author S. D. \ Baerdemacker ,\ https://arxiv.org/abs/2503.22478 title Almost B ayesian: The fractal dynamics of stochastic gradient descent ( year 2025 ),\ https://arxiv.org/abs/2503.22478 arXiv:2503.22478 [cs.LG] NoStop

2025
[187]

Mingard , author G

author author C. Mingard , author G. Valle-P\'erez , author J. Skalse ,\ and\ author A. A. \ Louis ,\ title title Is SGD a B ayesian sampler? W ell, almost ,\ http://jmlr.org/papers/v22/20-676.html journal journal Journal of Machine Learning Research \ volume 22 ,\ pages 1 ( y...

2021
[188]

author author S. L. \ Smith , author D. Duckworth , author S. Rezchikov , author Q. V. \ Le ,\ and\ author J. Sohl-Dickstein ,\ https://arxiv.org/abs/1806.09597 title Stochastic natural gradient descent draws posterior samples in function space ( year 2018 ),\ https://arxiv.or...

2018 arXiv
[189]

Mandt , author M

author author S. Mandt , author M. D. \ Hoffman ,\ and\ author D. M. \ Blei ,\ title title Stochastic gradient descent as approximate B ayesian inference ,\ http://jmlr.org/papers/v18/17-214.html journal journal Journal of Machine Learning Research \ volume 18 ,\ pages 1 ( yea...

2017
[190]

Raghu , author J

author author M. Raghu , author J. Gilmer , author J. Yosinski ,\ and\ author J. Sohl-Dickstein ,\ title title SVCCA : Singular vector canonical correlation analysis for deep learning dynamics and interpretability ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2017/fi...

2017
[191]

Cagnetta , author L

author author F. Cagnetta , author L. Petrini , author U. M. \ Tomasini , author A. Favero ,\ and\ author M. Wyart ,\ title title How deep neural networks learn compositional data: The random hierarchy model ,\ https://doi.org/10.1103/PhysRevX.14.031001 journal journal Phys. R...

2024 doi
[192]

Aguirre-López , author S

author author F. Aguirre-López , author S. Franz ,\ and\ author M. Pastore ,\ title title Random features and polynomial rules ,\ https://doi.org/10.21468/SciPostPhys.18.1.039 journal journal SciPost Phys. \ volume 18 ,\ pages 039 ( year 2025 ) NoStop

2025 doi
[193]

Hu , author Y

author author H. Hu , author Y. M. \ Lu ,\ and\ author T. Misiakiewicz ,\ https://arxiv.org/abs/2403.08160 title Asymptotics of random feature regression beyond the linear scaling regime ( year 2024 ),\ https://arxiv.org/abs/2403.08160 arXiv:2403.08160 [stat.ML] NoStop

2024 arXiv
[194]

Goldt , author M

author author S. Goldt , author M. M\'ezard , author F. Krzakala ,\ and\ author L. Zdeborov\'a ,\ title title Modeling the influence of data structure on learning in neural networks: The hidden manifold model ,\ https://doi.org/10.1103/PhysRevX.10.041044 journal journal Phys. ...

2020 doi
[195]

Hastie , author A

author author T. Hastie , author A. Montanari , author S. Rosset ,\ and\ author R. J. \ Tibshirani ,\ title title Surprises in high-dimensional ridgeless least squares interpolation ,\ https://doi.org/10.1214/21-AOS2133 journal journal The Annals of Statistics \ volume 50 ,\ p...

2022 doi
[196]

Mei \ and\ author A

author author S. Mei \ and\ author A. Montanari ,\ title title The generalization error of random features regression: Precise asymptotics and the double descent curve ,\ https://doi.org/10.1002/cpa.22008 journal journal Communications on Pure and Applied Mathematics \ volume ...

2022 arXiv
[197]

Goldt , author B

author author S. Goldt , author B. Loureiro , author G. Reeves , author F. Krzakala , author M. Mezard ,\ and\ author L. Zdeborov\' a ,\ title title The G aussian equivalence of generative models for learning with shallow neural networks ,\ in\ https://proceedings.mlr.press/v1...

2022
[198]

Hu \ and\ author Y

author author H. Hu \ and\ author Y. M. \ Lu ,\ title title Universality laws for high-dimensional learning with random features ,\ https://doi.org/10.1109/TIT.2022.3217698 journal journal IEEE Transactions on Information Theory \ volume 69 ,\ pages 1932 ( year 2023 ) NoStop

2022
[199]

Nourdin , author G

author author I. Nourdin , author G. Peccati ,\ and\ author M. Podolskij ,\ title title Quantitative B reuer- M ajor theorems ,\ https://doi.org/10.1016/j.spa.2010.12.006 journal journal Stochastic Processes and their Applications \ volume 121 ,\ pages 793 ( year 2011 ) NoStop

2010 doi
[200]

Barbier \ and\ author N

author author J. Barbier \ and\ author N. Macris ,\ title title The adaptive interpolation method: a simple scheme to prove replica formulas in B ayesian inference ,\ https://doi.org/10.1007/s00440-018-0879-0 journal journal Probability Theory and Related Fields \ volume 174 ,...

2019 doi
[201]

author author R. Monasson ,\ title title Properties of neural networks storing spatially correlated patterns ,\ https://doi.org/10.1088/0305-4470/25/13/019 journal journal Journal of Physics A: Mathematical and General \ volume 25 ,\ pages 3701 ( year 1992 ) NoStop

1992 doi
[202]

Loureiro , author C

author author B. Loureiro , author C. Gerbelot , author H. Cui , author S. Goldt , author F. Krzakala , author M. Mezard ,\ and\ author L. Zdeborov\' a ,\ title title Learning curves of generic features maps for realistic datasets with a teacher-student model ,\ in\ https://pr...

2021
[203]

, author Franz, S

author author Del Giudice, P. , author Franz, S. ,\ and\ author Virasoro, M. A. ,\ title title Perceptron beyond the limit of capacity ,\ https://doi.org/10.1051/jphys:01989005002012100 journal journal J. Phys. France \ volume 50 ,\ pages 121 ( year 1989 ) NoStop

1989 doi
[204]

Loureiro , author G

author author B. Loureiro , author G. Sicuro , author C. Gerbelot , author A. Pacco , author F. Krzakala ,\ and\ author L. Zdeborov\' a ,\ title title Learning G aussian mixtures with generalized linear models: Precise asymptotics in high-dimensions ,\ in\ https://proceedings....

2021
[205]

Lopez , author M

author author B. Lopez , author M. Schroder ,\ and\ author M. Opper ,\ title title Storage of correlated patterns in a perceptron ,\ https://doi.org/10.1088/0305-4470/28/16/005 journal journal Journal of Physics A: Mathematical and General \ volume 28 ,\ pages L447 ( year 1995...

1995 doi
[206]

Chung , author D

author author S. Chung , author D. D. \ Lee ,\ and\ author H. Sompolinsky ,\ title title Classification and geometry of general perceptual manifolds ,\ https://doi.org/10.1103/PhysRevX.8.031003 journal journal Phys. Rev. X \ volume 8 ,\ pages 031003 ( year 2018 ) NoStop

2018 doi
[207]

Rotondo , author M

author author P. Rotondo , author M. Pastore ,\ and\ author M. Gherardi ,\ title title Beyond the storage capacity: Data-driven satisfiability transition ,\ https://doi.org/10.1103/PhysRevLett.125.120601 journal journal Phys. Rev. Lett. \ volume 125 ,\ pages 120601 ( year 2020...

2020 doi
[208]

Pastore , author P

author author M. Pastore , author P. Rotondo , author V. Erba ,\ and\ author M. Gherardi ,\ title title Statistical learning theory of structured data ,\ https://doi.org/10.1103/PhysRevE.102.032119 journal journal Phys. Rev. E \ volume 102 ,\ pages 032119 ( year 2020 ) NoStop

2020 doi
[209]

Sclocchi , author A

author author A. Sclocchi , author A. Favero ,\ and\ author M. Wyart ,\ title title A phase transition in diffusion models reveals the hierarchical nature of data ,\ https://doi.org/10.1073/pnas.2408799121 journal journal Proceedings of the National Academy of Sciences \ volum...

2025 doi
[210]

Saad \ and\ author S

author author D. Saad \ and\ author S. A. \ Solla ,\ title title On-line learning in soft committee machines ,\ https://doi.org/10.1103/PhysRevE.52.4225 journal journal Phys. Rev. E \ volume 52 ,\ pages 4225 ( year 1995 a ) NoStop

1995 doi
[211]

Saad \ and\ author S

author author D. Saad \ and\ author S. Solla ,\ title title Dynamics of on-line gradient descent learning for multilayer neural networks ,\ in\ https://proceedings.neurips.cc/paper_files/paper/1995/file/a1519de5b5d44b31a01de013b9b51a80-Paper.pdf booktitle Advances in Neural In...

1995
[212]

Goldt , author M

author author S. Goldt , author M. S. \ Advani , author A. M. \ Saxe , author F. Krzakala ,\ and\ author L. Zdeborová ,\ title title Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup* ,\ https://doi.org/10.1088/1742-5468/abc61e ...

2020 doi
[213]

author author L. F. \ Cugliandolo ,\ title title Recent applications of dynamical mean-field methods ,\ https://doi.org/https://doi.org/10.1146/annurev-conmatphys-040721-022848 journal journal Annual Review of Condensed Matter Physics \ volume 15 ,\ pages 177 ( year 2024 ) NoStop

2024 doi
[214]

Montanari \ and\ author P

author author A. Montanari \ and\ author P. Urbani ,\ https://arxiv.org/abs/2502.21269 title Dynamical decoupling of generalization and overfitting in large two-layer networks ( year 2025 ),\ https://arxiv.org/abs/2502.21269 arXiv:2502.21269 [stat.ML] NoStop

2025
[215]

Bordelon , author A

author author B. Bordelon , author A. Atanasov ,\ and\ author C. Pehlevan ,\ title title A dynamical model of neural scaling laws ,\ in\ https://proceedings.mlr.press/v235/bordelon24a.html booktitle Proceedings of the 41st International Conference on Machine Learning ,\ series...

2024
[216]

Paquette , author C

author author E. Paquette , author C. Paquette , author L. Xiao ,\ and\ author J. Pennington ,\ title title 4+3 phases of compute-optimal neural scaling laws ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2024/file/1dccfc3ee01871d05e33457c61037d59-Paper-Conference.pdf...

2024
[217]

Lin , author J

author author L. Lin , author J. Wu , author S. M. \ Kakade , author P. L. \ Bartlett ,\ and\ author J. D. \ Lee ,\ title title Scaling laws in linear regression: Compute, parameters, and data ,\ in\ https://proceedings.neurips.cc/paper_files/paper/2024/file/6fcb1afcc1e9c2c82c...

2024
[218]

Oko , author Y

author author K. Oko , author Y. Song , author T. Suzuki ,\ and\ author D. Wu ,\ title title Learning sum of diverse features: computational hardness and efficient gradient-based training for ridge combinations ,\ in\ https://proceedings.mlr.press/v247/oko24a.html booktitle Pr...

2024
[219]

author author T. M. \ Cover ,\ @noop title Elements of information theory \ ( publisher John Wiley & Sons ,\ year 1999 ) NoStop

1999
[220]

Abadi et al

author author M. Abadi et al. ,\ https://www.tensorflow.org/ title TensorFlow : Large-scale machine learning on heterogeneous systems ( year 2015 ),\ note software available from tensorflow.org NoStop

2015
[221]

author author M. D. \ Hoffman \ and\ author A. Gelman ,\ title title The N o- U - T urn S ampler: Adaptively setting path lengths in H amiltonian M onte C arlo ,\ http://jmlr.org/papers/v15/hoffman14a.html journal journal Journal of Machine Learning Research \ volume 15 ,\ pag...

2014
[222]

Bingham et al

author author E. Bingham et al. ,\ title title Pyro: Deep universal probabilistic programming ,\ http://jmlr.org/papers/v20/18-403.html journal journal J. Mach. Learn. Res. \ volume 20 ,\ pages 28:1 ( year 2019 ) NoStop

2019

Pith tools

Reviewed August 4, 2026 · model on record in the stance chip above.

[1] [95]

Xu , author A

author author Y. Xu , author A. Maillard , author L. Zdeborov\'a ,\ and\ author F. Krzakala ,\ https://proceedings.mlr.press/v291/xu25a.html title Fundamental limits of matrix sensing: Exact asymptotics, universality, and applications ( year 2025 ) NoStop

2025

[2] [1]

author author P. L. \ Bartlett , author A. Montanari ,\ and\ author A. Rakhlin ,\ title title Deep learning: a statistical viewpoint ,\ https://doi.org/10.1017/S0962492921000027 journal journal Acta Numerica \ volume 30 ,\ pages 87 ( year 2021 ) NoStop

doi:10.1017/s0962492921000027 2021

[3] [2]

LeCun , author Y

author author Y. LeCun , author Y. Bengio ,\ and\ author G. Hinton ,\ title title Deep learning ,\ https://doi.org/10.1038/nature14539 journal journal Nature \ volume 521 ,\ pages 436 ( year 2015 ) NoStop

doi:10.1038/nature14539 2015

[4] [3]

author author D. J. \ Amit , author H. Gutfreund ,\ and\ author H. Sompolinsky ,\ title title Spin-glass models of neural networks ,\ https://doi.org/10.1103/PhysRevA.32.1007 journal journal Phys. Rev. A \ volume 32 ,\ pages 1007 ( year 1985 ) NoStop

doi:10.1103/physreva.32.1007 1985

[5] [4]

author author E. Gardner ,\ title title The space of interactions in neural network models ,\ https://doi.org/10.1088/0305-4470/21/1/030 journal journal Journal of Physics A: Mathematical and General \ volume 21 ,\ pages 257 ( year 1988 ) NoStop

doi:10.1088/0305-4470/21/1/030 1988

[6] [5]

Gardner \ and\ author B

author author E. Gardner \ and\ author B. Derrida ,\ title title Three unfinished works on the optimal storage capacity of networks ,\ https://doi.org/10.1088/0305-4470/22/12/004 journal journal Journal of Physics A: Mathematical and General \ volume 22 ,\ pages 1983 ( year 1989 ) NoStop

doi:10.1088/0305-4470/22/12/004 1983

[7] [6]

author author H. S. \ Seung , author M. Opper ,\ and\ author H. Sompolinsky ,\ title title Query by committee ,\ in\ https://doi.org/10.1145/130385.130417 booktitle Proceedings of the Fifth Annual Workshop on Computational Learning Theory ,\ series and number COLT '92 \ ( publisher Association for Computing Machinery ,\ address New York, NY, USA ,\ year 1...

arXiv 1992

[8] [7]

Engel , author H

author author A. Engel , author H. M. \ K\"ohler , author F. Tschepke , author H. Vollmayr ,\ and\ author A. Zippelius ,\ title title Storage capacity and learning algorithms for two-layer neural networks ,\ https://doi.org/10.1103/PhysRevA.45.7590 journal journal Phys. Rev. A \ volume 45 ,\ pages 7590 ( year 1992 ) NoStop

work page doi:10.1103/physreva.45.7590 1992