REVIEW 4 major objections 8 minor 35 references
Neural Network Acceleration of Iterative Methods for Nonlinear Schr\"odinger Eigenvalue Problems
T0 review · 4 major / 8 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read A neural network inserted mid-iteration into the energy-adaptive Riemannian conjugate gradient solver for the rotating Gross-Pitaevskii equation cuts iteration counts by 22% on average and wall-clock time by 14.5% over 500 test cases…
desk verdict A useful empirical hybrid acceleration for a hard 2D GPE solver, with an honestly reported but partly inflated headline speed-up that needs a same-minima-only breakdown before the exact numbers should be trusted. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the EARCG iteration on the $L^2$ unit sphere $\mathbb{S} = \{\varphi \in H^1 : \|\varphi\|_{L^2} = 1\}$, equipped with the energy-adaptive metric $g^{\mathrm{a}}_{\varphi}(v,w) = a_{\varphi}(v,w)$ and the normalization retraction. The accelerator is a U-Net, a convolutional encoder-decoder originally built for image segmentation, with 31 million parameters: it takes an $(n,n,4)$ tensor holding the real and imaginary parts of the current state and the current gradient, and outputs an $(n,n,2)$ enhanced state. The mechanism that carries the argument is the acceptance gate: because the network has no normalization layer, the scalar $e = |1 - \|\tilde{\varphi}\|_{L^2}|$ serves as a cheap proxy for proposal quality, and only proposals with $e < e_0 = 5 \times 10^{-3}$ are normalized and fed back into EARCG. This keeps the network a proposal generator inside the original solver rather than an end-to-end surrogate.
What would settle it
Compute the rank correlation between the normalization error $e$ and the true density error $\|\tilde{\rho} - \rho^*\|_{L^1}$ across the 40,000 training pairs; if the correlation is near zero, the acceptance gate is not selecting good proposals and the reported speedups would need a different explanation.
Extended reading notes
Core claim
The central claim is that a single, well-timed neural network proposal can bypass the slowest phase of EARCG for rotating condensates. The network is trained offline on 40,000 pairs gathered from EARCG runs: each pair contains an intermediate state and energy-adaptive gradient at a tolerance in $[10^{-4}, 10^{-1}]$ together with the converged state. When the running solver reaches that tolerance window, the U-Net proposes a new state, and the proposal is accepted only if $|1 - \|\tilde{\varphi}\|_{L^2}| < 5\times 10^{-3}$; the accepted state is normalized and the solver continues to tolerance $10^{-8}$. On 500 test problems this reduces iterations by 22.06% on average (median 19.89%) and wall time by 14.51% (median 13.92%), with density error reduced by 46.20% on average; iteration counts improve in 91.8% of cases and wall time in 75%. The strongest gains occur in near-symmetric traps ($v_1 \approx 1.1$, $v_2 = 1$), where the network learns to rotate the vortex lattice into the preferred orientation, cutting runs such as 25,285 iterations to 267.
Load-bearing premise
The entire acceptance strategy depends on the assumption that a small normalization error $|1 - \|\tilde{\varphi}\|_{L^2}|$ reliably means the neural network's proposal is a good approximation to the ground state; the paper gives no proof or independent validation of that correlation, so a well-normalized but physically wrong proposal would be accepted and a poorly normalized good proposal rejected.
Editorial extensions
If this is right
- A single well-timed network proposal cuts iterations in about 92% of test cases and wall-clock time in 75%, with mean savings of 22.06% and 14.51% respectively across 500 runs.
- The largest gains occur in the near-degenerate trap regime ($v_1 \approx 1.1$, $v_2 = 1$) where EARCG stagnates; reported examples shrink runs from 25,285 to 267 iterations, a 98.94% reduction.
- The normalization-error gate makes acceleration reliable: only 5.3% of runs worsen the density under the strategy, versus 40% under random application of the same network.
- Because Hartree-Fock, Kohn-Sham, and multicomponent BEC problems share the same Riemannian solver structure, the same acceleration workflow transfers with minimal adaptation.
- Allowing multiple accelerations per run and moving inference to a GPU are stated as likely further improvements to wall-time savings.
Reading between the lines
- One could isolate the contribution of the acceptance gate by replacing the U-Net proposals with random states whose normalization errors match the network's; if the speedup persists, the gate rather than the learned content is doing the work.
- The 46% average density-error improvement suggests the network has learned the rotation-alignment step, so an architecture with built-in rotational equivariance might generalize better outside the trained parameter box.
- Because the training data comes entirely from EARCG trajectories, the acceleration is tied to that solver's convergence bias; a network trained on trajectories from a different Riemannian solver may not transfer, which is a natural open question.
- The reported wall-time saving is a CPU-only number; the difference between iteration savings and time savings quantifies inference overhead, and GPU inference is an obvious untested lever.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a neural-network accelerator for the energy-adaptive Riemannian conjugate gradient (EARCG) method applied to ground-state computations of the rotating Gross-Pitaevskii equation. A U-Net is trained offline on EARCG trajectories to map mid-iteration states and gradients to the solver's converged state, and it is inserted once during a prescribed acceleration window. The acceptance of the network output is decided by the L2 normalization error of the prediction, and the algorithm then continues with EARCG to the final tolerance. Numerical experiments on 500 test cases report mean reductions of 22.06% in iteration count, 14.51% in wall-clock time, and 46.20% in density error, together with histograms, best/worst case studies, and a comparison against random application of the network.
Significance. If the reported gains are robust, this is a useful hybrid contribution to nonlinear eigenvalue solvers, complementing end-to-end neural approaches by retaining the classical solver's convergence guarantees while reducing cost in challenging regimes. Strengths include the reproducible open-source repository, a large test set of 500 cases, explicit disclosure of failure cases, and a sensible baseline comparison against random network application. The main weaknesses are statistical: the headline means pool runs that are not like-for-like (different local minima and non-converged classical baselines), and the acceptance heuristic is asserted but not independently validated. These issues are fixable in revision, and the paper's core idea deserves further consideration.
major comments (4)
- [Section 5.2 and 5.4] The headline improvements of 22.06% mean iteration saving and 14.51% mean wall-time saving are computed over all 500 test cases, as stated in Section 5.2 (Figure 8b and Figure 9b), yet the histograms color-code cases where the accelerated and classical runs converge to different local minima (orange). Section 5.4 explicitly excludes such cases from the iteration best/worst analysis because 'local convergence behavior may vary significantly, skewing the result,' which applies equally to the aggregate means. The pooled number also includes 12 runs where the classical method did not converge within 30000 iterations; for those runs the baseline is a stopping cap rather than a converged cost (Figure 19). For a like-for-like acceleration claim, report the mean and median savings restricted to runs where both methods converge to the same local minimum, and report the non-converged-classical cases separately. As written, the 22.06% figure conflates acceleration with changing the target solution (for example, Figure 15 reports a 61.57% iteration saving while the density deteriorates by 67.7%).
- [Section 5.4 and Figure 19] In the best-iteration examples (Section 5.4), the text states that 'in all cases, the classical and enhanced algorithm eventually converged to the same local minimum,' but Figure 19 is included as a best case even though its caption states the classical algorithm 'did not converge within 30000 steps' and the saving is quoted as 98.38% relative to that non-converged cap. This is internally inconsistent. A stopping cap is not an iteration count, and using it as the denominator inflates the saving. Either remove Figure 19 from the best-case analysis or provide a converged classical baseline; the claim of same-minimum convergence must then be adjusted accordingly.
- [Section 4.4] The acceptance strategy 'crucially relies' on the normalization error e = |1 - ||φ̃||_{L2}| as a quality indicator for the network output (Section 4.4). No theoretical justification, calibration, or independent validation of this correlation is provided; the only support is the aggregate improvement of the full strategy over random application. Because the acceptance threshold e0 controls exactly when the accelerator intervenes, a bad proxy could reject the best proposals or accept bad ones, directly affecting the reported speed-up. Provide a validation plot (e.g., e versus the density/energy error on a hold-out set) or an ablation showing the results are stable over a range of e0, and state the proportion of proposals accepted by the threshold in the 500 test runs.
- [Section 5.2] The density-improvement measure imprρ in Section 5.2 is defined relative to ρ∗, 'the reference solution (i.e., the EARCG converged state),' which is also the target the network was trained to predict (Section 4.2). The metric therefore rewards agreement with the classical solver's local minimum rather than with the physical ground state. This is visible in Figure 15, where the accelerated run attains a lower energy than the classical result yet is reported as 67.7% density deterioration. The accuracy claim should be split into (i) agreement with the classical converged state and (ii) comparison of the final energies of the two runs; at present the density-improvement statistic is partially circular and can mislead.
minor comments (8)
- [Abstract and Section 1] The phrase 'promising an order-of-magnitude speedup across a broad class of applications' in the introduction is not supported by the reported average savings (22% iterations, 14.5% wall time); only a few best cases approach an order of magnitude. Qualify this claim.
- [Section 5.2] Report standard deviations or confidence intervals for the mean savings; the histograms show substantial spread (e.g., for random application the mean 5.52% differs markedly from the median 12.62%).
- [Section 5.2] Define what 'correct energy' means in the sentence 'random acceleration converged to the correct energy in 439 cases'; clarify whether this refers to the same local minimum as the classical method or to a global-energy criterion.
- [Section 5.4 and Figure 19] Beyond the major inconsistency, the caption of Figure 19 states 'no estimation of the density improvement can be given,' which contradicts the general exclusion rule in Section 5.3; cross-check all figure captions for consistency with the methodology.
- [Section 4.3] The observation that the non-phase-invariant loss L(φ̂, φ) outperforms the invariant loss L̂(φ̂, φ) = ||ρ̂ - ρ||_{L1} is reported without quantitative evidence; include the training or validation losses for both losses.
- [Section 4.2] The phrase '20 log-equidistantly spaced tolerances' should be '20 logarithmically equidistant tolerances' for clarity.
- [Keywords] The keyword 'Riemmanian' is misspelled; it should be 'Riemannian'.
- [References] Reference [30] is listed as 2025 without a journal or preprint identifier; since Algorithm 1 and the step-size strategy depend on it, provide a stable reference or summarize the relevant details in the text.
Circularity Check
Density-improvement metric is measured against the same EARCG converged states used as training targets, so the 46% figure partly restates the training objective; the 22% iteration and 14.5% wall-time savings remain independent empirical claims.
-
fitted input called prediction
[Section 4.2 (Training data) and Section 5.2 (Benchmarking, imprρ definition)]
"Each training data point then consists of a pair ((φj, gj), φ∗), where φ∗ denotes the converged solution of the EARCG method. ... imprρ = ∥ρ − ρ∗∥L1(Ω) − ∥˜ρ − ρ∗∥L1(Ω) / ∥ρ − ρ∗∥L1(Ω), where φ is the input to the network, ˜φ is its output, φ∗ is the reference solution (i.e., the EARCG converged state) and ρ = |φ(·)|², ˜ρ = |˜φ(·)|², ρ∗ = |φ∗(·)|²."
The reported 46.20% mean density-error reduction measures L1-density distance from the network output to φ*, the EARCG converged state. That φ* is the same object used as the supervised regression target in training: each training datum is ((φj,gj), φ*), with φ* 'the converged solution of the EARCG method'. Hence 'density improvement' is, by construction, a test-set measure of how well the network reproduces the baseline solver's own fixed point. A positive average imprρ is the expected outcome of a successfully trained regressor, so this headline metric partially restates the training objective rather than providing an independent accuracy benchmark.
full rationale
The paper's main contribution is an empirical acceleration claim: neural-network proposals embedded in EARCG reduce iterations by ~22% and wall time by ~14.5% over 500 test cases, with the network trained offline on EARCG trajectories. This central claim is not circular: the network is trained to output the baseline solver's converged state from early iterates, and the benchmark compares total iteration and runtime counts of accelerated vs. unaccelerated runs on fresh random cases, where the result could have been negative (indeed, some worst-case examples show iteration increases). The baseline EARCG is cited from the authors' own prior work [30], but it is a concrete, independently implementable algorithm and its use is transparent, not a load-bearing unverified self-citation. The only construction-level circularity is the density-error metric: imprρ is defined relative to φ*, the same EARCG converged state that serves as the training label, so the 46% 'density improvement' is partly a restatement of training success rather than an independent accuracy measure. Additionally, the paper itself flags two limitations that are correctness concerns, not circularity: the acceptance strategy 'crucially relies' on the normalization error as a quality indicator (Section 4.4) with no theoretical justification, and Section 5.4 excludes different-minima cases from best/worst iteration analysis because 'local convergence behavior may vary significantly, skewing the result,' while the headline means pool those cases. These weaken the statistical interpretation of the speed-up but do not reduce it to its own inputs. Overall circularity score: 4, reflecting one partially self-referential evaluation metric while the central speed-up claim retains independent empirical content.
Assumptions & free parameters
free parameters (6)
- acceleration window lower bound eps1_min =
1e-4
- acceleration window upper bound eps1_max =
1e-1
- final tolerance eps2 =
1e-8
- network application frequency ne =
5
- acceptance threshold e0 =
5e-3
- data augmentation flip probability p =
0.5
assumptions (6)
- domain assumption The rotating Gross-Pitaevskii energy minimization on the L2 unit sphere has well-defined ground states and the Euler-Lagrange formulation (7) characterizes critical points.
- domain assumption Zero Dirichlet boundary conditions on a sufficiently large square introduce negligible truncation error.
- domain assumption Plane wave discretization with kinetic energy cutoff Ecut = 100 is accurate enough for the reported comparisons.
- ad hoc to paper The normalization error e = |1 - ||phi_tilde||_{L2}| is a reliable quality indicator for the neural network output.
- domain assumption Random initial states sampled from a normal distribution and normalized cover the relevant basin structure.
- domain assumption The classical EARCG converged state is a valid reference solution for measuring density improvement.
Cite this review
Pith. "Pith review of Neural Network Acceleration of Iterative Methods for Nonlinear Schr\"odinger Eigenvalue Problems." pith.science (2026). https://pith.science/paper/BRIUYKVM
@misc{pith2026250716349,
author = {Pith},
title = {Pith review of: Neural Network Acceleration of Iterative Methods for Nonlinear Schr\"odinger Eigenvalue Problems},
year = {2026},
howpublished = {\url{https://pith.science/paper/BRIUYKVM}},
note = {Machine review of arXiv:2507.16349}
}
read the original abstract
We present a novel approach to accelerate iterative methods to solve nonlinear Schr\"odinger eigenvalue problems using neural networks. Nonlinear eigenvector problems are fundamental in quantum mechanics and other fields, yet conventional solvers often suffer from slow convergence in extreme parameter regimes, as exemplified by the rotating Bose- Einstein condensate (BEC) problem. Our method uses a neural network to predict and refine solution trajectories, leveraging knowledge from previous simulations to improve convergence speed and accuracy. Numerical experiments demonstrate significant speed-up over classical solvers, highlighting both the strengths and limitations of the approach.
Figures
Figures from the paper (19 more)
Reference graph
Works this paper leans on
-
[1]
J. Adler and O. ¨Oktem. Solving ill-posed inverse problems using iterative deep neural networks. Inverse Problems, 33(12):124007, 2017
work page 2017
-
[2]
R. Altmann, P. Henning, and D. Peterseim. The J-method for the Gross–Pitaevskii eigenvalue problem. Numer. Math., 148:575–610, 2021
work page 2021
-
[3]
R. Altmann, M. Hermann, D. Peterseim, and T. Stykel. Riemannian optimisation meth- ods for ground states of multicomponent bose-einstein condensates, 2025
work page 2025
-
[4]
R. Altmann, D. Peterseim, and T. Stykel. Energy-adaptive Riemannian optimization on the Stiefel manifold. ESAIM Math. Model. Numer. Anal., 56(5):1629–1653, 2022
work page 2022
-
[5]
R. Altmann, D. Peterseim, and T. Stykel. Riemannian Newton methods for energy minimization problems of Kohn–Sham type. J. Sci. Comput., 101, 2024
work page 2024
-
[6]
X. Antoine, A. Levitt, and Q. Tang. Efficient spectral computation of the stationary states of rotating Bose–Einstein condensates by preconditioned nonlinear conjugate gra- dient methods. J. Comput. Phys., 343:92–109, 2017
work page 2017
-
[7]
X.-D. Bai, T. Xu, J. Li, Y.-K. Liu, Y. Zhao, and J. Zhao. Rapid discovering ground states in lee-huang-yang spin-orbit coupled bose-einstein condensates via a coupled-tgnn surrogate model. Phys. Rev. Res., 7:013332, Mar 2025
work page 2025
- [8]
Show all 35 references
-
[9]
W. Bao, Z. Chang, and X. Zhao. Computing ground states of Bose-Einstein condensation by normalized deep neural network.Journal of Computational Physics, 520:113486, 2025
2025
-
[10]
Bao, I-L
W. Bao, I-L. Chern, and F. Y. Lim. Efficient and spectrally accurate numerical methods for computing ground and first excited states in Bose–Einstein condensates. J. Comput. Phys., 219(2):836–854, 2006. 18 D. PETERSEIM, J. F. PIETSCHMANN, J. P¨USCHEL, AND K. RUESS
2006
-
[11]
Bao and Q
W. Bao and Q. Du. Computing the ground state solution of Bose–Einstein condensates by a normalized gradient flow. SIAM J. Sci. Comput., 25(5):1674–1697, 2004
2004
-
[12]
Bao and W
W. Bao and W. Tang. Ground-state solution of Bose–Einstein condensate by directly minimizing the energy functional. J. Comput. Phys., 187(1):230–254, 2003
2003
-
[13]
Canc` es, R
E. Canc` es, R. Chakir, and Y. Maday. Numerical analysis of nonlinear eigenvalue prob- lems. J. Sci. Comput., 45(1-3):90–117, 2010
2010
-
[14]
Canc` es, G
E. Canc` es, G. Kemlin, and A. Levitt. Convergence analysis of direct minimization and self-consistent iterations. SIAM J. Matrix Anal. Appl., 42(1):243–274, 2021
2021
-
[15]
Z. Chen, J. Lu, Y. Lu, and X. Zhang. On the convergence of Sobolev gradient flow for the Gross–Pitaevskii eigenvalue problem. SIAM J. Numer. Anal., 62(2):667–691, 2024
2024
-
[16]
Danaila and P
I. Danaila and P. Kazemi. A new Sobolev gradient method for direct minimization of the Gross–Pitaevskii energy with rotation. SIAM J. Sci. Comput., 32(5):2447–2467, 2010
2010
-
[17]
Danaila and B
I. Danaila and B. Protas. Computation of ground states of the Gross–Pitaevskii func- tional via Riemannian optimization. SIAM J. Sci. Comput., 39(6):B1102–B1129, 2017
2017
-
[18]
C. M. Dion and E. Canc` es. Ground state of the time-independent Gross–Pitaevskii equation. Comput. Phys. Commun., 177(10):787–798, 2007
2007
-
[19]
Du and C.-S
C.-E. Du and C.-S. Liu. Newton–Noda iteration for computing the ground states of nonlinear Schr¨ odinger equations.SIAM J. Sci. Comput., 44(4):A2370–A2385, 2022
2022
-
[20]
J. J. Garc ´ ıa-Ripoll and V. M. P´ erez-Garc ´ ıa. Optimizing Schr¨ odinger functionals using Sobolev gradients: applications to quantum mechanics and nonlinear optics. SIAM J. Sci. Comput., 23(4):1316–1334, 2001
2001
-
[21]
Hauck, Y
M. Hauck, Y. Liang, and D. Peterseim. Positivity preserving finite element method for the gross-pitaevskii ground state: discrete uniqueness and global convergence, 2024
2024
-
[22]
Henning and E
P. Henning and E. Jarlebring. The gross–pitaevskii equation and eigenvector nonlinear- ities: Numerical methods and algorithms. SIAM Review, 67(2):256–317, 2025
2025
-
[23]
Henning and D
P. Henning and D. Peterseim. Sobolev gradient flow for the Gross–Pitaevskii eigenvalue problem: global convergence and computational efficiency. SIAM J. Numer. Anal., 58(3):1744–1772, 2020
2020
-
[24]
M. F. Herbst, A. Levitt, and E. Canc` es. DFTK: A Julian approach for simulating electrons in solids. Proc. JuliaCon Conf., 3:69, 2021
2021
-
[25]
Jarlebring, S
E. Jarlebring, S. Kvaal, and W. Michiels. An inverse iteration method for eigenvalue problems with eigenvector nonlinearities. SIAM J. Sci. Comput., 36(4):A1978–A2001, 2014
2014
-
[26]
Kazemi and M
P. Kazemi and M. Eckart. Minimizing the Gross–Pitaevskii energy functional with the Sobolev gradient – analytical and numerical results. Int. J. Comput. Methods, 7(3):453– 475, 2010
2010
-
[27]
Kohn and L
W. Kohn and L. J. Sham. Self-consistent equations including exchange and correlation effects. Phys. Rev., 140:A1133–A1138, 1965
1965
-
[28]
E. H. Lieb, R. Seiringer, and J. Yngvason. Bosons in a trap: A rigorous derivation of the Gross-Pitaevskii energy functional. Phys. Rev. A, 61, 2000
2000
-
[29]
C. J. Myatt, E. A. Burt, R. W. Ghrist, E. A. Cornell, and C. E. Wieman. Production of two overlapping Bose-Einstein condensates by sympathetic cooling. Phys. Rev. Lett., 78:586–589, 1997
1997
-
[30]
Peterseim, J
D. Peterseim, J. P¨ uschel, and T. Stykel. Energy-adaptive riemannian conjugate gradient method for density functional theory. 2025
2025
-
[31]
Ronneberger, P
O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation, 2015
2015
-
[32]
J. C. Slater. A simplification of the hartree-fock method. Phys. Rev., 81:385–390, Feb 1951
1951
-
[33]
Stenger, S
J. Stenger, S. Inouye, D. M. Stamper-Kurn, H.-J. Miesner, A. P. Chikkatur, and W. Ket- terle. Spin domains in ground-state Bose-Einstein condensates. Nature, 396:345–348, 1998. NEURAL NETWORK ACCELERATION 19
1998
-
[34]
Venkataraman and B
S. Venkataraman and B. Amos. Neural fixed-point acceleration for convex optimization. CoRR, abs/2107.10254, 2021
2021 arXiv
-
[35]
X. Wu, Z. Wen, and W. Bao. A regularized Newton method for computing ground states of Bose–Einstein condensates. J. Sci. Comput., 73:303–329, 2017. (D. Peterseim, J.-F. Pietschmann) Institute of Mathematics & Centre for Advanced Analyt- ics and Predictive Sciences (CAAPS), Uni...
2017
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.