REVIEW 2 major objections 4 minor 1 cited by
A Parareal Algorithm with Low-Rank Coarse Solvers
T0 review · 2 major / 4 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read This paper proposes a Parareal algorithm whose coarse solver is the truncated singular value decomposition of the fine solver's transfer operator, and proves the error after k iterations is governed by the largest discarded singular value.
desk verdict First practical spectral coarse solver for Parareal, with rigorous convergence analysis and broad numerical evidence; the main limitation is that the practical gains depend on fast singular-value decay, which is demonstrated but not proven for general non-normal parabolic operators. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the spectral coarse solver $G_n$, defined as the rank-$R_n$ truncated SVD of the fine solver's linear transfer operator $F'_n$, plus the same affine shift $b_n$ as $F_n$. Its role is to make the fine-coarse difference exactly equal to the tail of the singular value expansion: $\|F_n - G_n\| = \sigma_{n,R_n+1}$. The randomized SVD construction (random initial values, applied to $F'_n$ and its adjoint) is what makes computing these spectral approximations embarrassingly parallel and cheap.
What would settle it
Take a linear parabolic test case where the transfer operators are expected to have slow singular value decay, for instance a heat equation with very small diffusivity or very short Parareal intervals, compute the singular values of $F'_n$, and run the algorithm with rank $R$. If the largest discarded singular value $\varepsilon$ stays close to 1 for any affordable $R$, or the observed error does not follow the predicted $\varepsilon^k$ decay, the paper's characterization of parabolic problems and the practical claim fail.
Extended reading notes
Core claim
The paper's claim is that the coarse solver in Parareal can be a spectral approximation of the fine solver itself. Writing the fine solver $F_n$ as affine with linear part $F'_n$, the coarse solver $G_n$ keeps only the leading $R_n$ singular modes of $F'_n$, so the fine-coarse mismatch has operator norm exactly $\|F'_n - G'_n\| = \sigma_{n,R_n+1}$. The paper proves that the Parareal error satisfies $\|e^k_n\| \le \varepsilon^k \sum_m \binom{n-m}{k-1} \delta^{n-m-k} \|e^0_m\|$, with $\varepsilon = \max_n \sigma_{n,R_n+1}$ and $\delta = \max_n \sigma_{n,1}$, and a simpler $\varepsilon^k$ bound when $\delta \le 1$ or $\delta < 1$. For a time-independent self-adjoint fine solver the estimate sha
Load-bearing premise
The practical speedup rests on the assumption that the fine solver's transfer operators have rapidly decaying singular values, a property demonstrated numerically for parabolic heat problems but not proven in general for the discretized operators used here.
Editorial extensions
If this is right
- For stable fine solvers ($\delta \le 1$), the maximum error after $k$ iterations is at most $\binom{N}{k}\varepsilon^k$, so the iteration count needed for a fixed tolerance is governed directly by the truncation tail $\varepsilon$.
- For a time-independent self-adjoint fine operator, the convergence rate is exactly $\sigma_{R+1}^k$, so the singular value spectrum tells the user in advance which rank gives which speed.
- Because the affine part is the only data-dependent piece of the coarse solver, the same spectral coarse solvers can be reused for new source terms without further setup work.
- Raising the truncation rank $R_n$ converts global Parareal iterations into independent local fine solves in the setup phase, so the method offers a knob to trade communication for parallelism.
- On the 3D heat-sink test case, rank-2 spectral coarse solvers reach an error around $10^{-13}$ with roughly fourfold speedup over sequential integration, while Euler coarse solvers give almost no speedup at that accuracy.
Reading between the lines
- The paper fixes one truncation rank for all intervals; the a posteriori bound it derives suggests a natural extension where each interval's rank is increased adaptively, based on the current Parareal update norms, rather than chosen up front.
- Although the analysis is for linear PDEs, the transfer-operator viewpoint carries over to linearizations of nonlinear flows, so the same spectral coarse solver could be applied to Jacobians in Newton-type integrators; the paper does not explore this.
- The setup phase's cost profile (parallel solves for random initial values, then block solves for many right-hand sides) points toward node-local or GPU batching as the main implementation lever for scaling beyond the direct-solver experiments shown.
- If a target problem has slowly decaying singular values, the paper's own theorem predicts the gains will vanish; a power-iteration or block-Krylov variant would be the natural repair, since the paper notes power iterations exist but does not test them.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a Parareal algorithm in which the coarse propagator G_n is a truncated SVD approximation of the fine transfer operator F_n, including its affine part. The SVD is computed by randomized sampling, so the setup phase is embarrassingly parallel. The authors prove a priori error bounds (Theorems 1 and 2, Corollaries 1–2) showing that the Parareal error after k iterations is controlled by powers of ε = max_n σ_{n,R_n+1}, the largest truncated singular value of the fine-solver transfer operators, and an a posteriori bound (Theorem 3) expressed in terms of the observed Parareal updates. Numerical experiments on one-, two-, and three-dimensional parabolic problems compare exact and randomized SVD coarse solvers with single-step Euler coarse solvers, reporting faster convergence, reduced numbers of fine solves, and speedup over sequential time stepping. Code and data are made available.
Significance. If the results hold, this is a valuable contribution to parallel-in-time methods: it replaces an ad hoc coarse propagator with a low-rank approximation that has a transparent convergence theory, and the construction is embarrassingly parallel. The convergence analysis in Section 3 is rigorous, standard, and self-contained, extending the Gander–Hairer framework to this class of coarse solvers. The numerical experiments are substantial, including a 3D heat-sink problem with 444,693 degrees of freedom, and the paper ships reproducible code and detailed experimental configuration, which is a strength. The paper is also transparent about limitations: the randomized SVD construction is justified mainly numerically, the a posteriori estimator can be inaccurate near machine precision, and the practical speedup relies on rapid singular-value decay of the transfer operators, which is demonstrated empirically but not proven for the whole class of parabolic problems. These caveats are acknowledged in the text, but they should be reflected more carefully in the statements of the theoretical and practical claims.
major comments (2)
- [§2.1, §3, Theorem 1, Eqs. (11)–(12)] Theorem 1 bounds the Parareal error in terms of ε = max_n σ_{n,R_n+1}, the exact truncation singular values of F'_n. However, the coarse solvers used in the numerical experiments are constructed by the randomized SVD of §2.1, so the computed G_n is not the exact rank-R SVD truncation of F'_n. Consequently, the key inequality ∥F'_n − G'_n∥ ≤ σ_{n,R_n+1} used in the proof of Theorem 1 does not hold verbatim for the implemented algorithm. The authors should either supply a probabilistic perturbation estimate for the randomized SVD error (for example using the results of [18]) or explicitly state that the convergence analysis applies to the exact-SVD idealization and that the randomized version is supported by numerical evidence. As written, the abstract's claim of bounds "in terms of the computed singular values" is stronger than what is proved.
- [§4, Fig. 8; §5] The paper concludes that spectral coarse solvers "can dramatically accelerate" Parareal for problems of parabolic type. This claim is supported by the specific examples in Section 4, but the efficiency of the method rests on rapid singular-value decay of the transfer operators F'_n. The decay is observed in Fig. 8 and has been proved for the exact 1D heat equation in prior work [14]; it is not established for variable-coefficient, non-normal, or short-interval cases. If σ_{n,R+1} decays only slowly, ε in (9) is not small for practical ranks, the a priori bounds are weak, and the speedup over Euler coarse solvers can be eroded. The paper should make this assumption explicit in the conclusions and add a short discussion of when such decay can be expected (e.g., diffusion dominance, dependence on interval length). This does not require a new theorem, but it would make the scope of the headl
minor comments (4)
- [Throughout, esp. §4] There are many incorrect cross-references: "top row of Section 3", "Section 4.1" in the text should refer to specific figure numbers. Please correct these to the appropriate Figure labels (e.g., Figure 1, Figure 2, etc.).
- [§4, Figs. 6, 9, 11] The randomized SVD experiments are reported for single realizations only. Since the randomized SVD is stochastic, please either add error bars over several trials or state explicitly that a single representative run is shown.
- [§4.5, Eq. (26), Fig. 13] The efficiency η_k is reported to exceed 1 in some runs, i.e., the a posteriori bound (19) underestimates the actual error. The text attributes this to floating point accuracy, but this means the word "bound" is only valid in exact arithmetic. Please add a sentence in Section 3 noting that (19) is an exact-arithmetic bound and may be violated in floating point computations.
- [§2.2, Table 1] The cost discussion in §2.2 would benefit from a concise summary in the conclusions: the setup phase costs R+1 fine solves and R adjoint solves per interval, and this overhead is part of the speedup comparison. This is already in Table 1, but it is not mentioned in Section 5.
Circularity Check
No significant circularity: the convergence analysis derives the Parareal error bound from the SVD truncation error of the coarse solver, not from observed convergence or fitted constants.
full rationale
The central derivation (Lemma 1, Theorems 1–3) is a direct induction on the Parareal error recursion (8). The key quantities δ = max_n σ_{n,1} and ε = max_n σ_{n,R_n+1} are defined by the SVD of the fine-solver transfer operator and satisfy ‖F′_n − G′_n‖ = σ_{n,R_n+1} by (5), so the bounds (11)–(14) express the contraction of the iteration in terms of the approximation error of the coarse solver. This is a rigorous a priori/a posteriori statement, not a fit of observed Parareal errors. The practical claim that small ranks suffice relies on rapid singular-value decay; the paper supports this by a Fourier argument for the heat equation (Eq. (22)) and by numerical experiments (Fig. 8), and it is explicitly conditional. The self-citation [14] is used for supporting facts (exponential decay of singular values and an analogous proof in a special case), but the main theorem does not reduce to it, and the proof of Theorem 2 is included in the paper. No step in the derivation defines the prediction in terms of the output, fits a parameter to the target quantity, or imports a uniqueness theorem. The only weakness is the unproven but numerically observed singular-value decay assumption for general non-normal parabolic operators; that is a support/correctness concern, not circularity.
Assumptions & free parameters
free parameters (2)
- Truncation rank R_n =
user-chosen (e.g., R=1..6 in experiments)
- Oversampling parameter p =
p=0 or 1 in experiments
assumptions (5)
- domain assumption The fine solver F_n is affine linear, F_n v = F'_n v + b_n, with F'_n compact.
- standard math The SVD of F'_n exists and the truncated SVD error is given by the next singular value σ_{n,R+1}.
- domain assumption The randomized SVD gives accurate approximations of the leading singular values/vectors with high probability.
- domain assumption For linear parabolic PDEs, the transfer operators have rapidly decaying singular values.
- domain assumption Stability: δ = max_n σ_{n,1} ≤ 1 (or < 1) for the linear convergence bounds.
Cite this review
Pith. "Pith review of A Parareal Algorithm with Low-Rank Coarse Solvers." pith.science (2026). https://pith.science/paper/SGP6NGYI
@misc{pith2026250808873,
author = {Pith},
title = {Pith review of: A Parareal Algorithm with Low-Rank Coarse Solvers},
year = {2026},
howpublished = {\url{https://pith.science/paper/SGP6NGYI}},
note = {Machine review of arXiv:2508.08873}
}
read the original abstract
We consider a new class of Parareal algorithms, which use ideas from localized reduced basis methods to construct the coarse solver from truncated SVD approximations of the transfer operators mapping initial values for a given time interval to the solution at the end of the interval. By leveraging randomized singular value decompositions, these low-rank approximations are obtained embarrassingly parallel by computing local fine solutions for random initial values. We show a priori and a posteriori error bounds in terms of the computed singular values of the transfer operators. Our numerical experiments demonstrate that our approach can significantly outperform Parareal with single-step coarse solvers. At the same time, it permits to further increase parallelism in Parareal by trading global iterations for a larger number of independent local solves.
Figures
Figures from the paper (10 more)
Forward citations
Cited by 1 Pith paper
-
A parallel-in-time Newton's method-based ODE solver
Newton's method on the fully discretized ODE, accelerated by parallel prefix sums, solves nonlinear IVPs with logarithmic span per iteration and beats Parareal in GPU runtime comparisons.
Reference graph
Works this paper leans on
-
[18]
N. Halko, P. G. Martinsson, and J. A. Tropp. Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Rev., 53(2):217–288, 2011. doi:10.1137/090771806
-
[14]
A Parareal algorithm without Coarse Propagator?
Martin J. Gander, Mario Ohlberger, and Stephan Rave. A Parareal algorithm without Coarse Propagator?, 2024. arXiv:2409.02673. 25
work page Pith review arXiv 2024
-
[1]
Multi-step variant of the parareal algorithm: convergence analysis and numerics
Katia Ait-Ameur and Yvon Maday. Multi-step variant of the parareal algorithm: convergence analysis and numerics. ESAIM Math. Model. Numer. Anal. , 58(2):673– 694, 2024. doi:10.1051/m2an/2024014
-
[2]
Model reduction of parametrized systems , volume 17 of MS&A
Peter Benner, Mario Ohlberger, Anthony Patera, Gianluigi Rozza, and Karsten Urban, editors. Model reduction of parametrized systems , volume 17 of MS&A. Modeling, Simulation and Applications . Springer, Cham, 2017. Selected papers from the 3rd MoRePaS Conference held at the International School for Advanced Studies (SISSA), Trieste, October 13–16, 2015. d...
-
[3]
Localized model reduction for parameterized problems
Andreas Buhr, Laura Iapichino, Mario Ohlberger, Stephan Rave, Felix Schindler, and Kathrin Smetana. Localized model reduction for parameterized problems. In 24 Peter Benner, Stefano Grivet-Talocia, Alfio Quarteroni, Gianluigi Rozza, Wilhelmus Schilders, and Lu ´ ıs Miguel Silveira, editors,Model Order Reduction (Volume 2) . De Gruyter, Berlin, Boston, 202...
-
[4]
Randomized local model order reduction
Andreas Buhr and Kathrin Smetana. Randomized local model order reduction. SIAM J. Sci. Comput. , 40(4):A2120–A2151, 2018. doi:10.1137/17M1138480
-
[5]
Benjamin Carrel, Martin J. Gander, and Bart Vandereycken. Low-rank parareal: a low-rank parallel-in-time integrator. BIT Numerical Mathematics , 63(1):13, 2023. doi:10.1007/s10543-023-00953-3
-
[6]
Feng Chen, Jan S. Hesthaven, and Xueyu Zhu. On the use of reduced basis methods to accelerate and stabilize the parareal method. Reduced Order Methods for modeling and computational reduction , pages 187–214, 2014. doi:10.1007/ 978-3-319-02090-7_7
work page 2014
Show all 34 references
-
[7]
Lisandro Dalcin and Yao-Lung L. Fang. Mpi4py: Status Update After 12 Years of Development. Computing in Science & Engineering , 23(4):47–54, 2021. doi: 10.1109/MCSE.2021.3083216
2021
-
[8]
Time- parallel implicit integrators for the near-real-time prediction of linear structural dynamic responses
Charbel Farhat, Julien Cortial, Clim` ene Dastillung, and Henri Bavestrello. Time- parallel implicit integrators for the near-real-time prediction of linear structural dynamic responses. International Journal for Numerical Methods in Engineering , 67(5):697–724, 2006. doi:10.1...
2006 doi
-
[9]
Gander and M
M. Gander and M. Petcu. Analysis of a Krylov subspace enhanced parareal algorithm for linear problems. ESAIM: Proceedings, 25:114–129, 2008. doi:10.1051/proc: 082508
2008 doi
-
[10]
Gander and Ernst Hairer
Martin J. Gander and Ernst Hairer. Nonlinear convergence analysis for the parareal algorithm. In Domain decomposition methods in science and engineering XVII , pages 45–56. Springer, 2008. doi:10.1007/978-3-540-75199-1_4
2008 doi
-
[11]
Gander and Ernst Hairer
Martin J. Gander and Ernst Hairer. Analysis for parareal algorithms applied to Hamiltonian differential equations. Journal of Computational and Applied Mathe- matics, 259:2–13, 2014. doi:10.1016/j.cam.2013.01.011
2014 doi
-
[12]
Gander and Thibaut Lunet
Martin J. Gander and Thibaut Lunet. Time Parallel Time Integration . SIAM, Philadelphia, PA, 2024. doi:10.1137/1.9781611978025
2024 doi
-
[13]
Gander, Thibaut Lunet, Daniel Ruprecht, and Robert Speck
Martin J. Gander, Thibaut Lunet, Daniel Ruprecht, and Robert Speck. A unified analysis framework for iterative parallel-in-time algorithms. SIAM J. Sci. Comput. , 45(5):A2275–A2303, 2023. doi:10.1137/22M1487163
2023 doi
-
[15]
Gander and Stefan Vandewalle
Martin J. Gander and Stefan Vandewalle. Analysis of the parareal time-parallel time-integration method. SIAM Journal on Scientific Computing , 29(2):556–578,
-
[16]
Hirstoaga, Van-Thanh Nguyen, and Julien Salomon
Laura Grigori, Sever A. Hirstoaga, Van-Thanh Nguyen, and Julien Salomon. Re- duced model-based parareal simulations of oscillatory singularly perturbed ordi- nary differential equations. J. Comput. Phys. , 436:Paper No. 110282, 18, 2021. doi:10.1016/j.jcp.2021.110282
2021
-
[17]
Tom Gustafsson and G. D. McBain. Scikit-fem: A Python package for finite element assembly. Journal of Open Source Software , 5(52):2369, 2020. doi:10.21105/joss. 02369
2020 doi
-
[19]
The reduced basis technique as a coarse solver for parareal in time simulations
Liping He. The reduced basis technique as a coarse solver for parareal in time simulations. Journal of Computational Mathematics , pages 676–692, 2010. URL: https://www.jstor.org/stable/43693608
2010
-
[20]
Hesthaven, Gianluigi Rozza, and Benjamin Stamm
Jan S. Hesthaven, Gianluigi Rozza, and Benjamin Stamm. Certified reduced basis methods for parametrized partial differential equations. SpringerBriefs in Mathematics. Springer, Cham; BCAM Basque Center for Applied Mathematics, Bilbao, 2016. BCAM SpringerBriefs. doi:10.1007/978...
2016 doi
-
[21]
Optimizing coarse propagators in parareal algo- rithms
Bangti Jin, Qingle Lin, and Zhi Zhou. Optimizing coarse propagators in parareal algo- rithms. SIAM J. Sci. Comput. , 47(2):A735–A761, 2025. doi:10.1137/23M1619733
2025 doi
-
[22]
R. B. Lehoucq, D. C. Sorensen, and C. Yang. ARPACK Users’ Guide . Software, Environments, and Tools. Society for Industrial and Applied Mathematics, 1998. doi:10.1137/1.9780898719628
1998 doi
-
[23]
R´ esolution d’edp par un sch´ ema en temps parar´ eel.Comptes Rendus de l’Acad´ emie des Sciences-Series I-Mathematics, 332(7):661–668, 2001
Jacques-Louis Lions, Yvon Maday, and Gabriel Turinici. R´ esolution d’edp par un sch´ ema en temps parar´ eel.Comptes Rendus de l’Acad´ emie des Sciences-Series I-Mathematics, 332(7):661–668, 2001. doi:10.1016/S0764-4442(00)01793-6
2001 doi
-
[24]
Per-Gunnar Martinsson and Joel A. Tropp. Randomized numerical linear algebra: Foundations and algorithms. Acta Numerica, 29:403–572, 2020. doi:10.1017/ S0962492920000021
2020
-
[25]
R. Milk, S. Rave, and F. Schindler. pyMOR – Generic Algorithms and Interfaces for Model Order Reduction. SIAM Journal of Scientific Computing , 38(5):S194–S216,
-
[26]
Reduced basis methods for partial differential equations , volume 92 of Unitext
Alfio Quarteroni, Andrea Manzoni, and Federico Negri. Reduced basis methods for partial differential equations , volume 92 of Unitext. Springer, Cham, 2016. doi:10.1007/978-3-319-15431-2 . 26
2016 doi
-
[27]
A parareal algorithm with spectral coarse solver (supplement)
Stephan Rave. A parareal algorithm with spectral coarse solver (supplement). Zenodo, 2025. doi:10.5281/zenodo.16780700
2025 doi
-
[28]
Optimal local approximation spaces for parabolic problems
Julia Schleuß and Kathrin Smetana. Optimal local approximation spaces for parabolic problems. Multiscale Model. Simul., 20(1):551–582, 2022. doi:10.1137/20M1384294
2022 doi
-
[29]
Randomized quasi-optimal local approximation spaces in time
Julia Schleuß, Kathrin Smetana, and Lukas Ter Maat. Randomized quasi-optimal local approximation spaces in time. SIAM J. Sci. Comput. , 45(3):A1066–A1096,
-
[30]
Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, St´ efan J
Pauli Virtanen, Ralf Gommers, Travis E. Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, St´ efan J. van der Walt, Matthew Brett, Joshua Wilson, K. Jarrod Millman, Nikolay Mayorov, Andrew R. J. Nelson,...
2020
-
[31]
Toward parallel coarse grid correction for the parareal algorithm
Shu-Lin Wu. Toward parallel coarse grid correction for the parareal algorithm. SIAM J. Sci. Comput. , 40(3):A1446–A1472, 2018. doi:10.1137/17M1141102. 27
2018 doi
-
[2007]
doi:10.1137/05064607X
-
[2016]
doi:10.1137/15M1026614
-
[2023]
doi:10.1137/22M1481002
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.