REVIEW 4 major objections 5 minor 39 references
Physics-informed Multiresolution Wavelet Neural Network Method for Solving Partial Differential Equations
T0 review · 4 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read A fixed Shannon wavelet basis plus a single least-squares solve replaces gradient-trained PINNs, yielding higher accuracy and speed on the PDEs the paper tests.
desk verdict A straightforward wavelet least-squares method that works, but the paper overstates its PINN comparison and spectral-bias story. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The multiresolution wavelet neural network (MWNN): a single-hidden-layer network built from Shannon scaling nodes $\phi_{J_0,k}(x)=2^{J_0/2}\operatorname{sinc}(2^{J_0}x/L-k)$ and Shannon wavelet nodes $\psi_{j,k}(x)$ for $j=J_0,\dots,J-1$, so the network output is the truncated multiresolution expansion $f(x)=\sum_k c_{J_0,k}\phi_{J_0,k}(x)+\sum_{j=J_0}^{J-1}\sum_k d_{j,k}\psi_{j,k}(x)$ (Eq. 15). Because the basis is fixed and only the output weights are unknown, substituting the ansatz into the PDE and boundary conditions produces a rectangular linear system whose least-squares solution defines the trained network.
What would settle it
Compute the Gram matrix of the basis functions in Eq. (14) on $[0,1]$ for $J=7$ and $J=9$. If the off-diagonal entries do not approach zero or the matrix condition number grows steeply with $J$, the orthonormality assumption collapses; one would then expect the reported $L^2$ errors for a smooth function like $\exp(x)$ to stop improving as $J$ increases, which is a direct, checkable contradiction.
Extended reading notes
Core claim
The paper's central discovery is that a feed-forward network whose hidden layer consists of Shannon scaling functions at a coarse resolution plus Shannon wavelets at finer resolutions, Eq. (15), can be trained by assembling a linear least-squares system from the PDE, boundary, and initial conditions; no backpropagation or stochastic optimization is needed. Across the tested stationary and time-dependent linear and nonlinear equations, this PIMWNN achieves relative $L^2$ errors that decrease as the resolution $J$ increases, matches or exceeds the accuracy of PINNs while using a fraction of the training time, and reproduces high-frequency spectral content that PINNs lose. The authors argue thi
Load-bearing premise
The convergence and high-frequency claims rest on the assumption that the truncated Shannon scaling and wavelet functions on the finite interval $[0,L]$ form an orthonormal basis whose approximation error shrinks as $J$ grows — but Shannon orthogonality is only guaranteed on the entire real line, not on an interval with a finite set of translations.
Editorial extensions
If this is right
- PDE solving reduces to assembling and solving a linear least-squares system, so training is deterministic, non-iterative for linear problems, and does not depend on optimizer hyperparameters.
- Increasing the finest scale $J$ systematically raises the maximum representable frequency, giving an explicit knob for high-frequency content and a concrete route around spectral bias.
- Time-dependent problems can be solved as a single space-time system (Eqs. 26-28), and nonlinear equations like Burgers can be handled by Picard iteration per time step.
- Because the ansatz is a fixed wavelet basis, the network's approximation capability provably increases with the number of hidden nodes (scale), making the architecture interpretable.
- The mesh-free collocation formulation accommodates irregular domains and Dirichlet boundary conditions without special treatment.
Reading between the lines
- Mathematically, PIMWNN is a spectral collocation method with a Shannon wavelet basis; comparing it against conventional Fourier or Chebyshev collocation with equal degrees of freedom would isolate what the wavelet multiresolution, rather than the least-squares training, contributes to its accuracy.
- The spectral-bias claim conflates ansatz and training algorithm: the fixed linear basis solves all frequencies at once, so a fair test is whether a gradient-descent-trained version of the same MWNN shows the frequency lag that the least-squares version avoids.
- The Shannon basis's orthonormality on the finite interval $[0,L]$ is not automatic — computing the Gram matrix of the truncated basis would reveal whether the convergence theory in Section 2.2 carries over to the actual computational domain.
- The space-time formulation means the method's cost grows with the product of spatial and temporal resolutions; for long-time or high-dimensional problems the authors' own discussion points to domain decomposition as the natural extension.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a physics-informed multiresolution wavelet neural network (PIMWNN) method for solving PDEs. The solution is represented by a single-hidden-layer network whose activations are Shannon scaling and wavelet functions at multiple resolutions; the network is trained by substituting the ansatz into the PDE and boundary/initial conditions and solving the resulting linear least-squares problem. The method is applied to 1D and 2D stationary advection/diffusion equations, a high-frequency Helmholtz problem, a complex-domain diffusion problem, unsteady advection/diffusion equations, and Burgers' equation. The paper claims higher accuracy and faster speed than PINNs and asserts that the method addresses the spectral bias problem by increasing the wavelet scale.
Significance. If the numerical results are reproducible, PIMWNN is a simple and potentially useful least-squares spectral collocation method for moderate-dimensional, smooth PDE problems. Its strengths are the transparent trial basis, the absence of gradient-based optimization, the clean assembly of the least-squares system, and the quantitative relative L2 error reporting together with FFT-based spectral diagnostics. The paper also explicitly acknowledges the high-dimensional limitation of tensor-product wavelet bases. However, the theoretical justification on bounded domains is not established, the reported network-size formula is inconsistent with all tables, and the headline comparison against PINNs rests on a single under-trained baseline. These issues currently prevent the paper from supporting its broader claims.
major comments (4)
- [§2.2, Eqs. (14)–(15)] The multiresolution framework in §2.1 is stated for L2(R), but the construction in Eqs. (14) restricts the Shannon scaling and wavelet functions to [0,L] and to k=0,...,2^j. Shannon functions are orthonormal on R, not on a finite interval; truncating the integer shifts breaks both orthogonality of {φ_{j,k}} and the decomposition property V_j ⊕ W_j = V_{j+1} on [0,L]. Consequently Eq. (13) is not justified as an orthonormal multiresolution expansion, and the claim that approximation accuracy improves as J increases does not follow from the cited theory. The numerical least-squares method may still work with a non-orthogonal trial set, but the theoretical statement in §2.2 and the scale-convergence interpretation of Tables 1–4 need either a proof for the bounded truncated case or a weakened empirical statement.
- [Eq. (15) vs. Tables 1, 3, 4] The formula N = n_J0+1 + Σ_{j=J0}^{J-1}(n_j+1) = 2^J + J - J0 + 1 gives N=136 for J0=0, J=7, but Table 1 reports N=265; the same discrepancy appears throughout Tables 3 and 4 (e.g., J0=0, J=1 yields Table N=7 instead of 4). The tabulated values match 2^{J+1}+J+2, equivalently including the j=J wavelet level in the sum, not the formula in Eq. (15). Since N is the dimension of the least-squares system and the accuracy-versus-scale claim is tied to the network size, this inconsistency must be corrected before the experiments can be reproduced or the scaling behavior assessed.
- [§4.2.2, §5, abstract] The headline comparison with PINNs is supported by exactly one experiment: a 2-hidden-layer, 80-neuron tanh network trained with Adam for 10,000 steps at learning rate 0.001 using DeepXDE. No loss history, final loss, L-BFGS refinement, learning-rate schedule, hyperparameter search, or repeated-seed statistics are reported, and the baseline is not close to convergence for a high-frequency Helmholtz problem. The abstract's statement that PIMWNN achieves 'higher accuracy and faster speed than PINNs' (plural) is therefore not supported; the evidence supports only a comparison with one particular under-trained PINN implementation. I recommend adding at least one fully converged PINN baseline (e.g., Adam followed by L-BFGS, with training curves and relative L2 errors) and, ideally, comparisons with PIELM or randomized neural network methods on the same test problems.
- [§1 contributions, §4.1, §5] The claim that the method 'addresses the spectral bias problem in network training' is not established. The FFT diagnostics in Figs. 2 and 5 show that the Shannon-basis least-squares approximation reproduces the spectrum of the target function; they do not probe the training dynamics of a neural network, and PIMWNN determines its outer-layer weights by solving a linear system rather than by gradient descent. The contribution should be reformulated as 'captures high-frequency components with increasing scale' or 'avoids the gradient-descent spectral bias of PINNs by construction.' As written, the spectral-bias language overstates what the experiments measure.
minor comments (5)
- [§3.3, §4.6] The time-stepping loop and Picard iteration are described only in prose; Algorithm 1 covers only the stationary case. For reproducibility, please state the time loop, the Picard stopping criterion (or explain why fixed K=10 is always sufficient), and report the number of least-squares solves and total CPU time for the Burgers' equation experiment.
- [§4.5.1, §4.5.3] The comparisons against 'deep PINN' and 'PINN' in these subsections are taken from figures in Refs. [27] and [39], not from runs performed by the authors, and no quantitative errors are reported for those baselines. If these comparisons are retained, the source and the exact setup of each baseline should be stated; ideally, the baselines should be rerun with the same error metric.
- [Tables 1–4] Table 2 and Table 4 report N as products such as '7×7' and '152×46'. Please clarify whether these are total numbers of basis functions or per-dimension counts, and align the notation with the formula for N.
- [§4.2.1 and elsewhere] Typographical issues include 'dvection-diffusion' in the section heading, 'Fucntion' in Table 1, 'the the pointwise error' in §4.2.2, and inconsistent use of 'Burger' vs 'Burgers'. These are minor but should be corrected.
- [§2.2, Eq. (14)] The Shannon wavelet formula in Eq. (14b) should be checked against the standard Shannon wavelet definition; the factor 1/2 and the cosine argument affect the generated basis, and any typographical error would propagate into the numerical implementation.
Circularity Check
No significant circularity: PIMWNN weights are solved from PDE residuals and boundary data, and accuracy is assessed against independent exact solutions.
full rationale
The paper's derivation chain is self-contained in the non-circular sense: the MWNN ansatz is inserted into the PDE and boundary conditions (Eqs. 19–21 and 26–28), producing a linear least-squares system whose unknowns are the network weights; the exact solution enters only through the source term, boundary data, and initial data, not through the fitted weights. Reported relative L2 errors are computed against those independent exact solutions, so the accuracy claims are not fitted inputs renamed as predictions. The spectral-bias discussion in Section 5 is a descriptive property of adding higher-scale Shannon wavelets to the trial space rather than a predicted quantity forced by the same data: increasing J by construction adds high-frequency basis functions, but the paper does not derive a quantitative spectral-bias result from the fitted solution itself. The one head-to-head PINN comparison in Section 4.2.2 uses a weak, undertrained baseline, and the bounded-domain orthonormality assumption in Eqs. (14)–(15) is a mathematical rigor gap; both are correctness or benchmark-design concerns, not circularity. The paper contains no load-bearing self-citations and does not invoke a uniqueness theorem from its own authors. Therefore no circular step can be exhibited from the paper's own equations or citations.
Assumptions & free parameters
free parameters (3)
- Resolution levels J0, J (and Jx, Jy in 2D) =
e.g., J0=0, J=7..11 in Table 1; Jx*Jy up to 4x4
- Collocation point counts Nf, Nb (and Nt) =
Nf from 100 to 20,000; Nb from 2 to 400 depending on the example
- Time step dt and Picard iteration count K =
dt=0.001, K=10 for Burgers' equation
assumptions (5)
- ad hoc to paper The truncated Shannon scaling and wavelet functions in Eq. (14) form an orthonormal multiresolution basis on the bounded domain [0,L].
- standard math Multiresolution analysis approximation property: adding wavelets at finer scales guarantees L2 convergence of the network expansion.
- domain assumption The PDE problems considered have classical solutions smooth enough for pointwise collocation of the strong form and for boundary data to be enforced pointwise.
- domain assumption The least-squares problems (21) and (28) are well-conditioned enough that solving them yields a reliable approximation.
- ad hoc to paper Picard iteration for the Burgers' equation converges within the fixed K=10 iterations.
Cite this review
Pith. "Pith review of Physics-informed Multiresolution Wavelet Neural Network Method for Solving Partial Differential Equations." pith.science (2026). https://pith.science/paper/WZWIQY3W
@misc{pith2026250807546,
author = {Pith},
title = {Pith review of: Physics-informed Multiresolution Wavelet Neural Network Method for Solving Partial Differential Equations},
year = {2026},
howpublished = {\url{https://pith.science/paper/WZWIQY3W}},
note = {Machine review of arXiv:2508.07546}
}
read the original abstract
In this paper, a physics-informed multiresolution wavelet neural network (PIMWNN) method is proposed for solving partial differential equations (PDEs). This method uses the multiresolution wavelet neural network (MWNN) to approximate unknown functions, then substituting the MWNN into PDEs and training the MWNN by least-squares algorithm. We apply the proposed method to various problems, including stationary/nonstationary advection, diffusion and advection-diffusion problems, and linear/nonlinear time-dependent problems. Numerical experiments show that the PIMWNN method can achieve higher accuracy and faster speed than Physics Informed Neural Networks (PINNs). Moreover, the PIMWNN method, being mesh-free, can handle different boundary conditions easily and solve the time-dependent problems efficiently. The proposed method is expected to solve the spectral bias problem in network training. These characteristics show the great potential of the PIMWNN method used in the field of numerical solving methods for PDEs.
Figures
Figures from the paper (11 more)
Reference graph
Works this paper leans on
-
[27]
Vikas Dwivedi and Balaji Srinivasan. Physics informed extreme learning machine (pielm) - a rapid method for the numerical solution of partial differential equations.Neurocomputing, 391:96 – 118, 2020
work page 2020
-
[1]
W. E. Machine learning and computational mathematics.Commun. Comput. Phys., 28(5):1639–1670, 2020
work page 2020
-
[2]
Kevrekidis, Lu Lu, Paris Perdikaris, Sifan Wang, and Liu Yang
George Em Karniadakis, Ioannis G. Kevrekidis, Lu Lu, Paris Perdikaris, Sifan Wang, and Liu Yang. Physics-informed machine learning. Nature Reviews Physics, 3:422 – 440, 2021
work page 2021
-
[3]
M.Raissi,P.Perdikaris,andG.E.Karniadakis. Physics-informedneuralnetwork:Adeeplearningframeworkforsolvingforwardandinverse problems involving nonlinear partial differential equations.J. Comput. Phys., 378:686–707, 2019
work page 2019
-
[4]
Hiddenfluidmechanics:Learningvelocityandpressurefieldsfromflowvisualizations
M.Raissi,A.Yazdani,andG.E.Karniadakis. Hiddenfluidmechanics:Learningvelocityandpressurefieldsfromflowvisualizations. Science, 367(6481):1026–1030, 2020
work page 2020
-
[5]
Ameya D. Jagtap, Ehsan. Kharazmi, and G. E. Karniadakis. Conservative physics-informed neural network on discrete domains for conservation laws: Applications to forward and inverse problems.Comput. Methods Appl. Mech. Eng., 365:113028, 2020
work page 2020
-
[6]
Liu Yang, Dongkun Zhang, and G. E. Karniadakis. Physics-informed generative adversarial networks for stochastic differential equations. SIAM Journal on Scientific Computing, 42(1):A292–A317, 2020
work page 2020
-
[7]
Dongkun Zhang, Lu Lu, Ling Guo, and G. E. Karniadakis. Quantifying total uncertainty in physics-informed neural network for solving forward and inverse stochastic problems.J. Comput. Phys., 397:108850, 2019
work page 2019
Show all 39 references
-
[8]
Dongkun Zhang, Ling Guo, and G. E. Karniadakis. Physics-informed generative adversarial networks for stochastic differential equations. SIAM Journal on Scientific Computing, 42(2):A639–A665, 2020
2020
-
[9]
Perdikaris
Yibo Yang and P. Perdikaris. Adversarial uncertainty quantification in physics-informed neural network.J. Comput. Phys., 394:136–152, 2019
2019
-
[10]
G. Pang, L. Lu, and G. E. Karniadakis. fpinns: fractional physics-informed neural networks.SIAM J Sci. Comput., 41(4):A2603–A2626, 2019
2019
-
[11]
W. E and B. Yu. The deep ritz method: a deep-learning based numerical algorithm for solving variational problems.Commun. Math. Stat., 6:1–12, 2018
2018
-
[12]
Liao and P
Y. Liao and P. Ming. Deep nitsche method: deep ritz method with essential boundary conditions.Commun Comput Phys, 29:1365–1384, 2021
2021
-
[13]
Varnet:Variationalneuralnetworksforthesolutionofpartialdifferentialequations
R.Khodayi-MehrandM.Zavlanos. Varnet:Variationalneuralnetworksforthesolutionofpartialdifferentialequations. Learningfordynamics and control, PMLR, 120:298–307, 2020
2020
-
[14]
Mingyuan Yang and John T. Foster. hp-variational physics-informed neural networks for nonlinear two-phase transport in porous media. Journal of Machine Learning for Modeling and Computing, 2:15–32, 2021
2021
-
[15]
Journal of Scientific Computing, 92:100, 09 2022
StefanoBerrone,ClaudioCanuto,andMorenoPintore.Variationalphysicsinformedneuralnetworks:theroleofquadraturesandtestfunctions. Journal of Scientific Computing, 92:100, 09 2022
2022
-
[16]
Zhang, and George Em Karniadakis
Ehsan Kharazmi, Z. Zhang, and George Em Karniadakis. Variational physics-informed neural networks for solving partial differential equations. ArXiv, abs/1912.00873, 2019
1912 arXiv
-
[17]
S. Wang, H. Wang, and P. Perdikaris. Learning the solution operator of parametric partial differential equations with physics-informed deeponets. Sci. Adv., 7:eabi8605, 2021
2021
-
[18]
N. B. Kovachki, Z. Li, B. Liu, K. Azizzadenesheli, K. Bhattacharya, A. M. Stuart, and A. Anandkumar. Neural operator: Learning maps between function spaces with applications to pdes.J. Mach. Learn. Res., 24:1–97, 2023
2023
-
[19]
Waveletsbasedphysicsinformedneuralnetworkstosolvenon-lineardifferential equations
ZiyaUddin,SaiGanga,RishiAsthana,andWubshetIbrahim. Waveletsbasedphysicsinformedneuralnetworkstosolvenon-lineardifferential equations. Scientific Reports, 13:2882, 2023
2023
-
[20]
Dwnn: Deep wavelet neural network for solving partial differential equations.Mathematics, 10(12):1976, 2022
Ying Li, Longxiang Xu, and Shihui Ying. Dwnn: Deep wavelet neural network for solving partial differential equations.Mathematics, 10(12):1976, 2022
1976
-
[21]
Randomizedneuralnetworkwithpetrov–galerkinmethodsforsolvinglinearandnonlinearpartialdifferential equations
Y.Shang,F.Wang,andJ.B.Sun. Randomizedneuralnetworkwithpetrov–galerkinmethodsforsolvinglinearandnonlinearpartialdifferential equations. Communications in Nonlinear Science and Numerical Simulation, 127:107518, 2023
2023
-
[22]
Shang and F
Y. Shang and F. Wang. Randomized neural networks with petrov–galerkin methods for solving linear elasticity and navier–stokes equations. Journal of Engineering Mechanics, 150(4):04024010, 2024
2024
-
[23]
Local randomized neural networks with discontinuous galerkin methods for diffusive-viscous wave equation
Jingbo Sun and Fei Wang. Local randomized neural networks with discontinuous galerkin methods for diffusive-viscous wave equation. Computers & Mathematics with Applications, 154:128–137, 2024
2024
-
[24]
Local randomized neural networks with discontinuous galerkin methods for partial differential equations
Jingbo Sun, Suchuan Dong, and Fei Wang. Local randomized neural networks with discontinuous galerkin methods for partial differential equations. Journal of Computational and Applied Mathematics, 445:115830, 2024
2024
-
[25]
Local randomized neural networks with hybridized discontinuous petrov–galerkin methods for stokes–darcy flows
Haoning Dang and Fei Wang. Local randomized neural networks with hybridized discontinuous petrov–galerkin methods for stokes–darcy flows. Physics of Fluids, 36(8):087138, 08 2024
2024
-
[26]
Localrandomizedneuralnetworkswithfinitedifferencemethodsforinterfaceproblems
YunlongLiandFeiWang. Localrandomizedneuralnetworkswithfinitedifferencemethodsforinterfaceproblems. JournalofComputational Physics, 529:113847, 2025
2025
-
[28]
Wavelet networks.IEEE transactions on neural networks, 36:889–898, 1992
Qinghua Zhang and Albert Benveniste. Wavelet networks.IEEE transactions on neural networks, 36:889–898, 1992
1992
-
[29]
Lukas P. A. Arts and Egon L. van den Broek. The fast continuous wavelet transformation (fcwt) for real-time, high-quality, noise-resistant time–frequency analysis.Nature Computational Science, 2:47 – 58, 2022
2022
-
[30]
Modifiedwaveletneuralnetworkinfunctionapproximationanditsapplicationinpredictionoftime-series pollution data.Appl
ZaritaZainuddinandPaulineOng. Modifiedwaveletneuralnetworkinfunctionapproximationanditsapplicationinpredictionoftime-series pollution data.Appl. Soft Comput., 11:4866 – 4874, 2011
2011
-
[31]
Mehdi Rafiei, Taher Niknam, and Mohammad Hassan Khooban. Probabilistic forecasting of hourly electricity price by generalization of elm for usage in improved wavelet neural network.IEEE Transactions on Industrial Informatics, 13:71 – 79, 2017
2017
-
[32]
B. R. Bakshi and G. Stephanopoulos. Wave-net: a multiresolution, hierarchical neural network with localized learning.AIChE Journal, 39(1):57–81, 1993. F. Han et al.:Preprint submitted to Elsevier Page 20 of 21 Physics-informed Multiresolution Wavelet Neural Network Method for ...
1993
-
[33]
Daubechies
I. Daubechies. Orthogonal bases of compactly supported wavelets.Comm. Pure Appl. Math., 41:909–996, 1988
1988
-
[34]
Solving nonlinear ode and pde problems
Hans Petter Langtangen. Solving nonlinear ode and pde problems. 2016
2016
-
[35]
A unified deep artificial neural network approach to partial differential equations in complex geometries
Jens Berg and Kaj Nyström. A unified deep artificial neural network approach to partial differential equations in complex geometries. Neurocomputing, 317:28 – 41, 2018
2018
-
[36]
Z. Xu, Y. Zhang, T. Luo, Y. Xiao, and Z. Ma. Frequency principle: Fourier analysis sheds light on deep neural networks.Communications in Computational Physics, 28:1746–1767, 2020
2020
-
[37]
On the spectral bias of neural networks.Proceedings of the 36th International Conference on Machine Learning, 97:5301–5310, 2019
Nasim Rahaman, Aristide Baratin, Devansh Arpit, Felix Draxler, Min Lin, Fred Hamprecht, Yoshua Bengio, and Aaron Courville. On the spectral bias of neural networks.Proceedings of the 36th International Conference on Machine Learning, 97:5301–5310, 2019
2019
-
[38]
Deepxde: A deep learning library for solving differential equations.SIAM Review, 63(1):208–228, 2021
Lu Lu, Xuhui Meng, Zhiping Mao, and George Em Karniadakis. Deepxde: A deep learning library for solving differential equations.SIAM Review, 63(1):208–228, 2021
2021
-
[39]
Sparse-regularizedhigh-frequencyenhancedneuralnetwork for solving high-frequency problems.Journal of Computational Physics, 523:113676, 2025
QilinHuang,MingjinFang,DongshengCheng,ChunyuanLu,andTaishanZeng. Sparse-regularizedhigh-frequencyenhancedneuralnetwork for solving high-frequency problems.Journal of Computational Physics, 523:113676, 2025. F. Han et al.:Preprint submitted to Elsevier Page 21 of 21
2025
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.