REVIEW 5 major objections 7 minor 34 references
The Finite Element Neural Network Method: One Dimensional Study
T0 review · 5 major / 7 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read A neural network trained on per-element weak-form residuals can solve 1D differential equations with flux and boundary information built into the loss.
desk verdict A worthwhile 1D proof-of-concept for a variational PINN that recovers flux terms via non-vanishing Lagrange test functions, held back by missing baseline comparisons and an overclaimed equivalence to FEM. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The carrying mechanism is the per-element weak-form residual in Eq. (12): for each element, the boundary flux terms $\phi_k x\, d\hat{U}/dx$ evaluated at element endpoints are kept because the Lagrange test functions $\phi_k$ are nonzero there, while the volume integrals are approximated by Gauss quadrature and written as convolutions with fixed filters $W_q \phi_k(\xi_q)$ and $W_q\, d\phi_k/d\xi$. These filters are defined in local coordinates so the same filters work on any element size, and the squared residuals are averaged over all elements and test functions to form the training loss. The nonvanishing boundary values are what let natural boundary conditions and intermediate forcing enter the loss rather than staying in separate penalty terms.
What would settle it
Train FENNM on the manufactured Poisson problem with a smooth exact solution, then measure the jump of the flux $x\,d\hat{U}/dx$ across every internal element boundary after training. If these flux jumps do not decrease with mesh refinement even as pointwise errors decrease, the boundary flux terms in Eq. (12) are not actually constraining the solution, and the paper's claim that nonvanishing Lagrange test functions embed flux information would be falsified.
Extended reading notes
Core claim
The paper's central claim is that a neural network can serve as the global trial function in a Petrov-Galerkin finite element scheme, provided the test functions are Lagrange polynomials that do not vanish at element boundaries. The resulting per-element weak-form residual, Eq. (12), contains four ingredients: boundary flux terms, lower-order differential operators, the forcing term, and convolution filters built from test functions and quadrature weights. Minimizing the sum of squared residuals over elements and test functions embeds flux continuity, natural boundary conditions, and intermediate point loads directly in the loss, so the network is trained on the same information a classical FEM assembles. The paper supports this by showing error saturation with quadrature order, convergence rates for linear, quadratic, and cubic test functions, and case studies—a cantilever beam with a midspan force, a nonlinear pendulum, convection-dominated transport, and steep Poisson layers—where FENNM reaches pointwise errors near machine precision.
Load-bearing premise
The paper assumes that a sum of squared per-element weak-form residuals—with each internal interface flux counted twice, once per adjacent element—is a faithful training objective that drives the network to the true solution rather than a misleading or overconstrained loss.
Editorial extensions
If this is right
- Natural boundary conditions and intermediate loads, such as a point force, can be imposed inside the residual loss of a single network, removing penalty terms that compete during training.
- Per-element convolution filters compute Gauss quadrature sums in parallel, avoiding the loop over elements that makes hp-VPINN expensive.
- A lower bound on quadrature points follows from the polynomial order of the test functions, and an upper bound is identified by error saturation, so using more points adds cost without accuracy.
- The strong-form residual is never used in training and can be evaluated afterward as an error proxy to drive adaptive mesh refinement, reducing elements by more than half for sharp-layer Poisson problems.
- FENNM can be applied to the time dimension as another coordinate, approximating transient solutions without committing to a time-stepping scheme.
Reading between the lines
- Because the loss squares per-element residuals before summing, internal interface fluxes do not cancel as they would in an assembled global weak form; a direct comparison between FENNM and a Galerkin FEM with identical meshes and test functions would reveal whether this least-squares enforcement of flux continuity improves or degrades conditioning.
- The number of network parameters stays fixed as the mesh is refined, so h-refinement changes only the filters and quadrature points; this opens the door to mesh adaptation without increasing optimization variables, a consequence the paper does not develop.
- The time-as-coordinate treatment in the pendulum case suggests a full space-time formulation in higher dimensions, but multidimensional convolution filters are needed, and whether the method scales there remains open.
- A sharper comparison would pit FENNM against least-squares FEM with the same elements and test functions to isolate the network's contribution from the weak-form least-squares structure.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes FENNM, a Petrov-Galerkin neural solver for one-dimensional differential equations. The neural network supplies the global trial solution, while Lagrange test functions, chosen to be nonvanishing at element boundaries, are used to form per-element weak-form residuals. Gauss quadrature is evaluated with convolution filters following the cv-PINN idea, and the total loss is a mean-squared sum of per-element residuals that includes flux terms, natural boundary conditions, and point or interface forcing terms. The paper presents the derivation, studies the effect of quadrature order and test-function order, reports empirical convergence rates, and demonstrates the method on a cantilever beam with an intermediate point force, damped and undamped pendulums, an advection-diffusion problem with a boundary layer, and Poisson problems with steep layers and discontinuous forcing. It also presents a residual-based adaptive mesh refinement example.
Significance. If substantiated, the method would offer a practical way to combine FEM-like weak-form structure with the flexibility of a single neural network, and the use of convolution for parallel quadrature evaluation is attractive. The derivations in Section 3 are mostly correct, the test suite is broad, and the idea of using the strong-form residual as an a posteriori error proxy is useful. At present, however, the claimed advantages over VPINN, hp-VPINN, and cv-PINN are not demonstrated by direct comparison, the convergence analysis is not a standard discretization convergence analysis, and much of the numerical evidence lacks repeated-run statistics. The manuscript is a promising methods paper but requires substantial strengthening before publication.
major comments (5)
- [Sec. 3, Eq. (12)] The loss in Eq. (12) is a sum of squared per-element weak-form residuals. In assembled FEM, interior flux terms cancel before discrete equations are formed, whereas here they are squared element-by-element; this is a legitimate least-squares Petrov-Galerkin formulation, and zero loss would imply the elementwise weak form holds, so I do not regard it as internally inconsistent. However, the paper does not analyze the minimizer of this functional: there is no consistency, coercivity, or convergence argument relating the minimizer of Eq. (12) to the exact solution as the mesh and the number of quadrature points increase. Because the central claim that FENNM is an FEM-like reliable solver rests on this loss, this gap should be addressed, either theoretically or through a careful numerical study in which the trial-space capacity is also varied.
- [Sec. 4.2, Eq. (27), Fig. 5] The convergence-rate study is not a standard discretization convergence study. The network parameter count, called DoF in Eq. (27), remains fixed (481 parameters) while Nel increases, so h-refinement does not enrich the trial space; the observed error decrease and plateaus are therefore a mix of optimization, quadrature, and round-off effects. Eq. (27) also counts weights and biases, not degrees of freedom of the output manifold, which is particularly misleading in the FEM comparison of Fig. 11, where FEM DoF grows as pNel+1. The authors should either present a genuine approximation-theoretic convergence analysis or substantially soften the convergence-rate and accuracy claims.
- [Abstract, Sec. 4] The paper repeatedly claims advantages over VPINN, hp-VPINN, and cv-PINN (flux information, natural boundary conditions, cost reduction), but no experiment in Section 4 compares FENNM with any of these methods; the numerical comparisons are with analytical solutions, FEM, FDM, and RK45. Direct benchmark comparisons on the same problems, with error and cost or epoch metrics, are required to substantiate the central contribution.
- [Table 1, Sec. 4.3.3] The transport-equation experiment is internally inconsistent: Table 1 lists quartic test functions for Section 4.3.3, while the text and Figure 8 describe linear, quadratic, and cubic test functions for 22, 15, and 11 elements. Since the dependence on test-function order is one of the paper's main messages, the authors must reconcile this mismatch and ensure the reported results correspond to the stated test functions.
- [Secs. 4.3.1-4.3.4] Except for Figures 5 and 11, the numerical case studies are single training runs without repeated initializations, error bars, or a variability statement. The conclusions about accuracy, training histories, and adaptive mesh refinement are therefore not robustly supported. Please provide multiple-seed statistics, or at least a clear statement of observed variability, for the main case studies.
minor comments (7)
- [Secs. 1 and 4.3.1] There are several typos, including 'Neural netowrks' in Section 1 and 'Diriclet' in Section 4.3.1.
- [Eq. (15)] The Neumann boundary conditions in Eq. (15) are garbled: 'd3w/dx2' should presumably be 'd3w/dx3', and the condition at x=L/2 is not written consistently with the flux-jump condition used in Eq. (18a).
- [Eq. (4)] The definition of LB in Eq. (4) has unbalanced parentheses and an ambiguous factor of 1/NB; please rewrite it for clarity.
- [Sec. 4.3.4] The phrase 'introduced a prior noise' should be 'introduced a priori noise' or 'introduced some noise'; the current wording is unclear.
- [Sec. 3, Eq. (12)] Please clarify how the 'predefined' convolution filters are applied when Jx varies per element: Eq. (12) places Jx inside Filters2, so those filter weights are not mesh-independent unless additional per-element scaling is performed; the text should describe the implementation used for nonuniform and adaptively refined meshes.
- [Sec. 4.3.4] The adaptive mesh refinement rule is described only qualitatively as 'elements with high residuals'; please specify the quantitative criterion, such as a threshold on the DE residual, and how elements are split or coarsened.
- [Appendix 7] Appendix 7 counts total network parameters, weights plus biases, in Eq. (27) and calls them degrees of freedom; this terminology should be changed to 'network parameters' or the DoF concept should be defined properly.
Circularity Check
No significant circularity: the central loss is the PDE weak-form residual, and all accuracy claims are benchmarked against external reference solutions.
full rationale
The paper's central object is the per-element weak-form residual in Eq. (12). This residual is obtained from the governing differential equation by integration by parts with Lagrange test functions; the network minimizes this residual directly. There is no fitted parameter that is later renamed a prediction, and no quantity in the loss is defined in terms of the solution it claims to predict. The only free choices are test-function order and quadrature point count, which are tuned empirically in Sec. 4.1 but not used to generate the benchmark answers. The verification case studies compare FENNM output against exact manufactured solutions, FEM, FDM, and RK45, so the claimed accuracy is externally anchored. The load-bearing prior work (cv-PINN convolution machinery, hp-VPINN weak formulation) is cited to external authors; the reference list contains no self-citations by the present authors, so there is no self-citation chain forcing the result. The skeptical concern that the convergence study fixes network DoF while refining the mesh is a legitimate limitation of the numerical study, but it is not circularity: it concerns what the measured convergence rates mean, not whether the loss reduces to its inputs. Similarly, the claim that flux information embeds natural BCs follows from the algebra of integration by parts, not from naming. Accordingly, no circular step can be quoted, and the honest finding is no significant circularity (score 0).
Assumptions & free parameters
free parameters (5)
- Quadrature points per element q =
3 to 15 depending on case and test order
- Mesh element count Nel =
1 to 1000 depending on case
- Penalty weights τR and τB =
Not reported (adaptively updated)
- Network depth ℓ and width N =
2-4 layers, 20 neurons
- Activation function =
tanh or sin per case
assumptions (5)
- standard math Integration by parts produces the flux terms in Eq. (12) exactly as in standard FEM weak forms.
- domain assumption The neural network can represent the solution well enough for the weak-form residual to be minimized to machine precision.
- ad hoc to paper Minimizing the sum of squared per-element residuals in Eq. (12) is equivalent to satisfying the weak form and does not introduce spurious solutions or harmful overconstraints.
- ad hoc to paper Predefined convolution filters remain valid on nonuniform adaptive meshes even though the Jacobian Jx appears inside Filters2 in Eq. (12).
- standard math Gauss quadrature with q >= (p+1)/2 points exactly integrates polynomial terms of order p.
Cite this review
Pith. "Pith review of The Finite Element Neural Network Method: One Dimensional Study." pith.science (2026). https://pith.science/paper/C6EWHD44
@misc{pith2026250112508,
author = {Pith},
title = {Pith review of: The Finite Element Neural Network Method: One Dimensional Study},
year = {2026},
howpublished = {\url{https://pith.science/paper/C6EWHD44}},
note = {Machine review of arXiv:2501.12508}
}
read the original abstract
The potential of neural networks (NN) in engineering is rooted in their capacity to understand intricate patterns and complex systems, leveraging their universal nonlinear approximation capabilities and high expressivity. Meanwhile, conventional numerical methods, backed by years of meticulous refinement, continue to be the standard for accuracy and dependability. Bridging these paradigms, this research introduces the finite element neural network method (FENNM) within the framework of the Petrov-Galerkin method using convolution operations to approximate the weighted residual of the differential equations. The NN generates the global trial solution, while the test functions belong to the Lagrange test function space. FENNM introduces several key advantages. Notably, the weak-form of the differential equations introduces flux terms that contribute information to the loss function compared to VPINN, hp-VPINN, and cv-PINN. This enables the integration of forcing terms and natural boundary conditions into the loss function similar to conventional finite element method (FEM) solvers, facilitating its optimization, and extending its applicability to more complex problems, which will ease industrial adoption. This study will elaborate on the derivation of FENNM, highlighting its similarities with FEM. Additionally, it will provide insights into optimal utilization strategies and user guidelines to ensure cost-efficiency. Finally, the study illustrates the robustness and accuracy of FENNM by presenting multiple numerical case studies and applying adaptive mesh refinement techniques.
Figures
Figures from the paper (10 more)
Reference graph
Works this paper leans on
-
[1]
D. S. Burnett, Finite element analysis: from concepts to applications . Addison-Wesley Pub. Co., 1987
work page 1987
-
[2]
Reddy, An Introduction to the Finite Element Method
J. Reddy, An Introduction to the Finite Element Method . McGraw-Hill, 1993
work page 1993
-
[3]
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,
M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational physics , vol. 378, pp. 686–707, 2019
2019
-
[4]
From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning,
J. D. Toscano, V. Oommen, A. J. Varghese, Z. Zou, N. A. Daryakenari, C. Wu, and G. E. Karniadakis, “From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning,” Oct. 2024, arXiv:2410.13228. [Online]. Available: http://arxiv.org/abs/2410.13228
arXiv 2024
-
[5]
Neural-network-based approximations for solv- ing partial differential equations,
M. G. Dissanayake and N. Phan-Thien, “Neural-network-based approximations for solv- ing partial differential equations,” communications in Numerical Methods in Engineering , vol. 10, no. 3, pp. 195–201, 1994
work page 1994
-
[6]
Nonlinear approximation and (deep) relu networks,
I. Daubechies, R. DeVore, S. Foucart, B. Hanin, and G. Petrova, “Nonlinear approximation and (deep) relu networks,” Constructive Approximation, vol. 55, no. 1, pp. 127–172, 2022
work page 2022
-
[7]
Function approximation by deep networks
H. N. Mhaskar and T. Poggio, “Function approximation by deep networks,”arXiv preprint arXiv:1905.12882, 2019
work page Pith review arXiv 1905
-
[8]
A. D. Jagtap, E. Kharazmi, and G. E. Karniadakis, “Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems,” Computer Methods in Applied Mechanics and Engineering, vol. 365, p. 113028, 2020
work page 2020
Show all 34 references
-
[9]
hp-vpinns: Variational physics-informed neural networks with domain decomposition,
E. Kharazmi, Z. Zhang, and G. E. Karniadakis, “hp-vpinns: Variational physics-informed neural networks with domain decomposition,” Computer Methods in Applied Mechanics and Engineering, vol. 374, p. 113547, 2021
2021
-
[10]
Variational physics-informed neural networks for solving partial differential equa- tions,
——, “Variational physics-informed neural networks for solving partial differential equa- tions,” arXiv preprint arXiv:1912.00873 , 2019
1912 arXiv
-
[11]
Hidden physics models: Machine learning of nonlinear partial differential equations,
M. Raissi and G. E. Karniadakis, “Hidden physics models: Machine learning of nonlinear partial differential equations,” Journal of Computational Physics , vol. 357, pp. 125–141, December 2017
2017
-
[12]
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,
M. Raissi, P. Perdikaris, and G. E. Karniadakis, “Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations,” Journal of Computational Physics , vol. 378, pp. 686–707, November 2019
2019
-
[13]
Self-adaptive physics-informed neural networks,
L. D. McClenny and U. M. Braga-Neto, “Self-adaptive physics-informed neural networks,” Journal of Computational Physics , vol. 474, p. 111722, 2023
2023
-
[14]
Understanding and mitigating gradient pathologies in physics-informed neural networks,
S. Wang, Y. Teng, and P. Perdikaris, “Understanding and mitigating gradient pathologies in physics-informed neural networks,” arXiv preprint arXiv:2001.04536 , 2020. 25
2001 arXiv
-
[15]
cv-pinn: Efficient learning of variational physics-informed neural network with domain decomposition,
C. Liu and H. Wu, “cv-pinn: Efficient learning of variational physics-informed neural network with domain decomposition,” Extreme Mechanics Letters , vol. 63, p. 102051, 2023
2023
-
[16]
Fastvpinns: Tensor-driven acceleration of vpinns for complex geometries,
T. Anandh, D. Ghose, H. Jain, and S. Ganesan, “Fastvpinns: Tensor-driven acceleration of vpinns for complex geometries,” arXiv preprint arXiv:2404.12063 , 2024
2024 arXiv
-
[17]
Nonlinear approximation,
R. A. DeVore, “Nonlinear approximation,” Acta numerica, vol. 7, pp. 51–150, 1998
1998
-
[18]
Nonlinear approximation and its applications,
——, “Nonlinear approximation and its applications,” in Multiscale, Nonlinear and Adap- tive Approximation: Dedicated to Wolfgang Dahmen on the Occasion of his 60th Birthday . Springer, 2009, pp. 169–201
2009
-
[19]
Approximation using scattered shifts of a multivariate function,
R. DeVore and A. Ron, “Approximation using scattered shifts of a multivariate function,” Transactions of the American Mathematical Society, vol. 362, no. 12, pp. 6205–6229, 2010
2010
-
[20]
Greedy deep dictionary learning,
S. Tariyal, A. Majumdar, R. Singh, and M. Vatsa, “Greedy deep dictionary learning,” arXiv preprint arXiv:1602.00203 , 2016
2016 arXiv
-
[21]
Self-adaptive physics-informed neural networks using a soft attention mechanism,
L. McClenny and U. Braga-Neto, “Self-adaptive physics-informed neural networks using a soft attention mechanism,” arXiv preprint arXiv:2009.04544 , 2020
2009 arXiv
-
[22]
Training a 3-node neural network is np-complete,
A. Blum and R. Rivest, “Training a 3-node neural network is np-complete,” Advances in neural information processing systems , vol. 1, 1988
1988
-
[23]
Numerical analysis,
R. L. Burden and J. D. Faires, “Numerical analysis,” 2010
2010
-
[24]
A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks,
C. Wu, M. Zhu, Q. Tan, Y. Kartha, and L. Lu, “A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks,” Computer Methods in Applied Mechanics and Engineering , vol. 403, p. 115671, 2023
2023
-
[25]
Physics-informed neural networks with residual/gradient-based adaptive sampling methods for solving pdes with sharp solutions,
Z. Mao and X. Meng, “Physics-informed neural networks with residual/gradient-based adaptive sampling methods for solving pdes with sharp solutions,” arXiv preprint arXiv:2302.08035, 2023
2023 arXiv
-
[26]
Extended physics-informed neural networks (xpinns): A generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations,
A. D. Jagtap and G. E. Karniadakis, “Extended physics-informed neural networks (xpinns): A generalized space-time domain decomposition based deep learning framework for nonlinear partial differential equations,” Communications in Computational Physics , vol. 28, no. 5, 2020
2020
-
[27]
Varnet: Variational neural networks for the solution of partial differential equations,
R. Khodayi-Mehr and M. Zavlanos, “Varnet: Variational neural networks for the solution of partial differential equations,” in Learning for dynamics and control . PMLR, 2020, pp. 298–307
2020
-
[28]
Variational physics informed neural networks: the role of quadratures and test functions,
S. Berrone, C. Canuto, and M. Pintore, “Variational physics informed neural networks: the role of quadratures and test functions,” Journal of Scientific Computing , vol. 92, no. 3, p. 100, 2022
2022
-
[29]
Automatic differen- tiation in machine learning: a survey,
A. G. Baydin, B. A. Pearlmutter, A. A. Radul, and J. M. Siskind, “Automatic differen- tiation in machine learning: a survey,” Journal of machine learning research , vol. 18, no. 153, pp. 1–43, 2018. 26
2018
-
[30]
Adam: A method for stochastic optimization,
D. P. Kingma, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014
2014 arXiv
-
[31]
On the limited memory bfgs method for large scale optimiza- tion,
D. C. Liu and J. Nocedal, “On the limited memory bfgs method for large scale optimiza- tion,” Mathematical programming, vol. 45, no. 1, pp. 503–528, 1989
1989
-
[32]
A dual-dimer method for training physics-constrained neural net- works with minimax architecture,
D. Liu and Y. Wang, “A dual-dimer method for training physics-constrained neural net- works with minimax architecture,” Neural Networks, vol. 136, pp. 112–125, 2021
2021
-
[33]
Fluid flow and heat transfer of liquid-liquid two phase flow in microchannels: A review,
A. Abdollahi, R. N. Sharma, and A. Vatani, “Fluid flow and heat transfer of liquid-liquid two phase flow in microchannels: A review,” International Communications in Heat and Mass Transfer, vol. 84, pp. 66–74, 2017
2017
-
[34]
M. G. Larson and F. Bengzon, The finite element method: theory, implementation, and applications. Springer Science & Business Media, 2013, vol. 10. 27
2013
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.