Separated-Variable Spectral Neural Networks: A Physics-Informed Learning Approach for High-Frequency PDEs
read the original abstract
Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional physics-informed neural networks (PINNs) suffer from spectral bias, limiting their ability to capture high-frequency solution components. We introduce Separated-Variable Spectral Neural Networks (SV-SNN), a novel framework that addresses these limitations by integrating separation of variables with adaptive spectral methods. Our approach features three key innovations: (1) decomposition of multivariate functions into univariate function products, enabling independent spatial and temporal networks; (2) adaptive Fourier spectral features with learnable frequency parameters for high-frequency capture; and (3) theoretical framework based on singular value decomposition to quantify spectral bias. Comprehensive evaluation on benchmark problems including Heat equation, Helmholtz equation, Poisson equations and Navier-Stokes equations demonstrates that SV-SNN achieves 1-3 orders of magnitude improvement in accuracy while reducing parameter count by over 90\% and training time by 60\%. These results establish SV-SNN as an effective solution to the spectral bias problem in neural PDE solving. The implementation will be made publicly available upon acceptance at https://github.com/xgxgnpu/SV-SNN.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equations
FS-PIELM shifts the mean of Gaussian weights (variance fixed at 1) in PIELM to bound frequency variance and achieve 1-5 orders of magnitude better accuracy on high-frequency PDE benchmarks while retaining single linea...
-
Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs
MS-SFNN builds PDE solutions from element-wise products of outputs from d independent fixed-random-weight subnetworks with tunable scaling and cosine activations, then solves coefficients by least squares, claiming su...
-
Gradient Scaling Effects in Adaptive Spectral PINNs for Stiff Nonlinear ODEs
IC gating in adaptive spectral PINNs induces explicit time-dependent gradient scaling that determines relative performance on stiff spring-pendulum ODEs, with exponential gates favored at k=20 and linear gates at k=60.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.