REVIEW 18 cited by
Wav-KAN: Wavelet Kolmogorov-Arnold Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
In this paper, we introduce Wav-KAN, an innovative neural network architecture that leverages the Wavelet Kolmogorov-Arnold Networks (Wav-KAN) framework to enhance interpretability and performance. Traditional multilayer perceptrons (MLPs) and even recent advancements like Spl-KAN face challenges related to interpretability, training speed, robustness, computational efficiency, and performance. Wav-KAN addresses these limitations by incorporating wavelet functions into the Kolmogorov-Arnold network structure, enabling the network to capture both high-frequency and low-frequency components of the input data efficiently. Wavelet-based approximations employ orthogonal or semi-orthogonal basis and maintain a balance between accurately representing the underlying data structure and avoiding overfitting to the noise. While continuous wavelet transform (CWT) has a lot of potentials, we also employed discrete wavelet transform (DWT) for multiresolution analysis, which obviated the need for recalculation of the previous steps in finding the details. Analogous to how water conforms to the shape of its container, Wav-KAN adapts to the data structure, resulting in enhanced accuracy, faster training speeds, and increased robustness compared to Spl-KAN and MLPs. Our results highlight the potential of Wav-KAN as a powerful tool for developing interpretable and high-performance neural networks, with applications spanning various fields. This work sets the stage for further exploration and implementation of Wav-KAN in frameworks such as PyTorch and TensorFlow, aiming to make wavelets in KAN as widespread as activation functions like ReLU and sigmoid in universal approximation theory (UAT). The codes to replicate the simulations are available at https://github.com/zavareh1/Wav-KAN.
Forward citations
Cited by 18 Pith papers
-
Kolmogorov--Arnold Networks for Small Language Models
In small language models, KAN feed-forward blocks are auditable and pruneable, but on standardized benchmarks and scale tests they show no consistent accuracy, quality, or latency advantage over MLP baselines.
-
A holomorphic Kolmogorov-Arnold network framework for solving elliptic problems on arbitrary 2D domains
A boundary-only holomorphic KAN framework solves Laplace, Helmholtz, and elasticity problems on simply and multiply connected 2D domains, outperforming standard PINNs in the tested cases.
-
Improving Memory Efficiency for Training KANs via Meta Learning
MetaKANs generates each KAN activation function from a shared prompt-conditioned meta-learner, cutting trainable parameters toward MLP level while retaining comparable or better accuracy on tested benchmarks.
-
Probing Quantum Spin Systems with Kolmogorov-Arnold Neural Network Quantum States
SineKAN, a Kolmogorov-Arnold network with sinusoidal activations, accurately represents ground states of 1D spin chains and outperforms RBM, LSTM, and MLP neural quantum states in the J1-J2 model.
-
GS-KAN: Parameter-Efficient Kolmogorov-Arnold Networks via Sprecher-Type Shared Basis Functions
GS-KAN shares one learnable B-spline per layer across all edges, cutting parameter counts to MLP levels while beating MLP/KAN baselines in the tested regimes.
-
ATHENA: Agentic Team for Hierarchical Evolutionary Numerical Algorithms
ATHENA introduces an agentic team framework that autonomously manages the end-to-end computational research lifecycle via a knowledge-driven HENA loop to achieve validation errors of 10^{-14} in scientific computing a...
-
Quantum Variational Activation Functions Empower Kolmogorov-Arnold Networks
QKANs show strong empirical performance on regression, vision, and language tasks, but the claimed exponential parameter reduction is not rigorously established.
-
Toroidal area-preserving parameterizations of genus-one closed surfaces
Four Riemannian optimization algorithms (projected/Riemannian gradient and conjugate gradient) are proposed to compute toroidal area-preserving parameterizations by minimizing stretch energy on a power manifold of ring tori.
-
Multi-Resolution Training-Enhanced Kolmogorov-Arnold Networks for Multi-Scale PDE Problems
MR-PIKAN, a multi-resolution training schedule that alternates coarse and fine collocation grids, cuts training time while keeping accuracy on multi-scale forward and inverse PDE problems.
-
Neural Tangent Kernel Analysis to Probe Convergence in Physics-informed Neural Solvers: PIKANs vs. PINNs
The first NTK analysis of cPIKANs finds their kernel spectra stay stable during training, correlating with large accuracy gains over PINNs, especially when time is split into subdomains.
-
Leveraging KANs for Expedient Training of Multichannel MLPs via Preconditioning and Geometric Refinement
Training in a B-spline KAN basis is equivalent to preconditioned gradient descent on a multichannel ReLU MLP, and geometric refinement plus trainable knots accelerate and improve training.
-
Degree-Optimized Cumulative Polynomial Kolmogorov-Arnold Networks
CP-KAN reformulates polynomial degree selection in Chebyshev-based Kolmogorov-Arnold networks as a QUBO optimization problem and shows competitive regression performance with fewer parameters on several benchmarks.
-
PG-KINN: A Physics-Informed Petrov-Galerkin Kolmogorov-Arnold Network for Solving Forward and Inverse PDEs
PG-KINN pairs a KAN trial space with a Petrov–Galerkin test space for forward and inverse PDEs, but the inverse benchmark data is inconsistent with the governing equation and the accuracy claims are not supported by t...
-
STKAN: Kolmogorov-Arnold Networks for Spatio-Temporal Forecasting
STKAN inserts Taylor-polynomial KAN token mixers into spatial and temporal mixing blocks and achieves small but consistent gains over strong baselines on three traffic-flow benchmarks and a tie on a fourth.
-
SechKAN: Kolmogorov-Arnold Networks with Hyperbolic Secant Functions
SechKAN combines sech basis functions with a 1D linear projection to build a KAN-style model whose parameter count matches MLPs and which is competitive or better than several KAN variants on tested benchmarks.
-
Adversarial Activation Patching: A Framework for Detecting and Mitigating Emergent Deception in Safety-Aligned Transformers
A framework that borrows activation patching to adversarially induce and measure deception, supported only by an underspecified toy network simulation.
-
Multi-Exit Kolmogorov-Arnold Networks: enhancing accuracy and parsimony
Augmenting Kolmogorov-Arnold Networks with prediction exits at each layer improves accuracy and often yields more parsimonious models, and a differentiable learning-to-exit algorithm automates the choice of exit weights.
-
Taylor expansion-based Kolmogorov-Arnold network for blind image quality assessment
A Taylor-expansion KAN variant outperforms B-spline, orthogonal-polynomial, wavelet, and Fourier KAN variants and MLPs on five authentic BIQA databases, with PCA and shallow layers reducing training cost.
Discussion (0). Sign in to comment.