pith. machine review for the scientific record. sign in

arxiv: 1610.02995 · v1 · submitted 2016-10-10 · 💻 cs.LG · cs.AI

Recognition: unknown

Extrapolation and learning equations

Georg Martius , Christoph H. Lampert

Authors on Pith no claims yet
classification 💻 cs.LG cs.AI
keywords functionlearningallowsexpressionsinterpretablenetworkableanalytical
0
0 comments X
read the original abstract

In classical machine learning, regression is treated as a black box process of identifying a suitable function from a hypothesis set without attempting to gain insight into the mechanism connecting inputs and outputs. In the natural sciences, however, finding an interpretable function for a phenomenon is the prime goal as it allows to understand and generalize results. This paper proposes a novel type of function learning network, called equation learner (EQL), that can learn analytical expressions and is able to extrapolate to unseen domains. It is implemented as an end-to-end differentiable feed-forward network and allows for efficient gradient based training. Due to sparsity regularization concise interpretable expressions can be obtained. Often the true underlying source expression is identified.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. KAN: Kolmogorov-Arnold Networks

    cs.LG 2024-04 conditional novelty 8.0

    KANs with learnable univariate spline activations on edges achieve better accuracy than MLPs with fewer parameters, faster scaling, and direct visualization for scientific discovery.

  2. Complex Equation Learner: Rational Symbolic Regression with Gradient Descent in Complex Domain

    cs.LG 2026-05 unverdicted novelty 7.0

    A complex-weight extension to the Equation Learner enables stable recovery of symbolic expressions containing real-domain poles and unconstrained use of singular operators such as division and logarithm.

  3. GESR: A Genetic Programming-Based Symbolic Regression Method with Gene Editing

    cs.AI 2026-05 unverdicted novelty 6.0

    GESR uses two BERT models to intelligently guide mutations and crossovers in genetic programming for symbolic regression, claiming better efficiency than standard GP.

  4. GESR: A Genetic Programming-Based Symbolic Regression Method with Gene Editing

    cs.AI 2026-05 unverdicted novelty 6.0

    GESR uses BERT models as guided 'gene editors' within genetic programming to direct mutations and crossovers, yielding higher efficiency and competitive performance on symbolic regression benchmarks.

  5. GESR: A Genetic Programming-Based Symbolic Regression Method with Gene Editing

    cs.AI 2026-05 unverdicted novelty 6.0

    GESR uses two BERT models to intelligently direct mutations and crossovers inside genetic programming, yielding higher efficiency and competitive accuracy on symbolic regression benchmarks.

  6. Singularity Formation: Synergy in Theoretical, Numerical and Machine Learning Approaches

    math.NA 2026-04 unverdicted novelty 5.0

    The work introduces a modulation-based analytical method for singularity proofs in singular PDEs and refines ML techniques like PINNs and KANs to identify blowup solutions, with application to the open 3D Keller-Segel...

  7. A Comparative Study of Model Selection Criteria for Symbolic Regression

    cs.LG 2026-05 unverdicted novelty 4.0

    MDL and BIC most reliably select low test-error models and recover ground-truth expressions in symbolic regression benchmarks.