REVIEW 10 cited by
Symbolic Regression with a Learned Concept Library
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We present a novel method for symbolic regression (SR), the task of searching for compact programmatic hypotheses that best explain a dataset. The problem is commonly solved using genetic algorithms; we show that we can enhance such methods by inducing a library of abstract textual concepts. Our algorithm, called LaSR, uses zero-shot queries to a large language model (LLM) to discover and evolve concepts occurring in known high-performing hypotheses. We discover new hypotheses using a mix of standard evolutionary steps and LLM-guided steps (obtained through zero-shot LLM queries) conditioned on discovered concepts. Once discovered, hypotheses are used in a new round of concept abstraction and evolution. We validate LaSR on the Feynman equations, a popular SR benchmark, as well as a set of synthetic tasks. On these benchmarks, LaSR substantially outperforms a variety of state-of-the-art SR approaches based on deep learning and evolutionary algorithms. Moreover, we show that LaSR can be used to discover a novel and powerful scaling law for LLMs.
Forward citations
Cited by 10 Pith papers
-
LLM-Based Scientific Equation Discovery via Physics-Informed Token-Regularized Policy Optimization
PiT-PO adaptively fine-tunes an LLM during symbolic regression search using physics-validity and token-level redundancy constraints, reporting state-of-the-art benchmark results and a periodic-hill turbulence closure.
-
Unified remnant models for aligned-spin, precessing, and eccentric binary black hole mergers
New analytic fits, gwModelRemS/P, predict remnant mass, spin, luminosity, and kick for black hole mergers from equal mass to q=1000, with a neural-flow model for precessing kicks.
-
MOT-SR: Multi-Objective Tool-Augmented Scientific Equation Discovery with Large Language Models
MOT-SR combines tool-augmented data analysis with multi-objective Pareto selection to discover symbolic equations, outperforming LLM-based and classical SR baselines on benchmarks and an EMRI orbital-correction task.
-
DeepInflation: an AI agent for research and model discovery of inflation
An LLM agent with symbolic regression finds simple inflation potentials that match target CMB observables, but the outputs are fitted to the targets rather than independently predicted.
-
Analysis of Error Sources in LLM-based Hypothesis Search for Few-Shot Rule Induction
On 100 list-function tasks, LLM hypothesis search approaches human-level acquisition (0.487 vs 0.521 mean test accuracy) and clearly beats direct program generation (0.359), with hypothesis generation as the main erro...
-
$\mathcal{CP}$-Analyses with Symbolic Regression
Symbolic regression produces analytic, detector-level CP-odd observables for WBF Higgs production and an analytic reconstruction of the Collins-Soper angle in ttH that are competitive with black-box ML and classical methods.
-
DiSciPLE: Learning Interpretable Programs for Scientific Visual Discovery
DiSciPLE uses LLM-guided evolution to discover interpretable Python programs that predict geospatial quantities, outperforming black-box deep nets on population density and on out-of-distribution generalization.
-
VisualPatchWorld: Code World Models as Latent Structured Representations for Planning
A two-level induction procedure—active-probe sketch selection plus multi-step rollout fitting—recovers executable code world models that improve CEM planning over prior code baselines on four LeWM tasks.
-
SAIL: Sound Abstract Interpreters with LLMs
SAIL synthesizes globally sound abstract transformers for neural-network operators by combining LLM generation with syntactic validation, SMT-based soundness checking, and cost-guided iterative refinement.
-
Zobrist Hash-based Duplicate Detection in Symbolic Regression
A Zobrist-hash cache in the Operon framework skips re-evaluation of duplicate expression trees in symbolic regression, giving up to 34% speedups.
Discussion (0). Sign in to comment.