REVIEW 6 cited by
Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large Language Models (LLMs) have demonstrated remarkable reasoning abilities, prompting interest in their application as black-box optimizers. This paper asserts that LLMs possess the capability for zero-shot optimization across diverse scenarios, including multi-objective and high-dimensional problems. We introduce a novel population-based method for numerical optimization using LLMs called Language-Model-Based Evolutionary Optimizer (LEO). Our hypothesis is supported through numerical examples, spanning benchmark and industrial engineering problems such as supersonic nozzle shape optimization, heat transfer, and windfarm layout optimization. We compare our method to several gradient-based and gradient-free optimization approaches. While LLMs yield comparable results to state-of-the-art methods, their imaginative nature and propensity to hallucinate demand careful handling. We provide practical guidelines for obtaining reliable answers from LLMs and discuss method limitations and potential research directions.
Forward citations
Cited by 6 Pith papers
-
Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombination
HERO optimizes programs by generating atomic edits without score feedback and selecting the highest-scoring subset of those edits, avoiding the 'weakest-link' failure of accepting or rejecting whole edit bundles.
-
Evolving Deeper LLM Thinking
Mind Evolution, an LLM-driven evolutionary search guided by a programmatic scorer, solves over 98% of TravelPlanner and Natural Plan instances with Gemini 1.5 Pro, outperforming Best-of-N and sequential revision at co...
-
QUBE: Enhancing Automatic Heuristic Design via Quality-Uncertainty Balanced Evolution
QUBE adds a UCB-style uncertainty term to FunSearch's parent selection and finds better heuristics on bin packing and TSP, with cap set gains only over a same-hardware reproduction.
-
REMoH: A Reflective Evolution of Multi-objective Heuristics approach via Large Language Models
REMoH evolves LLM-written heuristics with NSGA-II and a reflection mechanism, reporting competitive FJSSP results that are weakened by test-set selection.
-
Using Large Language Models for Parametric Shape Optimization
An LLM-driven evolutionary search, LLM-PSO, finds near-optimal airfoil and Stokes-flow body shapes on two benchmarks, generally converging faster than classical optimizers.
-
An Overview and Discussion on Using Large Language Models for Implementation Generation of Solutions to Open-Ended Problems
A survey and position paper that reviews LLM prompting, RAG, and RL techniques and argues they could support open-ended implementation generation, without presenting new results.
Discussion (0). Continue with ORCID to comment.