REVIEW 9 cited by
AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline, such as optimal model search and hyperparameter tuning. Existing AutoML systems often require technical expertise to set up complex tools, which is in general time-consuming and requires a large amount of human effort. Therefore, recent works have started exploiting large language models (LLM) to lessen such burden and increase the usability of AutoML frameworks via a natural language interface, allowing non-expert users to build their data-driven solutions. These methods, however, are usually designed only for a particular process in the AI development pipeline and do not efficiently use the inherent capacity of the LLMs. This paper proposes AutoML-Agent, a novel multi-agent framework tailored for full-pipeline AutoML, i.e., from data retrieval to model deployment. AutoML-Agent takes user's task descriptions, facilitates collaboration between specialized LLM agents, and delivers deployment-ready models. Unlike existing work, instead of devising a single plan, we introduce a retrieval-augmented planning strategy to enhance exploration to search for more optimal plans. We also decompose each plan into sub-tasks (e.g., data preprocessing and neural network design) each of which is solved by a specialized agent we build via prompting executing in parallel, making the search process more efficient. Moreover, we propose a multi-stage verification to verify executed results and guide the code generation LLM in implementing successful solutions. Extensive experiments on seven downstream tasks using fourteen datasets show that AutoML-Agent achieves a higher success rate in automating the full AutoML process, yielding systems with good performance throughout the diverse domains.
Forward citations
Cited by 9 Pith papers
-
Scaling Multi-agent Systems: A Smart Middleware for Improving Agent Interactions
Cognitive Fabric Nodes middleware improves multi-agent LLM system performance by over 10% on HotPotQA and MuSiQue datasets by elevating memory to an active substrate for topology selection, semantic grounding, securit...
-
iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML
iML's contract-based modular code generation with runtime verification reports 85% valid submissions and a 45% medal rate on MLE-BENCH, ahead of MLZero, MLE-STAR, and AutoML-Agent.
-
EXP-Bench: Can AI Conduct AI Research Experiments?
EXP-Bench is a new benchmark of 461 end-to-end AI research experiments, and leading AI agents complete fewer than 1 percent of them successfully.
-
Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Models
A two-framework testbed comparison claims mem0 is Pareto-optimal over Graphiti for distributed LLM agents because its lower cost is paired with accuracy that is not significantly different.
-
Aleks: AI powered Multi Agent System for Autonomous Scientific Discovery via Data-Driven Approaches in Plant Science
A three-agent LLM system, Aleks, autonomously chooses problem framing, features, and models for plant disease prediction, with domain knowledge and shared memory improving coherence across iterations.
-
Interpretable by Design: MH-AutoML for Transparent and Efficient Android Malware Detection without Compromising Performance
MH-AutoML is a domain-specific AutoML framework for Android malware detection that combines automated modeling with built-in interpretability, and its evaluation shows competitive recall and higher transparency scores...
-
CoNav: Collaborative Cross-Modal Reasoning for Embodied Navigation
CoNav lets a frozen 3D-text model pass spatial text hints to a lightly fine-tuned image-text navigation agent, improving path efficiency on several VLN benchmarks, though not all claimed state-of-the-art results hold.
-
Large Language Model-Empowered Interactive Load Forecasting
A multi-agent LLM framework enables interactive, natural-language steering of load forecasting pipelines and reports improved accuracy when users provide informed guidance.
-
Evaluation of Large Language Model-Driven AutoML in Data and Model Management from Human-Centered Perspective
A 15-participant within-subjects study claims LLM-driven AutoML outperforms traditional AutoML on speed, accuracy, and usability, though supporting data are not provided and several numbers conflict.
Discussion (0). Sign in to comment.