REVIEW 7 cited by
AutoML-GPT: Automatic Machine Learning with GPT
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization algorithm, and hyperparameters. Recent advances in large language models (LLMs) like ChatGPT show remarkable capabilities in various aspects of reasoning, comprehension, and interaction. Consequently, we propose developing task-oriented prompts and automatically utilizing LLMs to automate the training pipeline. To implement this concept, we present the AutoML-GPT, which employs GPT as the bridge to diverse AI models and dynamically trains models with optimized hyperparameters. AutoML-GPT dynamically takes user requests from the model and data cards and composes the corresponding prompt paragraph. Ultimately, with this prompt paragraph, AutoML-GPT will automatically conduct the experiments from data processing to model architecture, hyperparameter tuning, and predicted training log. By leveraging {\ours}'s robust language capabilities and the available AI models, AutoML-GPT can tackle numerous intricate AI tasks across various tasks and datasets. This approach achieves remarkable results in computer vision, natural language processing, and other challenging areas. Extensive experiments and ablation studies demonstrate that our method can be general, effective, and beneficial for many AI tasks.
Forward citations
Cited by 7 Pith papers
-
Agentic Bayesian Optimization through Surrogate-Augmented Autoresearch
An LLM agent that fully controls a reconfigurable Bayesian-optimization backend preserves standard BO reliability, outperforms LLM-only optimizers, and exploits natural-language priors and mid-run problem reformulation.
-
iML: Executable, Problem-Grounded, and Broadly Exploratory Code-Driven AutoML
iML's contract-based modular code generation with runtime verification reports 85% valid submissions and a 45% medal rate on MLE-BENCH, ahead of MLZero, MLE-STAR, and AutoML-Agent.
-
Reinforcement Learning for Machine Learning Engineering Agents
RL-trained Qwen2.5-3B outperforms prompted Claude-3.5-Sonnet and GPT-4o on 12 MLEBench tasks by an average of 22% and 24%, using two targeted RL modifications.
-
EvoVLMA: Evolutionary Vision-Language Model Adaptation
An LLM-based evolutionary algorithm automatically designs training-free VLM adaptation code, improving few-shot classification accuracy over manually-designed baselines by up to 1.91 points.
-
Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering
Matryoshka Agent’s orchestrator–sub-agent hierarchy plus tree-ranked RL raises MLE-Dojo HumanRank, letting a 4B orchestrator approach o4-mini and giving a 30B coder up to 36.7% relative gain.
-
Beyond Model Base Retrieval: Weaving Knowledge to Master Fine-grained Neural Network Design
M-DESIGN frames neural network refinement as retrieval over modification-gain graphs, with a Bayesian online update of task similarity and predictive planners for out-of-distribution cases, and reports reaching search...
-
Evaluation of Large Language Model-Driven AutoML in Data and Model Management from Human-Centered Perspective
A 15-participant within-subjects study claims LLM-driven AutoML outperforms traditional AutoML on speed, accuracy, and usability, though supporting data are not provided and several numbers conflict.
Discussion (0). Sign in to comment.