Pith. sign in

REVIEW 3 cited by

Benchmark and Survey of Automated Machine Learning Frameworks

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1904.12054 v5 pith:M2FTJ4C4 submitted 2019-04-26 cs.LG cs.AIstat.ML

classification cs.LGcs.AIstat.ML
keywords automllearningmachinedataframeworksbenchmarkapplicationsautomated
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning (AutoML) aims to reduce the demand for data scientists by enabling domain experts to build machine learning applications automatically without extensive knowledge of statistics and machine learning. This paper is a combination of a survey on current AutoML methods and a benchmark of popular AutoML frameworks on real data sets. Driven by the selected frameworks for evaluation, we summarize and review important AutoML techniques and methods concerning every step in building an ML pipeline. The selected AutoML frameworks are evaluated on 137 data sets from established AutoML benchmark suits.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agents

    cs.LG 2026-02 conditional novelty 6.0 of 10

    LLM agents acting as ML engineers autonomously generated optimizer, architecture, and reward changes that produced small live metric gains at YouTube when deployed through a dual offline/online loop.

  2. Automated Architecture Design for Deep Neural Networks

    cs.LG 2019-08 conditional novelty 4.0 of 10

    The paper reports that an automated forward thinking algorithm achieves about 97.5 percent test accuracy on MNIST, higher than the other architecture design methods it compares.

  3. AutoML: A Survey of the State-of-the-Art

    cs.LG 2019-08 unverdicted novelty 1.0 of 10

    A survey that organizes AutoML into a four-stage pipeline and reviews neural architecture search methods, their performance, and open problems.

Pith tools