Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

AutoML: A Survey of the State-of-the-Art

T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read This survey claims that a single document can organize the entire AutoML pipeline, from data preparation through model evaluation, and that this full-pipeline view is what earlier surveys lacked.

desk verdict A broad, readable AutoML survey whose comparative NAS tables are the main value but also the main liability: treat the tables as a rough map, not a ranking. read the letter →

arxiv 1908.00709 v6 pith:A3U7ESYA submitted 2019-08-02 cs.LG cs.CVstat.ML

classification cs.LGcs.CVstat.ML
keywords automatedmachinelearningneuralarchitecturesearchhyperparameteroptimizationdatapreparationfeatureengineeringmodelevaluationdeeppipelinesurvey
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper is a survey that tries to establish a broad, current map of automated machine learning (AutoML) organized by the stages of the deep-learning pipeline: data preparation, feature engineering, model generation, and model evaluation. Its distinctive claim is coverage: unlike prior surveys that treat only neural architecture search (NAS) or only hyperparameter optimization, it covers all four stages in one document, with the most space given to NAS as the currently dominant sub-topic. The paper also compiles the reported accuracy and GPU-day cost of representative NAS algorithms on CIFAR-10 and ImageNet, and uses that snapshot to discuss one- versus two-stage NAS, one-shot NAS, joint hyperparameter and architecture optimization, and resource-aware search. A sympathetic reader would value this as an entry point that supplies the field's vocabulary, taxonomy, and open problems in one pass. The survey's own caveat is that the compiled comparisons are not perfectly fair because methods were evaluated under different settings.

What carries the argument

The load-bearing device is the AutoML pipeline itself: a four-stage diagram (data preparation, feature engineering, model generation, model evaluation) that the survey uses as its table of contents. Within model generation, the paper's NAS taxonomy, which places every algorithm along three dimensions (search space, architecture optimization method, and model evaluation method), does the analytical work of organizing a large literature. The comparison tables use the GPU-day metric, defined as $N \times D$ where $N$ is the number of GPUs and $D$ the number of days, as the standard unit of search cost.

What would settle it

Run a representative set of the Table 3 and Table 4 methods, such as DARTS, ENAS, RandomNAS, AmoebaNet-B, and P-DARTS, on identical GPUs, epochs, batch sizes, and augmentation settings, then compare the rank order by accuracy and GPU days; if the reported order changes materially, the survey's comparative claims fail.

Watch

Extended reading notes

Core claim

The paper's central claim is that it covers a broader range of AutoML methods than earlier surveys [10, 45, 46, 9, 8], because it follows the complete pipeline rather than a single sub-topic. On its own terms, it establishes an organizational scheme: data preparation (collection, cleaning, augmentation), feature engineering (selection, construction, extraction), model generation (search space plus optimization), and model evaluation (low fidelity, weight sharing, surrogates, early stopping). Within NAS it reports that search spaces can be entire-structured, cell-based, hierarchical, or morphism-based, and that architecture optimization methods divide into evolutionary algorithms, reinforcement learning, gradient descent, surrogate-model-based optimization, grid and random search, and hybrids. It further argues that gradient-based and random-search methods now achieve results comparable to earlier RL and EA methods at a fraction of the cost, and that one-shot and weight-sharing NAS exhibit a bias that decoupled optimization tries to fix. The paper concludes by listing open problems: flexible search spaces, interpretability, reproducibility, robustness, joint hyperparameter and architecture optimization, complete pipeline systems, and lifelong learning.

Load-bearing premise

The survey's comparative snapshot of NAS methods assumes that accuracy and GPU-day figures collected from different papers, using different hardware, training budgets, and augmentation schemes, are comparable enough to support the trends it draws.

Editorial extensions

If this is right

  • A newcomer can acquire from one document an organized picture of AutoML's complete pipeline rather than stitching together separate surveys for NAS, hyperparameter optimization, and feature engineering.
  • The compiled tables give a rough cost-versus-accuracy landscape: early reinforcement-learning and evolutionary searches cost thousands of GPU days, while differentiable and random-search approaches complete in under a day with competitive accuracy.
  • The one-shot and weight-sharing distinction implies that NAS results should be evaluated for rank correlation between search and evaluation stages, not only final accuracy, and that the Kendall Tau metric is a meaningful diagnostic.
  • The open-problems list frames concrete research targets: flexible search spaces free of human bias, interpretable search decisions, reproducible NAS benchmarks, robustness to noisy and adversarial data, and joint optimization of hyperparameters and architectures.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the breadth claim holds, then AutoML is best understood as a pipeline-integration problem rather than a single algorithm family, which suggests that progress in one stage, such as data augmentation, can shift the value of methods in another stage.
  • The paper's own fairness caveat implies that Tables 3 and 4 should not be used to rank methods; a reader should treat them as existence proofs and cost anecdotes until controlled benchmarks settle the order.
  • A natural testable extension of the survey's logic is to build a single benchmark suite that varies training settings and augmentation across all four pipeline stages, extending the NAS-Bench idea to data preparation and feature engineering.
  • The competitive performance of random search reported for NAS suggests that the field's real advantage may lie in search-space design and evaluation fidelity rather than in the optimizer itself, a hypothesis the survey does not fully pursue.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This manuscript is a survey of automated machine learning organized around the ML pipeline: data preparation, feature engineering, model generation, and model evaluation. The largest part is devoted to neural architecture search, covering search spaces, architecture optimization methods, model-evaluation acceleration, and a comparative summary of representative NAS algorithms on CIFAR-10 and ImageNet. It also discusses one/two-stage NAS, one-shot NAS, joint hyperparameter and architecture optimization, resource-aware NAS, and several open problems. The authors' stated contribution is breadth relative to earlier surveys, which they support with a comparison table of existing surveys.

Significance. If the factual content is corrected, the survey would be a useful single-document entry point: it compiles a wide set of references across all pipeline stages, reproduces several central equations (DARTS relaxation, Eq. 4; bilevel objective, Eq. 5; Gumbel-Softmax, Eq. 8; MnasNet objective, Eq. 12) faithfully, and organizes NAS topics in a way that is helpful for newcomers. The main added value beyond earlier NAS-focused surveys is the pipeline-level coverage and the compiled comparison tables in Tables 3 and 4. The usefulness of those tables, however, is the weakest point: several entries appear to be transcription errors, and the resource metric is hardware-incomparable. These issues are fixable, so they do not invalidate the survey's organizational contribution, but they do require substantive revision.

major comments (3)
  1. [Table 4, DARTS row] Table 4 lists DARTS (searched on CIFAR-10) as achieving ImageNet top-1/top-5 accuracy of 73.3/81.3. The original DARTS paper (Liu et al., ICLR 2019) reports a top-5 accuracy of about 91.3% in this setting, so the 81.3 entry is almost certainly a transcription error. Because Tables 3 and 4 are presented as a global performance comparison and feed the qualitative conclusions in Section 6.1, this error should be corrected and the tables should be checked against the primary sources.
  2. [Table 3, RENASNet row] Table 3 lists RENASNet+c/o at 91.12% top-1 accuracy on CIFAR-10, while every neighboring method is in the 96–98% range. This is almost certainly a misprint for 97.12; as printed, it would place an EA+RL method far below its actual performance and distort the method-class comparison in Section 6.1.
  3. [Section 6.1, Eq. (9)] GPU Days defined in Eq. (9) as N×D is not comparable across rows because Tables 3 and 4 mix K40, P100, 1080Ti, Titan, Titan Xp, V100, and 2080Ti hardware with no normalization, and many entries omit the GPU type entirely. The caveat in Section 6.1.2 that 'the comparison is not quite fair' is useful, but it appears only after the tables, and the qualitative claims in Section 6.1 about gradient-descent methods reducing resource use and random search being comparable rely precisely on this resource measure. Please add per-row hardware flags, a normalization footnote, or restrict the resource-efficiency conclusions to entries with comparable hardware.
minor comments (5)
  1. [Figure 2] The flow chart contains the typo 'exsiting' in the decision box; it should read 'existing'.
  2. [Section 6.1.1/6.1.2 numbering] The discussion of Tables 3 and 4 and the comparison caveat appears under the heading 'NAS-Bench Dataset' (Section 6.1.2) before the actual NAS-Bench discussion begins; consider restructuring so the caveat and table caveats precede the benchmark discussion.
  3. [Eqs. (2) and (3)] The notation 'MB' and 'ML' in Eqs. (2) and (3) should be typeset as M^B and M^L to avoid ambiguity about whether the exponent applies to the multiplication or to M.
  4. [Section 7.7] The name 'Auto-WEAK' should be 'Auto-WEKA', matching the referenced system by Thornton et al.
  5. [Table 5] The entry 'Federate Learning' should be 'Federated Learning'.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the survey makes no derived predictions and fits no parameters, so its descriptive claims cannot reduce to their own inputs.

full rationale

This paper is a literature survey, not a derivation. Its load-bearing claim is that it covers a broader range of AutoML methods than prior surveys, which is supported by the explicit comparison matrix in Table 1 and by the paper's organization along the AutoML pipeline (data preparation, feature engineering, hyperparameter optimization, neural architecture search, and model evaluation). No quantity is fitted to data and then re-reported as a prediction; the only numerical comparisons, in Tables 3 and 4, are transcriptions of results from external papers, explicitly flagged by the authors in Section 6.1.2 as obtained 'under different settings' and therefore 'not quite fair.' That caveat concerns comparability and accuracy, not circularity. The paper does cite prior work, including some surveys by other authors, but none of those citations supply a load-bearing premise that is equivalent to the paper's own conclusion; self-citation is essentially absent from the argument. The NAS performance tables could contain transcription or normalization issues, as the skeptical note observes, but that is a correctness risk, not a circularity defect: reproducing a number from an external source and labeling it as an external result is the opposite of renaming that number as a prediction. Accordingly, the appropriate finding is no significant circularity, with score 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The survey introduces no fitted parameters and no new entities. Its central claims of breadth and comparison rest on the reliability of cited literature, the meaningfulness of GPU Days as a proxy, and the representativeness of the selected methods.

assumptions (3)
  • domain assumption Cited papers accurately report their own results and settings, including accuracies, parameter counts, and GPU days.
    The survey's tables compile values from original papers without re-running experiments, so it inherits the accuracy of the cited reports.
  • domain assumption GPU Days, defined as the number of GPUs times the number of days, is a meaningful proxy for search efficiency across papers.
    Section 6 defines and uses GPU Days, while Section 6.1.2 acknowledges that different papers used different GPU types and training settings, weakening comparability.
  • domain assumption The chosen set of representative methods for each category reflects the state of the art at the time of writing.
    The survey's breadth claim depends on the inclusion and selection of papers; an unrepresentative selection could bias the overview.

how reviews work

0 comments
Cite this review

Pith. "Pith review of AutoML: A Survey of the State-of-the-Art." pith.science (2026). https://pith.science/paper/A3U7ESYA

@misc{pith2026190800709,
  author       = {Pith},
  title        = {Pith review of: AutoML: A Survey of the State-of-the-Art},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/A3U7ESYA}},
  note         = {Machine review of arXiv:1908.00709}
}
read the original abstract

Deep learning (DL) techniques have penetrated all aspects of our lives and brought us great convenience. However, building a high-quality DL system for a specific task highly relies on human expertise, hindering the applications of DL to more areas. Automated machine learning (AutoML) becomes a promising solution to build a DL system without human assistance, and a growing number of researchers focus on AutoML. In this paper, we provide a comprehensive and up-to-date review of the state-of-the-art (SOTA) in AutoML. First, we introduce AutoML methods according to the pipeline, covering data preparation, feature engineering, hyperparameter optimization, and neural architecture search (NAS). We focus more on NAS, as it is currently very hot sub-topic of AutoML. We summarize the performance of the representative NAS algorithms on the CIFAR-10 and ImageNet datasets and further discuss several worthy studying directions of NAS methods: one/two-stage NAS, one-shot NAS, and joint hyperparameter and architecture optimization. Finally, we discuss some open problems of the existing AutoML methods for future research.

Figures

Figures reproduced from arXiv: 1908.00709 by the authors.

Figure 1
Figure 1. An overview of AutoML pipeline covering data preparation (Section 2), feature engineering (Section 3), model generation (Section 4) [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. The flow chart for data preparation. 2.1. Data Collection ML’s deepening study has led to a consensus that high￾quality datasets are of critical importance for ML; as a result, numerous open datasets have emerged. In the early stages of ML study, a handwritten digital dataset, i.e., MNIST [48], was developed. After that, several larger datasets like CIFAR-10 and CIFAR-100 [49] and ImageNet [50] were developed. A var… view at source ↗
Figure 3
Figure 3. A classification of data augmentation techniques. [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (16 more)
Figure 4
Figure 4. Figure 4: The iterative process of feature selection. A subset of [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: An overview of neural architecture search pipeline. [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]
Figure 6
Figure 6. Figure 6: Two simplified examples of entire-structured neural archi [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: (Left) Example of a cell-based model comprising three [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]
Figure 8
Figure 8. Figure 8: Difference between DARTS [17] and P-DARTS [128]. Both methods search and evaluate networks on the CIFAR-10 dataset. As the number of cell structures increases from 5 to 11 and then 17, the number of candidate operations is gradually reduced accordingly. search phase fi…
Figure 10
Figure 10. Figure 10: Example of a three-level hierarchical architecture rep [PITH_FULL_IMAGE:figures/full_fig_p009_10.png]
Figure 9
Figure 9. Figure 9: Network-level search space proposed by [ [PITH_FULL_IMAGE:figures/full_fig_p009_9.png]
Figure 12
Figure 12. Figure 12: Net2DeeperNet and Net2WiderNet transformations in [PITH_FULL_IMAGE:figures/full_fig_p010_12.png]
Figure 13
Figure 13. Figure 13: Overview of the evolutionary algorithm. each network can be modified using function-preserving network morphism operators. Hence, the child network has increased capacity and is guaranteed to perform at least as well as the parent networks. Four Steps. A typical EA co…
Figure 14
Figure 14. Figure 14: Overview of neural architecture search using reinforcement [PITH_FULL_IMAGE:figures/full_fig_p012_14.png]
Figure 15
Figure 15. Figure 15: Example of a controller generating a cell structure. Each [PITH_FULL_IMAGE:figures/full_fig_p012_15.png]
Figure 16
Figure 16. Figure 16: Overview of DARTS. (a) The data can only flow from lower-level nodes to higher-level nodes, and the operations on edges are [PITH_FULL_IMAGE:figures/full_fig_p014_16.png]
Figure 17
Figure 17. Figure 17: Examples of grid search (left) and random search (right) in [PITH_FULL_IMAGE:figures/full_fig_p015_17.png]
Figure 18
Figure 18. Figure 18: Illustration of two- and one-stage neural architecture [PITH_FULL_IMAGE:figures/full_fig_p020_18.png]
Figure 19
Figure 19. Figure 19: (Left) One-shot models. (Right) Non-one-shot models. [PITH_FULL_IMAGE:figures/full_fig_p021_19.png]
Figure 20
Figure 20. Figure 20: State-of-the-art models on the PTB dataset. The lower the [PITH_FULL_IMAGE:figures/full_fig_p024_20.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. PyGen: A Collaborative Human-AI Approach to Python Package Creation

    cs.SE 2024-11 conditional novelty 4.0 of 10

    PyGen is an open pipeline that uses LLMs to expand a prompt into a documented Python package, with limited evidence that added context improves smaller models.

Reference graph

Works this paper leans on

288 extracted references · 30 canonical work pages · cited by 1 Pith paper

  1. [1]

    Krizhevsky, I

    A. Krizhevsky, I. Sutskever, G. E. Hinton, Imagenet classi- fication with deep convolutional neural networks, in: P. L. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012. Proceedings of a meeting held Dec...

  2. [2]

    K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, IEEE Computer Society, 2016, pp. 770–778. doi:10.1109/CVPR.2016.90. URL https://doi.org/10.1109/CVPR.2016.90

  3. [3]

    Redmon, S

    J. Redmon, S. K. Divvala, R. B. Girshick, A. Farhadi, You only look once: Unified, real-time object detection, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, IEEE Computer Society, 2016, pp. 779–788. doi:10.1109/CVPR.2016. 91. URL https://doi.org/10.1109/CVPR.2016.91

  4. [4]

    C. Gong, D. He, X. Tan, T. Qin, L. Wang, T. Liu, FRAGE: frequency-agnostic word representation, in: S. Bengio, H. M. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, R. Garnett (Eds.), Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montr´ eal, Can...

  5. [5]

    Z. Dai, Z. Yang, Y. Yang, J. Carbonell, Q. Le, R. Salakhutdinov, Transformer-XL: Attentive language models beyond a fixed- length context, in: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Florence, Italy, 2019, pp. 2978–

  6. [6]

    Russakovsky, J

    O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, L. Fei-Fei, ImageNet Large Scale Visual Recognition Challenge, International Journal of Computer Vision (IJCV) 115 (3) (2015) 211–252. doi:10.1007/s11263-015-0816-y

  7. [7]

    Simonyan, A

    K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, in: Y. Bengio, Y. LeCun (Eds.), 3rd International Conference on Learning Represen- tations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015. URL http://arxiv.org/abs/1409.1556

  8. [8]

    Zoller, M

    M. Zoller, M. F. Huber, Benchmark and survey of automated machine learning frameworks, arXiv preprint arXiv:1904.12054

Show all 288 references
  1. [9]

    Q. Yao, M. Wang, Y. Chen, W. Dai, H. Yi-Qi, L. Yu-Feng, T. Wei-Wei, Y. Qiang, Y. Yang, Taking human out of learning applications: A survey on automated machine learning, arXiv preprint arXiv:1810.13306

  2. [10]

    Elsken, J

    T. Elsken, J. H. Metzen, F. Hutter, Neural architecture search: A survey, arXiv preprint arXiv:1808.05377

  3. [11]

    K. Yu, C. Sciuto, M. Jaggi, C. Musat, M. Salzmann, Evaluating the search phase of neural architecture search, in: 8th Inter- national Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020. URL https://openreview.net/f...

  4. [12]

    B. Zoph, Q. V. Le, Neural architecture search with reinforce- ment learning, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net, 2017. URL https://openreview.net/forum?id=r1Ue8Hcxg

  5. [13]

    H. Pham, M. Y. Guan, B. Zoph, Q. V. Le, J. Dean, Efficient neural architecture search via parameter sharing, in: J. G. Dy, A. Krause (Eds.), Proceedings of the 35th International Con- ference on Machine Learning, ICML 2018, Stockholmsm¨ assan, Stockholm, Sweden, July 10-15, 2018...

  6. [14]

    Brock, T

    A. Brock, T. Lim, J. M. Ritchie, N. Weston, SMASH: one-shot model architecture search through hypernetworks, in: 6th Inter- national Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings, OpenReview.net, ...

  7. [15]

    B. Zoph, V. Vasudevan, J. Shlens, Q. V. Le, Learning transferable architectures for scalable image recognition, in: 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, IEEE Computer Society, 2018, pp. 8697–8710...

  8. [16]

    Zhong, J

    Z. Zhong, J. Yan, W. Wu, J. Shao, C. Liu, Practical block-wise neural network architecture generation, in: 2018 IEEE Confer- ence on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, IEEE Computer Society, 2018, pp. 2423–2432. doi:1...

  9. [17]

    H. Liu, K. Simonyan, Y. Yang, DARTS: differentiable archi- tecture search, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum?id=S1eYHoC5FX

  10. [18]

    C. Liu, B. Zoph, M. Neumann, J. Shlens, W. Hua, L.-J. Li, L. Fei-Fei, A. Yuille, J. Huang, K. Murphy, Progressive neural architecture search (2018) 19–34

  11. [19]

    H. Liu, K. Simonyan, O. Vinyals, C. Fernando, K. Kavukcuoglu, Hierarchical representations for efficient architecture search, in: 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings, Ope...

  12. [20]

    T. Chen, I. J. Goodfellow, J. Shlens, Net2net: Accelerating learning via knowledge transfer, in: Y. Bengio, Y. LeCun (Eds.), 4th International Conference on Learning Represen- tations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings, 2016. URL htt...

  13. [21]

    T. Wei, C. Wang, Y. Rui, C. W. Chen, Network morphism, in: M. Balcan, K. Q. Weinberger (Eds.), Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19-24, 2016, Vol. 48 of JMLR Workshop and Conference Proceedings, JMLR.o...

  14. [22]

    H. Jin, Q. Song, X. Hu, Auto-keras: An efficient neural architecture search system, in: A. Teredesai, V. Kumar, Y. Li, R. Rosales, E. Terzi, G. Karypis (Eds.), Proceed- ings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchor- a...

  15. [23]

    Baker, O

    B. Baker, O. Gupta, N. Naik, R. Raskar, Designing neural network architectures using reinforcement learning, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net, 2017. URL http...

  16. [24]

    K. O. Stanley, R. Miikkulainen, Evolving neural networks through augmenting topologies, Evolutionary computation 10 (2) (2002) 99–127

  17. [25]

    E. Real, S. Moore, A. Selle, S. Saxena, Y. L. Suematsu, J. Tan, Q. V. Le, A. Kurakin, Large-scale evolution of image classifiers, in: D. Precup, Y. W. Teh (Eds.), Proceedings of the 34th Inter- national Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 Aug...

  18. [26]

    E. Real, A. Aggarwal, Y. Huang, Q. V. Le, Regularized evo- lution for image classifier architecture search, in: The Thirty- Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intel- ligence Conference, IAAI 2019, Th...

  19. [27]

    Elsken, J

    T. Elsken, J. H. Metzen, F. Hutter, Efficient multi-objective neural architecture search via lamarckian evolution, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum...

  20. [28]

    Suganuma, S

    M. Suganuma, S. Shirakawa, T. Nagao, A genetic programming approach to designing convolutional neural network architec- tures, in: J. Lang (Ed.), Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018, July 13-19, 2018, Stockholm...

  21. [29]

    Miikkulainen, J

    R. Miikkulainen, J. Liang, E. Meyerson, A. Rawal, D. Fink, O. Francon, B. Raju, H. Shahrzad, A. Navruzyan, N. Duffy, et al., Evolving deep neural networks (2019) 293–312

  22. [30]

    L. Xie, A. L. Yuille, Genetic CNN, in: IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, IEEE Computer Society, 2017, pp. 1388–

  23. [31]

    Ahmed, L

    K. Ahmed, L. Torresani, Maskconnect: Connectivity learning by gradient descent (2018) 349–365

  24. [32]

    R. Shin, C. Packer, D. Song, Differentiable neural network architecture search

  25. [33]

    Mendoza, A

    H. Mendoza, A. Klein, M. Feurer, J. T. Springenberg, F. Hutter, Towards automatically-tuned neural networks (2016) 58–65

  26. [34]

    A. Zela, A. Klein, S. Falkner, F. Hutter, Towards automated deep learning: Efficient joint neural architecture and hyperpa- rameter search, arXiv preprint arXiv:1807.06906

  27. [35]

    Klein, S

    A. Klein, S. Falkner, S. Bartels, P. Hennig, F. Hutter, Fast bayesian optimization of machine learning hyperparameters on large datasets, in: A. Singh, X. J. Zhu (Eds.), Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, 20...

  28. [36]

    Falkner, A

    S. Falkner, A. Klein, F. Hutter, Practical hyperparameter optimization for deep learning

  29. [37]

    Hutter, H

    F. Hutter, H. H. Hoos, K. Leyton-Brown, Sequential model- based optimization for general algorithm configuration, in: In- ternational conference on learning and intelligent optimization, 2011, pp. 507–523

  30. [38]

    Falkner, A

    S. Falkner, A. Klein, F. Hutter, BOHB: robust and efficient hyperparameter optimization at scale, in: J. G. Dy, A. Krause (Eds.), Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm¨ assan, Stockholm, Sweden, July 10-15, 2018, Vol. 80 of ...

  31. [39]

    Bergstra, D

    J. Bergstra, D. Yamins, D. D. Cox, Making a science of model search: Hyperparameter optimization in hundreds of dimen- sions for vision architectures, in: Proceedings of the 30th Inter- national Conference on Machine Learning, ICML 2013, Atlanta, GA, USA, 16-21 June 2013, Vol....

  32. [41]

    Maziarz, M

    K. Maziarz, M. Tan, A. Khorlin, M. Georgiev, A. Gesmundo, Evolutionary-neural hybrid agents for architecture searcharXiv: 1811.09828

  33. [42]

    Y. Chen, G. Meng, Q. Zhang, S. Xiang, C. Huang, L. Mu, X. Wang, Reinforced evolutionary neural architecture search, arXiv preprint arXiv:1808.00193

  34. [43]

    Y. Sun, H. Wang, B. Xue, Y. Jin, G. G. Yen, M. Zhang, Surrogate-assisted evolutionary deep learning using an end-to- end random forest-based performance predictor, IEEE Trans- actions on Evolutionary Computation

  35. [44]

    B. Wang, Y. Sun, B. Xue, M. Zhang, A hybrid differential evolu- tion approach to designing deep convolutional neural networks for image classification, in: Australasian Joint Conference on Artificial Intelligence, Springer, 2018, pp. 237–250

  36. [45]

    Wistuba, A

    M. Wistuba, A. Rawat, T. Pedapati, A survey on neural archi- tecture search, arXiv preprint arXiv:1905.01392. 27

  37. [46]

    P. Ren, Y. Xiao, X. Chang, P.-Y. Huang, Z. Li, X. Chen, X. Wang, A comprehensive survey of neural architecture search: Challenges and solutions (2020). arXiv:2006.02903

  38. [47]

    Elshawi, M

    R. Elshawi, M. Maher, S. Sakr, Automated machine learn- ing: State-of-the-art and open challenges, arXiv preprint arXiv:1906.02287

  39. [48]

    LeCun, L

    Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE 86 (11) (1998) 2278–2324

  40. [49]

    Krizhevsky, V

    A. Krizhevsky, V. Nair, G. Hinton, The cifar-10 dataset, online: http://www. cs. toronto. edu/kriz/cifar. html

  41. [50]

    J. Deng, W. Dong, R. Socher, L. Li, K. Li, F. Li, Ima- genet: A large-scale hierarchical image database, in: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 20-25 June 2009, Miami, Florida, USA, IEEE Computer Society, 2009, pp. 248...

  42. [51]

    J. Yang, X. Sun, Y.-K. Lai, L. Zheng, M.-M. Cheng, Recog- nition from web data: a progressive filtering approach, IEEE Transactions on Image Processing 27 (11) (2018) 5303–5315

  43. [52]

    X. Chen, A. Shrivastava, A. Gupta, NEIL: extracting visual knowledge from web data, in: IEEE International Conference on Computer Vision, ICCV 2013, Sydney, Australia, December 1-8, 2013, IEEE Computer Society, 2013, pp. 1409–1416. doi: 10.1109/ICCV.2013.178. URL https://doi.o...

  44. [53]

    Y. Xia, X. Cao, F. Wen, J. Sun, Well begun is half done: Generating high-quality seeds for automatic image dataset construction from web, in: European Conference on Computer Vision, Springer, 2014, pp. 387–400

  45. [54]

    N. H. Do, K. Yanai, Automatic construction of action datasets using web videos with density-based cluster analysis and outlier detection, in: Pacific-Rim Symposium on Image and Video Technology, Springer, 2015, pp. 160–172

  46. [55]

    Krause, B

    J. Krause, B. Sapp, A. Howard, H. Zhou, A. Toshev, T. Duerig, J. Philbin, L. Fei-Fei, The unreasonable effectiveness of noisy data for fine-grained recognition, in: European Conference on Computer Vision, Springer, 2016, pp. 301–320

  47. [56]

    P. D. Vo, A. Ginsca, H. Le Borgne, A. Popescu, Harnessing noisy web images for deep representation, Computer Vision and Image Understanding 164 (2017) 68–81

  48. [57]

    Collins, J

    B. Collins, J. Deng, K. Li, L. Fei-Fei, Towards scalable dataset construction: An active learning approach, in: European con- ference on computer vision, Springer, 2008, pp. 86–98

  49. [58]

    Y. Roh, G. Heo, S. E. Whang, A survey on data collection for machine learning: a big data-ai integration perspective, IEEE Transactions on Knowledge and Data Engineering

  50. [59]

    D. Yarowsky, Unsupervised word sense disambiguation rivaling supervised methods, in: 33rd Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Cambridge, Massachusetts, USA, 1995, pp. 189–

  51. [60]

    Triguero, J

    I. Triguero, J. A. S´ aez, J. Luengo, S. Garc´ ıa, F. Herrera, On the characterization of noise filters for self-training semi-supervised in nearest neighbor classification, Neurocomputing 132 (2014) 30–41

  52. [61]

    M. F. A. Hady, F. Schwenker, Combining committee-based semi- supervised learning and active learning, Journal of Computer Science and Technology 25 (4) (2010) 681–698

  53. [62]

    A. Blum, T. Mitchell, Combining labeled and unlabeled data with co-training, in: Proceedings of the eleventh annual con- ference on Computational learning theory, ACM, 1998, pp. 92–100

  54. [63]

    Y. Zhou, S. Goldman, Democratic co-learning, in: Tools with Artificial Intelligence, 2004. ICTAI 2004. 16th IEEE Interna- tional Conference on, IEEE, 2004, pp. 594–602

  55. [64]

    X. Chen, A. Gupta, Webly supervised learning of convolutional networks, in: 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015, IEEE Computer Society, 2015, pp. 1431–1439. doi:10.1109/ICCV. 2015.168. URL https://doi.org/10.11...

  56. [65]

    Z. Xu, S. Huang, Y. Zhang, D. Tao, Augmenting strong super- vision using web data for fine-grained categorization, in: 2015 IEEE International Conference on Computer Vision, ICCV 2015, Santiago, Chile, December 7-13, 2015, IEEE Computer Society, 2015, pp. 2524–2532. doi:10.1109...

  57. [66]

    N. V. Chawla, K. W. Bowyer, L. O. Hall, W. P. Kegelmeyer, Smote: synthetic minority over-sampling technique, Journal of artificial intelligence research 16 (2002) 321–357

  58. [67]

    H. Guo, H. L. Viktor, Learning from imbalanced data sets with boosting and data generation: the databoost-im approach, ACM Sigkdd Explorations Newsletter 6 (1) (2004) 30–39

  59. [68]

    Brockman, V

    G. Brockman, V. Cheung, L. Pettersson, J. Schneider, J. Schul- man, J. Tang, W. Zaremba, Openai gym, arXiv preprint arXiv:1606.01540

  60. [69]

    Q. Wang, S. Zheng, Q. Yan, F. Deng, K. Zhao, X. Chu, Irs: A large synthetic indoor robotics stereo dataset for disparity and surface normal estimation, arXiv preprint arXiv:1912.09678

  61. [70]

    N. Ruiz, S. Schulter, M. Chandraker, Learning to simulate, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenRe- view.net, 2019. URL https://openreview.net/forum?id=HJgkx2Aqt7

  62. [71]

    I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde- Farley, S. Ozair, A. C. Courville, Y. Bengio, Generative adversarial nets, in: Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 27: An...

  63. [72]

    T.-H. Oh, R. Jaroensri, C. Kim, M. Elgharib, F. Durand, W. T. Freeman, W. Matusik, Learning-based video motion magnification, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 633–648

  64. [73]

    Sixt, Rendergan: Generating realistic labeled data–with an application on decoding bee tags, unpublished Bachelor Thesis, Freie Universit¨ at, Berlin

    L. Sixt, Rendergan: Generating realistic labeled data–with an application on decoding bee tags, unpublished Bachelor Thesis, Freie Universit¨ at, Berlin

  65. [74]

    Bowles, L

    C. Bowles, L. Chen, R. Guerrero, P. Bentley, R. Gunn, A. Ham- mers, D. A. Dickie, M. V. Hern´ andez, J. Wardlaw, D. Rueckert, Gan augmentation: Augmenting training data using generative adversarial networks, arXiv preprint arXiv:1810.10863

  66. [75]

    N. Park, M. Mohammadi, K. Gorde, S. Jajodia, H. Park, Y. Kim, Data synthesis based on generative adversarial net- works, Proceedings of the VLDB Endowment 11 (10) (2018) 1071–1083

  67. [76]

    L. Xu, K. Veeramachaneni, Synthesizing tabular data using gen- erative adversarial networks, arXiv preprint arXiv:1811.11264

  68. [77]

    Donahue, A

    D. Donahue, A. Rumshisky, Adversarial text generation without reinforcement learning, arXiv preprint arXiv:1810.06640

  69. [78]

    Karras, S

    T. Karras, S. Laine, T. Aila, A style-based generator ar- chitecture for generative adversarial networks, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 4401–4410. d...

  70. [79]

    X. Chu, I. F. Ilyas, S. Krishnan, J. Wang, Data cleaning: Overview and emerging challenges, in: F. ¨Ozcan, G. Koutrika, S. Madden (Eds.), Proceedings of the 2016 International Con- ference on Management of Data, SIGMOD Conference 2016, San Francisco, CA, USA, June 26 - July 01...

  71. [80]

    Jesmeen, J

    M. Jesmeen, J. Hossen, S. Sayeed, C. Ho, K. Tawsif, A. Rahman, 28 E. Arif, A survey on cleaning dirty data using machine learning paradigm for big data analytics, Indonesian Journal of Electrical Engineering and Computer Science 10 (3) (2018) 1234–1243

  72. [81]

    X. Chu, J. Morcos, I. F. Ilyas, M. Ouzzani, P. Papotti, N. Tang, Y. Ye, KATARA: A data cleaning system powered by knowledge bases and crowdsourcing, in: T. K. Sellis, S. B. Davidson, Z. G. Ives (Eds.), Proceedings of the 2015 ACM SIGMOD International Conference on Management o...

  73. [82]

    Krishnan, J

    S. Krishnan, J. Wang, M. J. Franklin, K. Goldberg, T. Kraska, T. Milo, E. Wu, Sampleclean: Fast and reliable analytics on dirty data., IEEE Data Eng. Bull. 38 (3) (2015) 59–75

  74. [83]

    Krishnan, M

    S. Krishnan, M. J. Franklin, K. Goldberg, J. Wang, E. Wu, Ac- tiveclean: An interactive data cleaning framework for modern machine learning, in: F. ¨Ozcan, G. Koutrika, S. Madden (Eds.), Proceedings of the 2016 International Conference on Manage- ment of Data, SIGMOD Conferenc...

  75. [84]

    Krishnan, M

    S. Krishnan, M. J. Franklin, K. Goldberg, E. Wu, Boostclean: Automated error detection and repair for machine learning, arXiv preprint arXiv:1711.01299

  76. [85]

    Krishnan, E

    S. Krishnan, E. Wu, Alphaclean: Automatic generation of data cleaning pipelines, arXiv preprint arXiv:1904.11827

  77. [86]

    I. Gemp, G. Theocharous, M. Ghavamzadeh, Automated data cleansing through meta-learning, in: S. P. Singh, S. Markovitch (Eds.), Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4-9, 2017, San Francisco, Cali- fornia, USA, AAAI Press, 2017, pp...

  78. [87]

    I. F. Ilyas, Effective data cleaning with continuous evaluation., IEEE Data Eng. Bull. 39 (2) (2016) 38–46

  79. [88]

    Mahdavi, F

    M. Mahdavi, F. Neutatz, L. Visengeriyeva, Z. Abedjan, Towards automated data cleaning workflows, Machine Learning 15 (2019) 16

  80. [89]

    DeVries, G

    T. DeVries, G. W. Taylor, Improved regularization of con- volutional neural networks with cutout, arXiv preprint arXiv:1708.04552

  81. [90]

    Zhang, M

    H. Zhang, M. Ciss´ e, Y. N. Dauphin, D. Lopez-Paz, mixup: Beyond empirical risk minimization, in: 6th International Con- ference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Pro- ceedings, OpenReview.net, 2018. URL htt...

  82. [91]

    A. B. Jung, K. Wada, J. Crall, S. Tanaka, J. Graving, C. Reinders, S. Yadav, J. Banerjee, G. Vecsei, A. Kraft, Z. Rui, J. Borovec, C. Vallentin, S. Zhydenko, K. Pfeiffer, B. Cook, I. Fern´ andez, F.-M. De Rainville, C.-H. Weng, A. Ayala-Acevedo, R. Meudec, M. Laporte, et al., i...

  83. [92]

    Buslaev, A

    A. Buslaev, A. Parinov, E. Khvedchenya, V. I. Iglovikov, A. A. Kalinin, Albumentations: fast and flexible image augmenta- tions, ArXiv e-printsarXiv:1809.06839

  84. [93]

    Miko lajczyk, M

    A. Miko lajczyk, M. Grochowski, Data augmentation for im- proving deep learning in image classification problem, in: 2018 international interdisciplinary PhD workshop (IIPhDW), IEEE, 2018, pp. 117–122

  85. [94]

    Miko lajczyk, M

    A. Miko lajczyk, M. Grochowski, Style transfer-based image synthesis as an efficient regularization technique in deep learn- ing, in: 2019 24th International Conference on Methods and Models in Automation and Robotics (MMAR), IEEE, 2019, pp. 42–47

  86. [95]

    Antoniou, A

    A. Antoniou, A. Storkey, H. Edwards, Data augmentation gen- erative adversarial networks, arXiv preprint arXiv:1711.04340

  87. [96]

    S. C. Wong, A. Gatt, V. Stamatescu, M. D. McDonnell, Under- standing data augmentation for classification: when to warp?, arXiv preprint arXiv:1609.08764

  88. [97]

    Z. Xie, S. I. Wang, J. Li, D. L´ evy, A. Nie, D. Jurafsky, A. Y. Ng, Data noising as smoothing in neural network language models, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenRevie...

  89. [98]

    A. W. Yu, D. Dohan, M. Luong, R. Zhao, K. Chen, M. Norouzi, Q. V. Le, Qanet: Combining local convolution with global self-attention for reading comprehension, in: 6th International Conference on Learning Representations, ICLR 2018, Vancou- ver, BC, Canada, April 30 - May 3, 20...

  90. [99]

    Ma, Nlp augmentation, https://github.com/makcedward/ nlpaug (2019)

    E. Ma, Nlp augmentation, https://github.com/makcedward/ nlpaug (2019)

  91. [100]

    E. D. Cubuk, B. Zoph, D. Man´ e, V. Vasudevan, Q. V. Le, Autoaugment: Learning augmentation strategies from data, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 113–...

  92. [101]

    Y. Li, G. Hu, Y. Wang, T. Hospedales, N. M. Robertson, Y. Yang, Dada: Differentiable automatic data augmentation, arXiv preprint arXiv:2003.03780

  93. [102]

    Hataya, J

    R. Hataya, J. Zdenek, K. Yoshizoe, H. Nakayama, Faster au- toaugment: Learning augmentation strategies using backpropa- gation, arXiv preprint arXiv:1911.06987

  94. [103]

    S. Lim, I. Kim, T. Kim, C. Kim, S. Kim, Fast autoaugment, in: H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alch´ e-Buc, E. B. Fox, R. Garnett (Eds.), Advances in Neural Information Processing Systems 32: Annual Conference on Neural Informa- tion Processing Systems 2019, ...

  95. [104]

    Naghizadeh, M

    A. Naghizadeh, M. Abavisani, D. N. Metaxas, Greedy autoaug- ment, arXiv preprint arXiv:1908.00704

  96. [105]

    D. Ho, E. Liang, X. Chen, I. Stoica, P. Abbeel, Population based augmentation: Efficient learning of augmentation policy schedules, in: K. Chaudhuri, R. Salakhutdinov (Eds.), Proceed- ings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long ...

  97. [106]

    T. Niu, M. Bansal, Automatically learning data augmenta- tion policies for dialogue tasks, in: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Pro- cessing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Ass...

  98. [107]

    M. Geng, K. Xu, B. Ding, H. Wang, L. Zhang, Learning data augmentation policies using augmented random search, arXiv preprint arXiv:1811.04768

  99. [108]

    Zhang, Q

    X. Zhang, Q. Wang, J. Zhang, Z. Zhong, Adversarial autoaug- ment, in: 8th International Conference on Learning Represen- tations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020. URL https://openreview.net/forum?id=ByxdUySKvS

  100. [109]

    C. Lin, M. Guo, C. Li, X. Yuan, W. Wu, J. Yan, D. Lin, W. Ouyang, Online hyper-parameter learning for auto- augmentation strategy, in: 2019 IEEE/CVF International Con- ference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 6...

  101. [110]

    T. C. LingChen, A. Khonsari, A. Lashkari, M. R. Nazari, J. S. Sambee, M. A. Nascimento, Uniformaugment: A search- free probabilistic data augmentation approach, arXiv preprint arXiv:2003.14348

  102. [111]

    Motoda, H

    H. Motoda, H. Liu, Feature selection, extraction and construc- tion, Communication of IICM (Institute of Information and Computing Machinery, Taiwan) Vol 5 (67-72) (2002) 2

  103. [112]

    M. Dash, H. Liu, Feature selection for classification, Intelligent data analysis 1 (1-4) (1997) 131–156

  104. [113]

    M. J. Pazzani, Constructive induction of cartesian product attributes, in: Feature Extraction, Construction and Selection, Springer, 1998, pp. 341–354

  105. [114]

    Zheng, A comparison of constructing different types of new feature for decision tree learning, in: Feature Extraction, Con- struction and Selection, Springer, 1998, pp

    Z. Zheng, A comparison of constructing different types of new feature for decision tree learning, in: Feature Extraction, Con- struction and Selection, Springer, 1998, pp. 239–255

  106. [115]

    Gama, Functional trees, Machine Learning 55 (3) (2004) 219–250

    J. Gama, Functional trees, Machine Learning 55 (3) (2004) 219–250

  107. [116]

    Vafaie, K

    H. Vafaie, K. De Jong, Evolutionary feature space transfor- mation, in: Feature Extraction, Construction and Selection, Springer, 1998, pp. 307–323

  108. [117]

    Sondhi, Feature construction methods: a survey, sifaka

    P. Sondhi, Feature construction methods: a survey, sifaka. cs. uiuc. edu 69 (2009) 70–71

  109. [118]

    D. Roth, K. Small, Interactive feature space construction using semantic information, in: Proceedings of the Thirteenth Con- ference on Computational Natural Language Learning (CoNLL- 2009), Association for Computational Linguistics, Boulder, Colorado, 2009, pp. 66–74. URL htt...

  110. [119]

    Q. Meng, D. Catchpoole, D. Skillicom, P. J. Kennedy, Rela- tional autoencoder for feature extraction, in: 2017 International Joint Conference on Neural Networks (IJCNN), IEEE, 2017, pp. 364–371

  111. [120]

    Irsoy, E

    O. Irsoy, E. Alpaydın, Unsupervised feature extraction with autoencoder trees, Neurocomputing 258 (2017) 63–73

  112. [121]

    Cortes, V

    C. Cortes, V. Vapnik, Support-vector networks, Machine learn- ing 20 (3) (1995) 273–297

  113. [122]

    N. S. Altman, An introduction to kernel and nearest-neighbor nonparametric regression, The American Statistician 46 (3) (1992) 175–185

  114. [123]

    A. Yang, P. M. Esperan¸ ca, F. M. Carlucci, NAS evaluation is frustratingly hard, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26- 30, 2020, OpenReview.net, 2020. URL https://openreview.net/forum?id=HygrdpVKvr

  115. [124]

    F. Chollet, Xception: Deep learning with depthwise separable convolutions, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, IEEE Computer Society, 2017, pp. 1800–1807. doi:10.1109/CVPR.2017.195. URL https://do...

  116. [125]

    F. Yu, V. Koltun, Multi-scale context aggregation by dilated convolutions, in: Y. Bengio, Y. LeCun (Eds.), 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings, 2016. URL http://arxiv.org/abs/1511.07122

  117. [126]

    J. Hu, L. Shen, G. Sun, Squeeze-and-excitation networks, in: 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, IEEE Computer Society, 2018, pp. 7132–7141. doi:10.1109/CVPR.2018.00745. URL http://openaccess.th...

  118. [127]

    Huang, Z

    G. Huang, Z. Liu, L. van der Maaten, K. Q. Weinberger, Densely connected convolutional networks, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, IEEE Computer Society, 2017, pp. 2261–2269. doi:10.1109/CVPR.20...

  119. [128]

    X. Chen, L. Xie, J. Wu, Q. Tian, Progressive differentiable architecture search: Bridging the depth gap between search and evaluation, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. ...

  120. [129]

    C. Liu, L. Chen, F. Schroff, H. Adam, W. Hua, A. L. Yuille, F. Li, Auto-deeplab: Hierarchical neural architecture search for semantic image segmentation, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer V...

  121. [130]

    M. Tan, B. Chen, R. Pang, V. Vasudevan, M. Sandler, A. Howard, Q. V. Le, Mnasnet: Platform-aware neural archi- tecture search for mobile, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundatio...

  122. [131]

    B. Wu, X. Dai, P. Zhang, Y. Wang, F. Sun, Y. Wu, Y. Tian, P. Vajda, Y. Jia, K. Keutzer, Fbnet: Hardware-aware efficient convnet design via differentiable neural architecture search, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, Ju...

  123. [132]

    H. Cai, L. Zhu, S. Han, Proxylessnas: Direct neural architecture search on target task and hardware, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum?id=HylVB3AqYm

  124. [133]

    Courbariaux, Y

    M. Courbariaux, Y. Bengio, J. David, Binaryconnect: Training deep neural networks with binary weights during propagations, in: C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, R. Garnett (Eds.), Advances in Neural Information Processing Systems 28: Annual Conference on Neura...

  125. [134]

    Hinton, O

    G. Hinton, O. Vinyals, J. Dean, Distilling the knowledge in a neural network, arXiv preprint arXiv:1503.02531

  126. [135]

    Yosinski, J

    J. Yosinski, J. Clune, Y. Bengio, H. Lipson, How transferable are features in deep neural networks?, in: Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information...

  127. [136]

    T. Wei, C. Wang, C. W. Chen, Modularized morphing of neural networks, arXiv preprint arXiv:1701.03281

  128. [137]

    H. Cai, T. Chen, W. Zhang, Y. Yu, J. Wang, Efficient architecture search by network transformation, in: S. A. McIlraith, K. Q. Weinberger (Eds.), Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial ...

  129. [138]

    Kwasigroch, M

    A. Kwasigroch, M. Grochowski, M. Mikolajczyk, Deep neu- ral network architecture search using network morphism, in: 2019 24th International Conference on Methods and Models in Automation and Robotics (MMAR), IEEE, 2019, pp. 30–35

  130. [139]

    H. Cai, J. Yang, W. Zhang, S. Han, Y. Yu, Path-level network transformation for efficient architecture search, in: J. G. Dy, A. Krause (Eds.), Proceedings of the 35th International Con- ference on Machine Learning, ICML 2018, Stockholmsm¨ assan, Stockholm, Sweden, July 10-15, 20...

  131. [140]

    J. Fang, Y. Sun, K. Peng, Q. Zhang, Y. Li, W. Liu, X. Wang, Fast neural network adaptation via parameter remapping and architecture search, in: 8th International Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020...

  132. [141]

    Gordon, E

    A. Gordon, E. Eban, O. Nachum, B. Chen, H. Wu, T. Yang, E. Choi, Morphnet: Fast & simple resource-constrained structure learning of deep networks, in: 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, IEEE Co...

  133. [142]

    M. Tan, Q. V. Le, Efficientnet: Rethinking model scaling for convolutional neural networks, in: K. Chaudhuri, R. Salakhut- dinov (Eds.), Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, Vol. 97 of Proce...

  134. [143]

    J. F. Miller, S. L. Harding, Cartesian genetic programming, in: Proceedings of the 10th annual conference companion on Genetic and evolutionary computation, ACM, 2008, pp. 2701– 2726

  135. [144]

    J. F. Miller, S. L. Smith, Redundancy and computational efficiency in cartesian genetic programming, IEEE Transactions on Evolutionary Computation 10 (2) (2006) 167–174

  136. [145]

    Gruau, Cellular encoding as a graph grammar, in: IEEE Colloquium on Grammatical Inference: Theory, Applications & Alternatives, 1993

    F. Gruau, Cellular encoding as a graph grammar, in: IEEE Colloquium on Grammatical Inference: Theory, Applications & Alternatives, 1993

  137. [146]

    Fernando, D

    C. Fernando, D. Banarse, M. Reynolds, F. Besse, D. Pfau, M. Jaderberg, M. Lanctot, D. Wierstra, Convolution by evolu- tion: Differentiable pattern producing networks, in: Proceed- ings of the Genetic and Evolutionary Computation Conference 2016, ACM, 2016, pp. 109–116

  138. [147]

    M. Kim, L. Rigazio, Deep clustered convolutional kernels, in: Feature Extraction: Modern Questions and Challenges, 2015, pp. 160–172

  139. [148]

    J. K. Pugh, K. O. Stanley, Evolving multimodal controllers with hyperneat, in: Proceedings of the 15th annual conference on Genetic and evolutionary computation, ACM, 2013, pp. 735–742

  140. [149]

    H. Zhu, Z. An, C. Yang, K. Xu, E. Zhao, Y. Xu, Eena: Efficient evolution of neural architecture (2019). arXiv:1905.07320

  141. [150]

    R. J. Williams, Simple statistical gradient-following algorithms for connectionist reinforcement learning, Machine learning 8 (3-

  142. [151]

    Schulman, F

    J. Schulman, F. Wolski, P. Dhariwal, A. Radford, O. Klimov, Proximal policy optimization algorithms, arXiv preprint arXiv:1707.06347

  143. [152]

    Marcus, G

    M. Marcus, G. Kim, M. A. Marcinkiewicz, R. MacIntyre, A. Bies, M. Ferguson, K. Katz, B. Schasberger, The Penn Treebank: Annotating predicate argument structure, in: Hu- man Language Technology: Proceedings of a Workshop held at Plainsboro, New Jersey, March 8-11, 1994, 1994. U...

  144. [154]

    X. Dong, Y. Yang, Searching for a robust neural architecture in four GPU hours, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 1761–1770. doi:10.1109/CVPR.2019.00186...

  145. [155]

    S. Xie, H. Zheng, C. Liu, L. Lin, SNAS: stochastic neural ar- chitecture search, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum?id=rylqooRqK7

  146. [156]

    B. Wu, Y. Wang, P. Zhang, Y. Tian, P. Vajda, K. Keutzer, Mixed precision quantization of convnets via differentiable neural architecture search (2018). arXiv:1812.00090

  147. [157]

    E. Jang, S. Gu, B. Poole, Categorical reparameterization with gumbel-softmax, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net, 2017. URL https://openreview.net/forum?id=rkE3y85ee

  148. [158]

    C. J. Maddison, A. Mnih, Y. W. Teh, The concrete distribution: A continuous relaxation of discrete random variables, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net, 2017. ...

  149. [159]

    Liang, S

    H. Liang, S. Zhang, J. Sun, X. He, W. Huang, K. Zhuang, Z. Li, Darts+: Improved differentiable architecture search with early stopping, arXiv preprint arXiv:1909.06035

  150. [160]

    Kandasamy, W

    K. Kandasamy, W. Neiswanger, J. Schneider, B. P´ oczos, E. P. Xing, Neural architecture search with bayesian optimisation and optimal transport, in: S. Bengio, H. M. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, R. Garnett (Eds.), Advances in Neural Information Processi...

  151. [161]

    Negrinho, G

    R. Negrinho, G. Gordon, Deeparchitect: Automatically design- ing and training deep architectures (2017). arXiv:1704.08792

  152. [162]

    Negrinho, M

    R. Negrinho, M. R. Gormley, G. J. Gordon, D. Patil, N. Le, D. Ferreira, Towards modular and programmable architecture search, in: H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alch´ e-Buc, E. B. Fox, R. Garnett (Eds.), Advances in Neural Information Processing Systems 32:...

  153. [163]

    Dikov, J

    G. Dikov, J. Bayer, Bayesian learning of neural network ar- chitectures, in: K. Chaudhuri, M. Sugiyama (Eds.), The 22nd International Conference on Artificial Intelligence and Statis- tics, AISTATS 2019, 16-18 April 2019, Naha, Okinawa, Japan, Vol. 89 of Proceedings of Machine ...

  154. [164]

    White, W

    C. White, W. Neiswanger, Y. Savani, Bananas: Bayesian op- timization with neural architectures for neural architecture search (2019). arXiv:1910.11858

  155. [165]

    M. Wistuba, Bayesian optimization combined with incremen- tal evaluation for neural network architecture optimization, 31 in: Proceedings of the International Workshop on Automatic Selection, Configuration and Composition of Machine Learning Algorithms, 2017

  156. [166]

    Perez-Rua, M

    J. Perez-Rua, M. Baccouche, S. Pateux, Efficient progressive neural architecture search, in: British Machine Vision Confer- ence 2018, BMVC 2018, Newcastle, UK, September 3-6, 2018, BMVA Press, 2018, p. 150. URL http://bmvc2018.org/contents/papers/0291.pdf

  157. [167]

    C. E. Rasmussen, Gaussian processes in machine learning, Lecture Notes in Computer Science (2003) 63–71

  158. [168]

    Bergstra, R

    J. Bergstra, R. Bardenet, Y. Bengio, B. K´ egl, Algorithms for hyper-parameter optimization, in: J. Shawe-Taylor, R. S. Zemel, P. L. Bartlett, F. C. N. Pereira, K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Info...

  159. [169]

    R. Luo, F. Tian, T. Qin, E. Chen, T. Liu, Neural architecture optimization, in: S. Bengio, H. M. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, R. Garnett (Eds.), Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Sys...

  160. [170]

    M. M. Ian Dewancker, S. Clark, Bayesian optimization primer. URL https://app.sigopt.com/static/pdf/SigOpt_ Bayesian_Optimization_Primer.pdf

  161. [171]

    Shahriari, K

    B. Shahriari, K. Swersky, Z. Wang, R. P. Adams, N. De Fre- itas, Taking the human out of the loop: A review of bayesian optimization, Proceedings of the IEEE 104 (1) (2016) 148–175

  162. [172]

    Snoek, O

    J. Snoek, O. Rippel, K. Swersky, R. Kiros, N. Satish, N. Sun- daram, M. M. A. Patwary, Prabhat, R. P. Adams, Scalable bayesian optimization using deep neural networks, in: F. R. Bach, D. M. Blei (Eds.), Proceedings of the 32nd International Conference on Machine Learning, ICML...

  163. [173]

    Snoek, H

    J. Snoek, H. Larochelle, R. P. Adams, Practical bayesian optimization of machine learning algorithms, in: P. L. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, K. Q. Weinberger (Eds.), Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neur...

  164. [174]

    Stork, M

    J. Stork, M. Zaefferer, T. Bartz-Beielstein, Improving neuroevo- lution efficiency by surrogate model-based optimization with phenotypic distance kernels (2019). arXiv:1902.03419

  165. [175]

    Swersky, D

    K. Swersky, D. Duvenaud, J. Snoek, F. Hutter, M. A. Osborne, Raiders of the lost architecture: Kernels for bayesian optimiza- tion in conditional parameter spaces (2014). arXiv:1409.4011

  166. [176]

    Camero, H

    A. Camero, H. Wang, E. Alba, T. B¨ ack, Bayesian neural archi- tecture search using a training-free performance metric (2020). arXiv:2001.10726

  167. [177]

    Thornton, F

    C. Thornton, F. Hutter, H. H. Hoos, K. Leyton-Brown, Auto- weka: combined selection and hyperparameter optimization of classification algorithms, in: I. S. Dhillon, Y. Koren, R. Ghani, T. E. Senator, P. Bradley, R. Parekh, J. He, R. L. Grossman, R. Uthurusamy (Eds.), The 19th A...

  168. [178]

    sharpdarts, V

    A. sharpdarts, V. Jain, G. D. Hager, sharpdarts: Faster and more accurate differentiable architecture search, Tech. rep. (2019)

  169. [179]

    Geifman, R

    Y. Geifman, R. El-Yaniv, Deep active learning with a neural architecture search, in: H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alch´ e-Buc, E. B. Fox, R. Garnett (Eds.), Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Proc...

  170. [180]

    L. Li, A. Talwalkar, Random search and reproducibility for neural architecture search, in: A. Globerson, R. Silva (Eds.), Proceedings of the Thirty-Fifth Conference on Uncertainty in Artificial Intelligence, UAI 2019, Tel Aviv, Israel, July 22-25, 2019, Vol. 115 of Proceedings ...

  171. [181]

    Bergstra, Y

    J. Bergstra, Y. Bengio, Random search for hyper-parameter optimization, Journal of machine learning research 13 (Feb) (2012) 281–305

  172. [182]

    Hsu, C.-C

    C.-W. Hsu, C.-C. Chang, C.-J. Lin, et al., A practical guide to support vector classification

  173. [183]

    J. Y. Hesterman, L. Caucci, M. A. Kupinski, H. H. Barrett, L. R. Furenlid, Maximum-likelihood estimation with a contracting- grid search algorithm, IEEE transactions on nuclear science 57 (3) (2010) 1077–1084

  174. [184]

    L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, A. Talwalkar, Hyperband: A novel bandit-based approach to hyperparameter optimization, The Journal of Machine Learning Research 18 (1) (2017) 6765–6816

  175. [185]

    Feurer, F

    M. Feurer, F. Hutter, Hyperparameter Optimization, Springer International Publishing, Cham, 2019, pp. 3–33. URL https://doi.org/10.1007/978-3-030-05318-5_1

  176. [186]

    T. Yu, H. Zhu, Hyper-parameter optimization: A review of algorithms and applications, arXiv preprint arXiv:2003.05689

  177. [187]

    Bengio, Gradient-based optimization of hyperparameters, Neural computation 12 (8) (2000) 1889–1900

    Y. Bengio, Gradient-based optimization of hyperparameters, Neural computation 12 (8) (2000) 1889–1900

  178. [188]

    Domke, Generic methods for optimization-based modeling, in: Artificial Intelligence and Statistics, 2012, pp

    J. Domke, Generic methods for optimization-based modeling, in: Artificial Intelligence and Statistics, 2012, pp. 318–326

  179. [189]

    Maclaurin, D

    D. Maclaurin, D. Duvenaud, R. P. Adams, Gradient-based hy- perparameter optimization through reversible learning, in: F. R. Bach, D. M. Blei (Eds.), Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015, Vol. 37 of JMLR ...

  180. [190]

    Pedregosa, Hyperparameter optimization with approximate gradient, in: M

    F. Pedregosa, Hyperparameter optimization with approximate gradient, in: M. Balcan, K. Q. Weinberger (Eds.), Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19-24, 2016, Vol. 48 of JMLR Workshop and Conference Proce...

  181. [191]

    Franceschi, M

    L. Franceschi, M. Donini, P. Frasconi, M. Pontil, Forward and reverse gradient-based hyperparameter optimization, in: D. Precup, Y. W. Teh (Eds.), Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017, Vol. 70...

  182. [192]

    Chandra, E

    K. Chandra, E. Meijer, S. Andow, E. Arroyo-Fang, I. Dea, J. George, M. Grueter, B. Hosmer, S. Stumpos, A. Tempest, et al., Gradient descent: The ultimate optimizer, arXiv preprint arXiv:1909.13371

  183. [193]

    D. P. Kingma, J. Ba, Adam: A method for stochastic opti- mization, in: Y. Bengio, Y. LeCun (Eds.), 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015. URL http://arxiv.org/abs/1412.6980

  184. [194]

    Chrabaszcz, I

    P. Chrabaszcz, I. Loshchilov, F. Hutter, A downsampled variant 32 of imagenet as an alternative to the CIFAR datasets, CoRR abs/1707.08819. arXiv:1707.08819. URL http://arxiv.org/abs/1707.08819

  185. [195]

    Y. Hu, Y. Yu, W. Tu, Q. Yang, Y. Chen, W. Dai, Multi- fidelity automatic hyper-parameter tuning via transfer series expansion, in: The Thirty-Third AAAI Conference on Arti- ficial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Confere...

  186. [196]

    URL https://www.aclweb.org/anthology/P95-1026

    doi:10.3115/981658.981684. URL https://www.aclweb.org/anthology/P95-1026

  187. [197]

    Stamoulis, R

    D. Stamoulis, R. Ding, D. Wang, D. Lymberopoulos, B. Priyan- tha, J. Liu, D. Marculescu, Single-path nas: Designing hardware-efficient convnets in less than 4 hours, arXiv preprint arXiv:1904.02877

  188. [198]

    Eggensperger, F

    K. Eggensperger, F. Hutter, H. H. Hoos, K. Leyton-Brown, Surrogate benchmarks for hyperparameter optimization., in: MetaSel@ ECAI, 2014, pp. 24–31

  189. [199]

    C. Wong, N. Houlsby, Y. Lu, A. Gesmundo, Transfer learning with neural automl, in: S. Bengio, H. M. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, R. Garnett (Eds.), Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing ...

  190. [200]

    Eggensperger, F

    K. Eggensperger, F. Hutter, H. H. Hoos, K. Leyton-Brown, Efficient benchmarking of hyperparameter optimizers via surrogates, in: B. Bonet, S. Koenig (Eds.), Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 25-30, 2015, Austin, Texas, USA, AAAI P...

  191. [201]

    K. K. Vu, C. D’Ambrosio, Y. Hamadi, L. Liberti, Surrogate- based methods for black-box optimization, International Trans- actions in Operational Research 24 (3) (2017) 393–424

  192. [202]

    C. Wang, Q. Duan, W. Gong, A. Ye, Z. Di, C. Miao, An evaluation of adaptive surrogate modeling based optimization with two benchmark problems, Environmental Modelling & Software 60 (2014) 167–179

  193. [203]

    Klein, S

    A. Klein, S. Falkner, J. T. Springenberg, F. Hutter, Learning curve prediction with bayesian neural networks, in: 5th Inter- national Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceed- ings, OpenReview.net, 2017. URL...

  194. [204]

    B. Deng, J. Yan, D. Lin, Peephole: Predicting network perfor- mance before training, arXiv preprint arXiv:1712.03351

  195. [205]

    R. Luo, X. Tan, R. Wang, T. Qin, E. Chen, T.-Y. Liu, Semi-supervised neural architecture search (2020). arXiv: 2002.10389

  196. [206]

    Mahsereci, L

    M. Mahsereci, L. Balles, C. Lassner, P. Hennig, Early stopping without a validation set, arXiv preprint arXiv:1703.09580

  197. [207]

    D. Han, J. Kim, J. Kim, Deep pyramidal residual networks, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, IEEE Computer Society, 2017, pp. 6307–6315. doi: 10.1109/CVPR.2017.668. URL https://doi.org/10.1109/CV...

  198. [208]

    Domhan, J

    T. Domhan, J. T. Springenberg, F. Hutter, Speeding up auto- matic hyperparameter optimization of deep neural networks by extrapolation of learning curves, in: Q. Yang, M. J. Wooldridge (Eds.), Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelli...

  199. [209]

    X. Dong, Y. Yang, One-shot neural architecture search via self- evaluated template network, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 3680–

  200. [210]

    H. Zhou, M. Yang, J. Wang, W. Pan, Bayesnas: A bayesian approach for neural architecture search, in: K. Chaudhuri, R. Salakhutdinov (Eds.), Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, Vol. 97 of ...

  201. [211]

    J. Cui, P. Chen, R. Li, S. Liu, X. Shen, J. Jia, Fast and practical neural architecture search, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 6508–

  202. [212]

    G. Li, G. Qian, I. C. Delgadillo, M. M¨ uller, A. K. Thabet, B. Ghanem, SGAS: sequential greedy architecture search, in: 2020 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, IEEE, 2020, pp. 1617–1627. doi:10.1109...

  203. [214]

    Zhang, M

    C. Zhang, M. Ren, R. Urtasun, Graph hypernetworks for neu- ral architecture search, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019, OpenReview.net, 2019. URL https://openreview.net/forum?id=rkgW0oA9FX

  204. [215]

    Sandler, A

    M. Sandler, A. G. Howard, M. Zhu, A. Zhmoginov, L. Chen, Mobilenetv2: Inverted residuals and linear bottlenecks, in: 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018, IEEE Computer Society, 2018, pp. 4510–452...

  205. [216]

    Y. Xu, L. Xie, X. Zhang, X. Chen, G. Qi, Q. Tian, H. Xiong, PC-DARTS: partial channel connections for memory-efficient architecture search, in: 8th International Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020. ...

  206. [217]

    H. Cai, C. Gan, T. Wang, Z. Zhang, S. Han, Once-for-all: Train one network and specialize it for efficient deployment, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, Open- Review.net, 2020. URL https://openrevie...

  207. [218]

    J. Mei, Y. Li, X. Lian, X. Jin, L. Yang, A. L. Yuille, J. Yang, Atomnas: Fine-grained end-to-end neural architecture search, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, Open- Review.net, 2020. URL https://o...

  208. [221]

    S. You, T. Huang, M. Yang, F. Wang, C. Qian, C. Zhang, Greedynas: Towards fast one-shot NAS with greedy supernet, in: 2020 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, IEEE, 2020, pp. 1996–2005. doi:10.1109/CV...

  209. [222]

    Istrate, F

    R. Istrate, F. Scheidegger, G. Mariani, D. S. Nikolopoulos, C. Bekas, A. C. I. Malossi, TAPAS: train-less accuracy predic- tor for architecture search, in: The Thirty-Third AAAI Con- ference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Arti...

  210. [223]

    M. G. Kendall, A new measure of rank correlation, Biometrika 30 (1/2) (1938) 81–93. URL http://www.jstor.org/stable/2332226

  211. [224]

    C. Ying, A. Klein, E. Christiansen, E. Real, K. Murphy, F. Hut- ter, Nas-bench-101: Towards reproducible neural architecture search, in: K. Chaudhuri, R. Salakhutdinov (Eds.), Proceed- ings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Lo...

  212. [225]

    X. Dong, Y. Yang, Nas-bench-201: Extending the scope of reproducible neural architecture search, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020. URL https://openreview.net/forum?id=HJxyZkBKDr

  213. [227]

    Zhang, Z

    X. Zhang, Z. Huang, N. Wang, You only search once: Single shot neural architecture search via direct sparse optimization, arXiv preprint arXiv:1811.01567

  214. [228]

    J. Yu, P. Jin, H. Liu, G. Bender, P.-J. Kindermans, M. Tan, T. Huang, X. Song, R. Pang, Q. Le, Bignas: Scaling up neural architecture search with big single-stage models, arXiv preprint arXiv:2003.11142

  215. [229]

    X. Chu, B. Zhang, R. Xu, J. Li, Fairnas: Rethinking evaluation fairness of weight sharing neural architecture search, arXiv preprint arXiv:1907.01845

  216. [230]

    Benyahia, K

    Y. Benyahia, K. Yu, K. Bennani-Smires, M. Jaggi, A. C. Davi- son, M. Salzmann, C. Musat, Overcoming multi-model forget- ting, in: K. Chaudhuri, R. Salakhutdinov (Eds.), Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach,...

  217. [231]

    Klyuchnikov, I

    N. Klyuchnikov, I. Trofimov, E. Artemova, M. Salnikov, M. Fe- dorov, E. Burnaev, Nas-bench-nlp: Neural architecture search benchmark for natural language processing (2020). arXiv: 2006.07116

  218. [232]

    Bender, P

    G. Bender, P. Kindermans, B. Zoph, V. Vasudevan, Q. V. Le, Understanding and simplifying one-shot architecture search, in: J. G. Dy, A. Krause (Eds.), Proceedings of the 35th Inter- national Conference on Machine Learning, ICML 2018, Stock- holmsm¨ assan, Stockholm, Sweden, Ju...

  219. [233]

    X. Dong, M. Tan, A. W. Yu, D. Peng, B. Gabrys, Q. V. Le, Autohas: Differentiable hyper-parameter and architecture search (2020). arXiv:2006.03656

  220. [234]

    Klein, F

    A. Klein, F. Hutter, Tabular benchmarks for joint archi- tecture and hyperparameter optimization, arXiv preprint arXiv:1905.04970

  221. [235]

    X. Dai, A. Wan, P. Zhang, B. Wu, Z. He, Z. Wei, K. Chen, Y. Tian, M. Yu, P. Vajda, et al., Fbnetv3: Joint architecture- recipe search using neural acquisition function, arXiv preprint arXiv:2006.02049

  222. [237]

    X. He, S. Wang, S. Shi, X. Chu, J. Tang, X. Liu, C. Yan, J. Zhang, G. Ding, Benchmarking deep learning models and automated model design for covid-19 detection with chest ct scans, medRxiv

  223. [238]

    L. Faes, S. K. Wagner, D. J. Fu, X. Liu, E. Korot, J. R. Ledsam, T. Back, R. Chopra, N. Pontikos, C. Kern, et al., Automated deep learning design for medical image classification by health- care professionals with no coding experience: a feasibility study, The Lancet Digital He...

  224. [239]

    X. He, S. Wang, X. Chu, S. Shi, J. Tang, X. Liu, C. Yan, J. Zhang, G. Ding, Automated model design and benchmarking of 3d deep learning models for covid-19 detection with chest ct scans (2021). arXiv:2101.05442

  225. [240]

    Ghiasi, T

    G. Ghiasi, T. Lin, Q. V. Le, NAS-FPN: learning scalable feature pyramid architecture for object detection, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 7036–7045. ...

  226. [241]

    Hsu, S.-H

    C.-H. Hsu, S.-H. Chang, J.-H. Liang, H.-P. Chou, C.-H. Liu, S.- C. Chang, J.-Y. Pan, Y.-T. Chen, W. Wei, D.-C. Juan, Monas: Multi-objective neural architecture search using reinforcement learning, arXiv preprint arXiv:1806.10332

  227. [243]

    Y. Chen, T. Yang, X. Zhang, G. Meng, C. Pan, J. Sun, Detnas: Neural architecture search on object detection, arXiv preprint arXiv:1903.10979 1 (2) (2019) 4–1

  228. [246]

    H. Xu, L. Yao, Z. Li, X. Liang, W. Zhang, Auto-fpn: Automatic network architecture adaptation for object detection beyond classification, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, p...

  229. [247]

    Nekrasov, H

    V. Nekrasov, H. Chen, C. Shen, I. D. Reid, Fast neural architecture search of compact semantic segmentation models via auxiliary cells, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation ...

  230. [248]

    W. Bae, S. Lee, Y. Lee, B. Park, M. Chung, K.-H. Jung, Re- source optimized neural architecture search for 3d medical image segmentation, in: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention, Springer, 2019, pp. 228–236

  231. [249]

    D. Yang, H. Roth, Z. Xu, F. Milletari, L. Zhang, D. Xu, Search- ing learning strategy with reinforcement learning for 3d medical image segmentation, in: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention, Springer, 2019, pp. 3–11

  232. [250]

    N. Dong, M. Xu, X. Liang, Y. Jiang, W. Dai, E. Xing, Neural architecture search for adversarial medical image segmentation, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, 2019, pp. 828–836

  233. [251]

    Y. Weng, T. Zhou, Y. Li, X. Qiu, Nas-unet: Neural architecture search for medical image segmentation, IEEE Access 7 (2019) 44247–44257

  234. [252]

    R. Quan, X. Dong, Y. Wu, L. Zhu, Y. Yang, Auto-reid: Search- ing for a part-aware convnet for person re-identification, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 3749–3758. doi:...

  235. [253]

    D. Song, C. Xu, X. Jia, Y. Chen, C. Xu, Y. Wang, Efficient residual dense block search for image super-resolution., in: AAAI, 2020, pp. 12007–12014

  236. [254]

    X. Chu, B. Zhang, H. Ma, R. Xu, J. Li, Q. Li, Fast, accurate and lightweight super-resolution with neural architecture search, arXiv preprint arXiv:1901.07261

  237. [255]

    Y. Guo, Y. Luo, Z. He, J. Huang, J. Chen, Hierarchical neural architecture search for single image super-resolution, arXiv preprint arXiv:2003.04619

  238. [256]

    S. Kim, I. Kim, S. Lim, W. Baek, C. Kim, H. Cho, B. Yoon, T. Kim, Scalable neural architecture search for 3d medical image segmentation, in: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention, Springer, 2019, pp. 220–228

  239. [257]

    X. Gong, S. Chang, Y. Jiang, Z. Wang, Autogan: Neural architecture search for generative adversarial networks, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 3223–3233. doi:10.1109/...

  240. [258]

    Y. Fu, W. Chen, H. Wang, H. Li, Y. Lin, Z. Wang, Autogan- distiller: Searching to compress generative adversarial networks, in: Proceedings of the 37th International Conference on Ma- chine Learning, ICML 2020, 13-18 July 2020, Virtual Event, Vol. 119 of Proceedings of Machine...

  241. [261]

    Zhang, Y

    H. Zhang, Y. Li, H. Chen, C. Shen, Ir-nas: Neural architecture search for image restoration, arXiv preprint arXiv:1909.08228

  242. [262]

    W. Peng, X. Hong, G. Zhao, Video action recognition via neural architecture searching, in: 2019 IEEE International Conference on Image Processing (ICIP), IEEE, 2019, pp. 11–15

  243. [263]

    M. S. Ryoo, A. J. Piergiovanni, M. Tan, A. Angelova, Assem- blenet: Searching for multi-stream neural connectivity in video architectures, in: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020. U...

  244. [264]

    Nekrasov, H

    V. Nekrasov, H. Chen, C. Shen, I. Reid, Architecture search of dynamic cells for semantic video segmentation, in: The IEEE Winter Conference on Applications of Computer Vision, 2020, pp. 1970–1979

  245. [265]

    A. J. Piergiovanni, A. Angelova, A. Toshev, M. S. Ryoo, Evolving space-time neural architectures for videos, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 1793–1802. doi:10.1109/IC...

  246. [266]

    Saikia, Y

    T. Saikia, Y. Marrakchi, A. Zela, F. Hutter, T. Brox, Au- todispnet: Improving disparity estimation with automl, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 1812–1823. doi:10.110...

  247. [267]

    Jiang, C

    Y. Jiang, C. Hu, T. Xiao, C. Zhang, J. Zhu, Improved dif- ferentiable architecture search for language modeling and named entity recognition, in: Proceedings of the 2019 Confer- ence on Empirical Methods in Natural Language Processing and the 9th International Joint Conference...

  248. [268]

    J. Chen, K. Chen, X. Chen, X. Qiu, X. Huang, Exploring shared structures and hierarchies for multiple nlp tasks, arXiv preprint arXiv:1808.07658

  249. [269]

    Mazzawi, X

    H. Mazzawi, X. Gonzalvo, A. Kracun, P. Sridhar, N. Subrah- manya, I. Lopez-Moreno, H.-J. Park, P. Violette, Improving keyword spotting and language identification via neural ar- chitecture search at scale., in: INTERSPEECH, 2019, pp. 1278–1282

  250. [270]

    Y. He, J. Lin, Z. Liu, H. Wang, L.-J. Li, S. Han, Amc: Automl for model compression and acceleration on mobile devices, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 784–800

  251. [271]

    Y. Fan, F. Tian, Y. Xia, T. Qin, X.-Y. Li, T.-Y. Liu, Searching better architectures for neural machine translation, IEEE/ACM Transactions on Audio, Speech, and Language Processing

  252. [272]

    R. Zhao, W. Luk, Efficient structured pruning and architecture searching for group convolution, in: Proceedings of the IEEE International Conference on Computer Vision Workshops, 2019, pp. 0–0

  253. [273]

    T. Wang, K. Wang, H. Cai, J. Lin, Z. Liu, H. Wang, Y. Lin, S. Han, APQ: joint search for network architecture, pruning and quantization policy, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, IEEE, 2020, p...

  254. [274]

    X. Dong, Y. Yang, Network pruning via transformable architec- ture search, in: H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alch´ e-Buc, E. B. Fox, R. Garnett (Eds.), Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing...

  255. [275]

    Huang, K

    Q. Huang, K. Zhou, S. You, U. Neumann, Learning to prune filters in convolutional neural networks (2018). arXiv:1801. 07365

  256. [276]

    X. Xiao, Z. Wang, S. Rajasekaran, Autoprune: Automatic network pruning by regularizing auxiliary parameters, in: H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alch´ e-Buc, E. B. Fox, R. Garnett (Eds.), Advances in Neural Information Processing Systems 32: Annual Conferenc...

  257. [277]

    T.-W. Chin, C. Zhang, D. Marculescu, Layer-compensated pruning for resource-constrained convolutional neural networks (2018). arXiv:1810.00518

  258. [278]

    K. Zhou, Q. Song, X. Huang, X. Hu, Auto-gnn: Neural ar- chitecture search of graph neural networks, arXiv preprint arXiv:1909.03184

  259. [279]

    C. He, M. Annavaram, S. Avestimehr, Fednas: Federated deep learning via neural architecture search (2020). arXiv: 2004.08546

  260. [280]

    H. Zhu, Y. Jin, Real-time federated evolutionary neural archi- tecture search, arXiv preprint arXiv:2003.02793

  261. [281]

    Y. He, P. Liu, L. Zhu, Y. Yang, Meta filter pruning to accelerate deep convolutional neural networks (2019). arXiv:1904.03961

  262. [282]

    B. Ru, C. Lyle, L. Schut, M. van der Wilk, Y. Gal, Revisiting the train loss: an efficient performance estimator for neural architecture search, arXiv preprint arXiv:2006.04492

  263. [283]

    Ramachandran, B

    P. Ramachandran, B. Zoph, Q. V. Le, Searching for activation functions (2017). arXiv:1710.05941

  264. [284]

    H. Wang, H. Wang, K. Xu, Evolutionary recurrent neural network for image captioning, Neurocomputing

  265. [285]

    L. Wang, Y. Zhao, Y. Jinnai, Y. Tian, R. Fonseca, Neural architecture search using deep neural networks and monte carlo tree search, arXiv preprint arXiv:1805.07440

  266. [286]

    C. Li, X. Yuan, C. Lin, M. Guo, W. Wu, J. Yan, W. Ouyang, AM-LFS: automl for loss function search, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 8409–8418. doi:10.1109/ICCV.2019.00...

  267. [287]

    X. Zhao, C. Wang, M. Chen, X. Zheng, X. Liu, J. Tang, Au- toemb: Automated embedding dimensionality search in stream- ing recommendations, arXiv preprint arXiv:2002.11252

  268. [288]

    Cheng, Y

    W. Cheng, Y. Shen, L. Huang, Differentiable neural input search for recommender systems, arXiv preprint arXiv:2006.04466

  269. [289]

    E. Real, C. Liang, D. R. So, Q. V. Le, Automl-zero: Evolving machine learning algorithms from scratch, in: Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, Vol. 119 of Proceedings of Machine Learning Research, PML...

  270. [290]

    Radford, J

    A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever, Language models are unsupervised multitask learners, OpenAI Blog 1 (2019) 8

  271. [291]

    P. Zhao, K. Xiao, Y. Zhang, K. Bian, W. Yan, Amer: Automatic behavior modeling and interaction exploration in recommender system, arXiv preprint arXiv:2006.05933

  272. [292]

    A. Zela, T. Elsken, T. Saikia, Y. Marrakchi, T. Brox, F. Hut- ter, Understanding and robustifying differentiable architecture search, in: 8th International Conference on Learning Represen- tations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, OpenReview.net, 2020. URL h...

  273. [293]

    KOTYAN, D

    S. KOTYAN, D. V. VARGAS, Is neural architecture search a way forward to develop robust neural networks?, Proceedings of the Annual Conference of JSAI JSAI2020 (2020) 2K1ES203– 2K1ES203

  274. [294]

    M. Guo, Y. Yang, R. Xu, Z. Liu, D. Lin, When NAS meets robustness: In search of robust architectures against adversarial attacks, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, IEEE, 2020, pp. 628–637. do...

  275. [295]

    Y. Chen, Q. Song, X. Liu, P. S. Sastry, X. Hu, On robustness of neural architecture search under label noise, in: Frontiers in Big Data, 2020

  276. [296]

    D. Wang, C. Gong, Q. Liu, Improving neural language modeling via adversarial training, in: K. Chaudhuri, R. Salakhutdinov (Eds.), Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, Vol. 97 of Proceeding...

  277. [1397]

    URL https://doi.org/10.1109/ICCV.2017.154

    doi:10.1109/ICCV.2017.154. URL https://doi.org/10.1109/ICCV.2017.154

  278. [2988]

    URL https://www.aclweb.org/anthology/P19-1285

    doi:10.18653/v1/P19-1285. URL https://www.aclweb.org/anthology/P19-1285

  279. [3689]

    URL https://doi.org/10.1109/ICCV.2019.00378

    doi:10.1109/ICCV.2019.00378. URL https://doi.org/10.1109/ICCV.2019.00378

  280. [6517]

    URL https://doi.org/10.1109/ICCV.2019.00661

    doi:10.1109/ICCV.2019.00661. URL https://doi.org/10.1109/ICCV.2019.00661

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.