REVIEW 1 cited by
Black Magic in Deep Learning: How Human Skill Impacts Network Training
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
How does a user's prior experience with deep learning impact accuracy? We present an initial study based on 31 participants with different levels of experience. Their task is to perform hyperparameter optimization for a given deep learning architecture. The results show a strong positive correlation between the participant's experience and the final performance. They additionally indicate that an experienced participant finds better solutions using fewer resources on average. The data suggests furthermore that participants with no prior experience follow random strategies in their pursuit of optimal hyperparameters. Our study investigates the subjective human factor in comparisons of state of the art results and scientific reproducibility in deep learning.
Forward citations
Cited by 1 Pith paper
-
Assessing the Advantages and Limitations of Quantum Neural Networks in Regression Tasks
Quantum neural networks strongly outperform narrow classical networks on smooth function regression, but the advantage depends on comparison design and disappears on discontinuous functions.
Discussion (0). Continue with ORCID to comment.