REVIEW 4 cited by
A Survey of Lottery Ticket Hypothesis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The Lottery Ticket Hypothesis (LTH) states that a dense neural network model contains a highly sparse subnetwork (i.e., winning tickets) that can achieve even better performance than the original model when trained in isolation. While LTH has been proved both empirically and theoretically in many works, there still are some open issues, such as efficiency and scalability, to be addressed. Also, the lack of open-source frameworks and consensual experimental setting poses a challenge to future research on LTH. We, for the first time, examine previous research and studies on LTH from different perspectives. We also discuss issues in existing works and list potential directions for further exploration. This survey aims to provide an in-depth look at the state of LTH and develop a duly maintained platform to conduct experiments and compare with the most updated baselines.
Forward citations
Cited by 4 Pith papers
-
Weisfeiler and Leman Go Gambling: Why Expressive Lottery Tickets Win
Expressive sparse subnetworks of sufficiently overparameterized graph neural networks provably preserve Weisfeiler-Leman expressivity, and empirically high pre-training expressivity makes a lottery ticket far more lik...
-
Expand Neurons, Not Parameters
Fixed Parameter Expansion — duplicating neurons and partitioning their incoming weights into disjoint sparse sub-neurons at constant non-zero parameter count — reduces measured feature interference and improves classi...
-
Investigating the Lottery Ticket Hypothesis for Variational Quantum Circuits
On toy classification tasks, variational quantum circuits show weak lottery ticket behavior: pruned circuits retain full accuracy with roughly 26% to 51% of their parameters, while strong-ticket evidence is limited to...
-
Not All Explanations for Deep Learning Phenomena Are Equally Valuable
A position paper arguing that narrow, puzzle-solving explanations of deep learning edge case phenomena are low-value, and that these phenomena should instead be used to stress-test broad explanatory theories.
Discussion (0). Continue with ORCID to comment.