Pith. sign in

REVIEW 3 cited by

NoiseOut: A Simple Way to Prune Neural Networks

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1611.06211 v1 pith:7PL5GGHN submitted 2016-11-18 cs.NE cs.CV

Mohammad Babaeizadeh , Paris Smaragdis , Roy H. Campbell This is my paper · ORCID
classification cs.NEcs.CV
keywords neuronsnetworksnoiseoutpruningaccuracycorrelationmaintainingneural
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Neural networks are usually over-parameterized with significant redundancy in the number of required neurons which results in unnecessary computation and memory usage at inference time. One common approach to address this issue is to prune these big networks by removing extra neurons and parameters while maintaining the accuracy. In this paper, we propose NoiseOut, a fully automated pruning algorithm based on the correlation between activations of neurons in the hidden layers. We prove that adding additional output neurons with entirely random targets results into a higher correlation between neurons which makes pruning by NoiseOut even more efficient. Finally, we test our method on various networks and datasets. These experiments exhibit high pruning rates while maintaining the accuracy of the original network.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Catalyst: Out-of-Distribution Detection via Elastic Scaling

    cs.CV 2026-02 conditional novelty 7.0 of 10

    Catalyst improves OOD detection by multiplicatively scaling baseline scores using channel-wise statistics from pre-pooling feature maps, reducing average FPR by 22-33% on standard benchmarks.

  2. Adaptive Ensemble of Classifiers with Regularization for Imbalanced Data Classification

    cs.LG 2019-08 reject novelty 4.0 of 10

    AER is a dynamic ensemble method that reports improved balanced accuracy on seven UCI imbalanced datasets and five GMM-generated variants, with a theoretical complexity claim that is not correctly proved.

  3. Smaller Models, Better Generalization

    cs.LG 2019-08 reject novelty 3.0 of 10

    A regularizer claimed to minimize a VC dimension bound for neural networks is proposed, but the bound derivation drops a required term and the empirical gains over L2 regularization are inconsistent.

Pith tools