REVIEW 2 cited by
A Comprehensive Review on Deep Supervision: Theories and Applications
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Deep supervision, or known as 'intermediate supervision' or 'auxiliary supervision', is to add supervision at hidden layers of a neural network. This technique has been increasingly applied in deep neural network learning systems for various computer vision applications recently. There is a consensus that deep supervision helps improve neural network performance by alleviating the gradient vanishing problem, as one of the many strengths of deep supervision. Besides, in different computer vision applications, deep supervision can be applied in different ways. How to make the most use of deep supervision to improve network performance in different applications has not been thoroughly investigated. In this paper, we provide a comprehensive in-depth review of deep supervision in both theories and applications. We propose a new classification of different deep supervision networks, and discuss advantages and limitations of current deep supervision networks in computer vision applications.
Forward citations
Cited by 2 Pith papers
-
Supervised Extraction of the Thermal Sunyaev$-$Zel'dovich Effect with a Three-Dimensional Convolutional Neural Network
A 3D Attention Nested U-Net trained on synthetic SZ signals injected into Planck maps extracts the thermal SZ effect with accuracy comparable to the NILC method.
-
Multi-Head Explainer: A General Framework to Improve Explainability in CNNs and Transformers
MHEX inserts attention-gated deep-supervision heads into ResNet and BERT and derives saliency maps from the product of the head weights, claiming better accuracy and more detailed explanations.
Discussion (0). Continue with ORCID to comment.