ResNet18's residual stream can build scale invariance by summing a smaller-scale feature from the block input with a larger-scale feature from the pre-sum output, and ablating these channels mildly impairs scale-robust image classification.
How does the brain solve visual object recognition? Neuron, 73 (3):415–434, 2012
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Naturally Computed Scale Invariance in the Residual Stream of ResNet18
ResNet18's residual stream can build scale invariance by summing a smaller-scale feature from the block input with a larger-scale feature from the pre-sum output, and ablating these channels mildly impairs scale-robust image classification.