SWARD introduces stochastic windowed attention distillation and prototype discriminative regularization to improve cross-architecture knowledge transfer from transformers to CNNs for semantic segmentation.
Masked distillation with receptive tokens.arXiv preprint arXiv:2205.14589, 2022
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
SWARD: Stochastic Window-Attention-Based Relational Distillation for Cross-Architectural Semantic Segmentation
SWARD introduces stochastic windowed attention distillation and prototype discriminative regularization to improve cross-architecture knowledge transfer from transformers to CNNs for semantic segmentation.