Pith. sign in

REVIEW 12 cited by

nnFormer: Interleaved Transformer for Volumetric Segmentation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2109.03201 v6 pith:3M4U2GLM submitted 2021-09-07 cs.CV

Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu This is my paper
classification cs.CV
keywords nnformersegmentationtransformerattentionconvolutionalglobalhelpinterleaved
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional neural networks to overcome their inherent shortcomings of spatial inductive bias. However, most of recently proposed transformer-based segmentation approaches simply treated transformers as assisted modules to help encode global context into convolutional representations. To address this issue, we introduce nnFormer, a 3D transformer for volumetric medical image segmentation. nnFormer not only exploits the combination of interleaved convolution and self-attention operations, but also introduces local and global volume-based self-attention mechanism to learn volume representations. Moreover, nnFormer proposes to use skip attention to replace the traditional concatenation/summation operations in skip connections in U-Net like architecture. Experiments show that nnFormer significantly outperforms previous transformer-based counterparts by large margins on three public datasets. Compared to nnUNet, nnFormer produces significantly lower HD95 and comparable DSC results. Furthermore, we show that nnFormer and nnUNet are highly complementary to each other in model ensembling.

Discussion (0). Sign in to comment.

Forward citations

Cited by 12 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SAM+D: Parameter-Efficient Dimensional Lifting of SAM-Family Models via Depth-Routed LoRA and Depth Shifting

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Depth-routed LoRA and a depth-shift module lift frozen SAM and SAM2 to 3D and 3D+T segmentation using less than ~3.7% trainable parameters.

  2. One-for-All Adaptive Radiotherapy Planning Agent: A Foundation Framework for Daily CBCT-guided Radiotherapy

    physics.med-ph 2026-07 conditional novelty 6.0 of 10

    A unified agentic model performs online adaptive radiotherapy planning from daily CBCT in under two minutes with target dose errors generally within 2.0 Gy of clinical reference plans.

  3. Super-Generalist: Towards Comprehensive and Accurate Medical Image Understanding via Generalist-Specialist Synergy

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Injecting multi-expert anatomy/lesion segmentation priors into vision–language alignment and calibrating text attention with lesion masks yields broad CT diagnosis plus specialist-level tumor performance and lesion grounding.

  4. Unified Start, Personalized End: Progressive Pruning for Efficient 3D Medical Image Segmentation

    cs.CV 2025-09 conditional novelty 6.0 of 10

    PSP-Seg prunes redundant modules during training to make 3D segmentation networks much smaller and faster without losing accuracy.

  5. ScSAM: Debiasing Morphology and Distributional Variability in Subcellular Semantic Segmentation

    cs.CV 2025-07 conditional novelty 6.0 of 10

    ScSAM fuses frozen SAM and MAE embeddings with a fusion module and class prompt encoder, reporting state-of-the-art organelle segmentation on BetaSeg islet datasets.

  6. Mapping intratumoral heterogeneity through PET-derived washout and deep learning after proton therapy

    physics.med-ph 2025-06 conditional novelty 6.0 of 10

    A deep learning framework estimates voxel-wise biological washout parameters from simulated post-proton therapy PET, reducing errors by up to 60% and revealing intratumoral heterogeneity.

  7. Advancing Medical Image Segmentation via Self-supervised Instance-adaptive Prototype Learning

    stat.ME 2025-07 conditional novelty 5.0 of 10

    SIPL fuses common and instance-specific prototype proposals and reports the best mean Dice scores on BTCV, Lungs, and BraTS benchmarks.

  8. Rethinking Brain Tumor Segmentation from the Frequency Domain Perspective

    eess.IV 2025-06 conditional novelty 5.0 of 10

    A dual-branch frequency-domain brain tumor segmentation network, HFF-Net, reports large Dice improvements over prior methods on four public MRI datasets, especially for contrast-enhancing tumor regions.

  9. Dual Interaction Network with Cross-Image Attention for Medical Image Segmentation

    cs.CV 2025-09 conditional novelty 4.0 of 10

    A dual-encoder segmentation network fusing original and fuzzy-enhanced images with bidirectional cross-attention reports 93.25 Dice on ACDC and 85.49 Dice on Synapse.

  10. Pre- and Post-Treatment Glioma Segmentation with the Medical Imaging Segmentation Toolkit

    cs.CV 2025-07 conditional novelty 4.0 of 10

    On BraTS 2025 glioma segmentation, postprocessing strategies improve mean Dice/HD95 but worsen the official rank-based score, so the authors submitted the unpostprocessed baseline.

  11. MLRU++: Multiscale Lightweight Residual UNETR++ with Attention for Efficient 3D Medical Image Segmentation

    eess.IV 2025-07 reject novelty 4.0 of 10

    MLRU++ reports small Dice gains over UNETR++ on three public benchmarks using a lighter attention module and multiscale depthwise blocks.

  12. BraTS orchestrator : Democratizing and Disseminating state-of-the-art brain tumor image analysis

    eess.IV 2025-06 conditional novelty 4.0 of 10

    BraTS orchestrator is a new open-source package that provides uniform, tutorial-based access to winning BraTS segmentation and synthesis algorithms for brain tumor MRI.

Pith tools