REVIEW 3 major objections 5 minor 22 references
Frequency-enhanced Multi-granularity Context Network for Efficient Vertebrae Segmentation
T0 review · 3 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read A wavelet-based segmentation network achieves state-of-the-art vertebrae segmentation on CT and MRI by processing high- and low-frequency signal components separately, restoring blurred detail and distinguishing look-alike vertebrae.
desk verdict Solid incremental architecture paper, but the SOTA claim is undercut by a numerical slip and single-run margins of about 1 DSC point. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The engine of the argument is the discrete wavelet transform used as a lossless downsampling step (WTD): it splits each 3D feature map into one low-frequency band and seven high-frequency sub-bands instead of pooling away information. The high-frequency bands go through a High-frequency Feature Refinement (HFR) module with two attention paths, one amplifying salient structures (max-pooling plus softmax weighting) and one smoothing noise (average pooling); the low-frequency band goes through a Multi-granularity State Space Model (MG-SSM) that runs three parallel dilated depthwise convolutions into three state-space modules and merges their outputs, capturing long-range dependencies at linear complexity. A Wavelet Transform Upsampling (WTU) step reuses encoder wavelet coefficients during decoding. Each named component does specific work: WTD avoids information loss, HFR restores fine detail, and MG-SSM supplies the spatially-varying multi-scale context the paper argues is needed to tell similar vertebrae apart.
What would settle it
Run the released code on both benchmarks under the stated settings with at least five random seeds; the central claim would be undermined if the seed-to-seed variation in FMC-Net's mean DSC overlaps the reported scores of the best prior method in Table 1 (a 1.64-point margin on VERSE2019 and a 0.96-point margin on LUMBAR), or if the DWT-Sample component changes the DSC by less than the 0.66 points reported in the ablation.
Extended reading notes
Core claim
The discovery this paper puts forward is a segmentation architecture whose performance gains come from where information is lost, not from a bigger model. FMC-Net replaces max-pooling and interpolation with a discrete wavelet transform, which splits each feature map into one low-frequency band (the bulk of the image content) and seven high-frequency bands (edges, texture, noise) without discarding information. High-frequency bands pass through a High-frequency Feature Refinement (HFR) module with two spatial-attention paths — one that amplifies salient structure via max-pooling, one that smooths noise via average pooling. Low-frequency bands pass through a Multi-granularity State Space Model (MG-SSM): three dilated depthwise convolutions feed three state-space modules whose outputs are merged, capturing contexts at multiple receptive fields with linear complexity in sequence length. The wavelet-based sampling is also used in the decoder (Wavelet Transform Upsampling), so encoder detail is reused during upsampling. The author's claim is that this combination specifically targets the two failure modes — blur and vertebra similarity — and that it outperforms previous convolutional, transformer, and state-space-model methods on both CT and MRI vertebrae benchmarks.
Load-bearing premise
The load-bearing premise is that the reported performance gaps over the prior methods are genuine effects of the architecture and not artifacts of a single training run: the paper reports no error bars, repeated trials, or significance tests, so the observed 1–2 point DSC advantages are assumed to be stable.
Editorial extensions
If this is right
- Because the ablation isolates each piece, the wavelet sampling, the high-frequency refinement, and the multi-granularity state-space module each can be added to an existing U-shaped baseline independently and raise the Dice score.
- The same network, with only patch size and epoch count changed, produces the reported results on both CT and MRI, so the design is not tied to one imaging modality.
- The underlying state-space formulation keeps long-range context capture at linear complexity, avoiding the quadratic cost of self-attention that limits transformer-based segmentation of large 3D volumes.
- Public release of the code means the reported numbers on both benchmarks can be checked directly against the paper's tables.
Reading between the lines
- My inference: if the failure-mode analysis is right, the accuracy gains should concentrate on blurry slices and on the boundaries between adjacent vertebrae; a stratified error analysis by sharpness and inter-vertebral border distance would confirm where the method actually helps.
- My inference: the component-wise ablation numbers come from single runs, so the exact size of each module's contribution is not yet established; multi-seed ablations would turn the observed ordering of gains into a quantitative claim.
- My inference: the frequency-split recipe (wavelet downsampling plus separate high/low treatment) is a general remedy for repetitive-anatomy segmentation with blur, and could be tested on ribs, teeth, or finger bones where the same two failure modes dominate.
- My inference: the method's reported improvements over the closest prior model are in the 1–2 DSC point range; whether that margin is clinically meaningful for vertebrae labeling is a separate question the paper does not address, since DSC gains of that size may or may not change surgical planning decisions.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes FMC-Net, a 3D encoder-decoder for vertebrae segmentation that replaces standard downsampling with discrete wavelet transform, splits features into high- and low-frequency components, enhances them with a High-frequency Feature Refinement (HFR) module and a Multi-granularity State Space Model (MG-SSM), and reconstructs features via inverse wavelet transform. The method is evaluated on VERSE2019 (CT) and LUMBAR (MRI) datasets, reporting DSC and HD95 against CNN-, Transformer-, and Mamba-based baselines, together with an ablation study on LUMBAR. The central claim is that FMC-Net achieves state-of-the-art performance on both datasets.
Significance. If the reported results are reliable, the paper would make a modest but useful contribution to vertebrae segmentation: it combines two established ideas (wavelet-domain downsampling and state-space modeling) in a new way, addresses the clinically relevant problem of blurred and morphologically similar vertebrae, and provides a public codebase. The ablation study on LUMBAR shows large gains from the proposed components (DSC from 71.09 to 79.13), and the design is plausible and well-motivated. However, the significance as stated depends on the SOTA claim, which currently rests on a single training run and on a numerical mismatch between the text and Table 1. The gains over the strongest baselines are small (1.64 DSC over UMamba on VERSE2019 and 0.96 DSC over SegMamba on LUMBAR), and no evidence rules out seed or protocol variation. The manuscript is therefore of interest to the community, but the SOTA claim is not yet established at the level of certainty the paper asserts.
major comments (3)
- [Section 3, Table 1 and text] There is a direct numerical contradiction in the SOTA claim. The text states that compared with the best-performing Mamba-based method, SegMamba, the approach improves the mean DSC per class by 1.64% on VERSE2019. Table 1, however, lists SegMamba at 72.22 DSC and FMC-Net at 79.92 DSC on VERSE2019, a difference of 7.70 percentage points, not 1.64. The 1.64-point gap corresponds to UMamba (78.28 vs. 79.92), not SegMamba. Either the text identifies the wrong baseline or the table reports different numbers. This is load-bearing because the paper's central claim is state-of-the-art performance, and the reader cannot tell which baseline is actually the strongest. The authors must correct the text/table inconsistency and clearly state which baseline is the best prior method on each dataset.
- [Section 3, Tables 1 and 2] No error bars, confidence intervals, repeated runs, or significance tests are reported for any of the quantitative results. The margins over the strongest baselines are approximately 1.64 DSC points on VERSE2019 and 0.96 DSC points on LUMBAR; in 3D medical segmentation, single-seed differences of this size are typically within random seed variation and hyperparameter sensitivity. Without at least three independent runs with mean and standard deviation, or a paired statistical test, the claim that FMC-Net outperforms state-of-the-art methods is not established. The same issue affects the ablation study in Table 2: for example, adding HFR improves DSC by 3.55 points (71.75 to 75.30) but worsens HD95 from 22.12 to 24.52, and adding MG-SSM improves DSC by 1.79 points (76.56 to 78.35?) while worsening HD95 from 16.72 to 17.13 in the final row. Without variance information, the claim that each component 'significantly enhances' performance is unsupported.
- [Section 3, Datasets and Implementation Details] The experimental protocol is incompletely specified. The paper does not state how the VERSE2019 (160 scans) and LUMBAR (156 scans) datasets were split into training, validation, and test sets, nor whether the baseline numbers in Table 1 were obtained under the same split and preprocessing as the proposed method. If baseline results are quoted from their original papers and those papers use different splits or evaluation protocols, the cross-method comparison in Table 1 is not valid. The authors should state the exact split, the number of folds if cross-validation is used, and either re-evaluate all baselines under the identical protocol or justify that the cited numbers are protocol-comparable.
minor comments (5)
- [Section 2.3, Eq. (8)] Equation (8) appears to have a missing closing parenthesis: X2 = phi(Conv([Fd1, Fd2, Fd3])) is presumably intended. Please fix the typo.
- [Section 3, Table 2] The checkmark pattern in Table 2 is ambiguous. The rows with the same number of checkmarks ('✓ ✓') cannot be reliably mapped to components without carefully cross-referencing the text; for example, the row at 76.56 could be Baseline+DWT+MG-SSM or Baseline+HFR+MG-SSM. Please label each row explicitly or use separate columns with Y/N entries.
- [Title and Section 2] The title claims 'Efficient' segmentation, but no efficiency metrics (parameters, FLOPs, inference time, GPU memory) are reported, and the only efficiency evidence is the linear-complexity statement about SSMs. Please add quantitative efficiency comparisons with the baselines, or soften the efficiency claim.
- [Section 2.2 and Table 1] The dilation rates d1, d2, d3 in MG-SSM and the group counts 2^i in HFR are fixed hyperparameters, but no sensitivity analysis or ablation is provided for them. Since the multi-granularity argument depends on these choices, a short ablation or at least a statement of how they were chosen would strengthen the paper.
- [Throughout] There are several typographical errors: 'he evaluation results' should be 'The evaluation results' in Section 3; 'are in illustrated Fig. 1 (a)' should be 'are illustrated in Fig. 1 (a)' in Section 1; and Eq. (1) lists eight sub-bands but uses a notation where F_i_{llh,...,hhh} is written with only one representative subscript. These should be cleaned up.
Circularity Check
No significant circularity: FMC-Net is an empirical architecture paper whose claims are measured against external public benchmarks, not derived from fitted parameters or self-citation.
full rationale
The paper makes no parameter-free predictions or first-principles derivations; its central contribution is an architectural design (wavelet-based downsampling/upsampling, HFR, and MG-SSM) evaluated by measured DSC and HD95 on two public datasets, VERSE2019 and LUMBAR. The components are defined by explicit equations (Eqs. 1-9) but none of these equations is fitted to the reported metrics, and the benchmark numbers in Tables 1 and 2 are external measurements, not consequences of the method's mathematical definitions. Citations such as [12] and [13] for wavelet transforms are external prior work and are not load-bearing self-citations. The reported text/table mismatch about SegMamba's DSC (1.64% vs 7.70%) is an internal consistency or correctness issue, not a circularity issue, because the claimed comparison does not reduce to the paper's own assumptions. No fitted parameter is renamed as a prediction, no uniqueness theorem is imported from the authors' prior work, and no ansatz is smuggled in via citation. The derivation chain is therefore self-contained with respect to circularity, and the appropriate score is 0.
Assumptions & free parameters
free parameters (3)
- dilation rates (d1, d2, d3) of MG-SSM branches =
not disclosed
- Group counts 2^i in HFR GroupMax =
2^i groups, i is encoder stage
- Training hyperparameters =
patch sizes (128,160,96) and (32,256,160); 1000/600 epochs; lr 0.01
assumptions (4)
- standard math The Haar Discrete Wavelet Transform is invertible and information-preserving, so downsampling via DWT does not lose details.
- domain assumption VERSE2019 and LUMBAR are representative benchmarks for vertebrae segmentation in CT and MRI.
- domain assumption DSC and HD95 are sufficient metrics for comparing vertebrae segmentation methods.
- ad hoc to paper Splitting features into high- and low-frequency components and enhancing them separately improves segmentation over joint feature processing.
Cite this review
Pith. "Pith review of Frequency-enhanced Multi-granularity Context Network for Efficient Vertebrae Segmentation." pith.science (2026). https://pith.science/paper/KX63ONND
@misc{pith2026250623086,
author = {Pith},
title = {Pith review of: Frequency-enhanced Multi-granularity Context Network for Efficient Vertebrae Segmentation},
year = {2026},
howpublished = {\url{https://pith.science/paper/KX63ONND}},
note = {Machine review of arXiv:2506.23086}
}
read the original abstract
Automated and accurate segmentation of individual vertebra in 3D CT and MRI images is essential for various clinical applications. Due to the limitations of current imaging techniques and the complexity of spinal structures, existing methods still struggle with reducing the impact of image blurring and distinguishing similar vertebrae. To alleviate these issues, we introduce a Frequency-enhanced Multi-granularity Context Network (FMC-Net) to improve the accuracy of vertebrae segmentation. Specifically, we first apply wavelet transform for lossless downsampling to reduce the feature distortion in blurred images. The decomposed high and low-frequency components are then processed separately. For the high-frequency components, we apply a High-frequency Feature Refinement (HFR) to amplify the prominence of key features and filter out noises, restoring fine-grained details in blurred images. For the low-frequency components, we use a Multi-granularity State Space Model (MG-SSM) to aggregate feature representations with different receptive fields, extracting spatially-varying contexts while capturing long-range dependencies with linear complexity. The utilization of multi-granularity contexts is essential for distinguishing similar vertebrae and improving segmentation accuracy. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches on both CT and MRI vertebrae segmentation datasets. The source code is publicly available at https://github.com/anaanaa/FMCNet.
Figures
Reference graph
Works this paper leans on
-
[1]
In: Proceedings of the AAAI Conference on Artificial Intelligence, Vol
Wang,H.,Song,Q.,Yin,R.,Ma,R.:B-spine:LearningB-splinecurverepresentation for robust and interpretable spinal curvature estimation. In: Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38, No. 6, pp. 5381-5389 (2024)
work page 2024
-
[2]
IEEE Transactions on Medical Imaging, 40(1), 262-273 (2020)
Pang, S., Pang, C., Zhao, L., Chen, Y., Su, Z., Zhou, Y., Feng, Q.: SpineParseNet: spine parsing for volumetric MR image by a two-stage segmentation framework with semantic image representation. IEEE Transactions on Medical Imaging, 40(1), 262-273 (2020)
work page 2020
-
[3]
Lessmann, N., Van Ginneken, B., De Jong, P. A., Išgum, I.: Iterative fully con- volutional neural networks for automatic vertebra segmentation and identification. Medical Image Analysis, 53, 142-155 (2019)
work page 2019
-
[4]
In: Medical Image Computing and Computer Assisted Intervention, pp
Wu, H., Zhang, J., Fang, Y., Liu, Z., Wang, N., Cui, Z., Shen, D.: Multi-view ver- tebra localization and identification from ct images. In: Medical Image Computing and Computer Assisted Intervention, pp. 136-145 (2023)
work page 2023
-
[5]
Medical Image Analysis, 75, 102258 (2022)
Tao,R.,Liu,W.,Zheng,G.:Spine-transformers:Vertebralabelingandsegmentation in arbitrary field-of-view spine CTs via 3D transformers. Medical Image Analysis, 75, 102258 (2022)
work page 2022
-
[6]
IEEE Journal of Biomedical and Health Informatics, 26(8), 3976-3987 (2022)
Shi, W., Xu, T., Yang, H., Xi, Y., Du, Y., Li, J., Li, J.: Attention gate based dual- pathway network for vertebra segmentation of X-ray spine images. IEEE Journal of Biomedical and Health Informatics, 26(8), 3976-3987 (2022). 10 Jian Shi et al
work page 2022
-
[7]
In: Medical Image Computing and Com- puter Assisted Intervention, pp
Masuzawa, N., Kitamura, Y., Nakamura, K., Iizuka, S., Simo-Serra, E.: Automatic segmentation, localization, and identification of vertebrae in 3D CT images using cascaded convolutional neural networks. In: Medical Image Computing and Com- puter Assisted Intervention, pp. 681-690 (2020)
work page 2020
-
[8]
In: International Symposium on Biomedical Imaging, pp
You, X., Gu, Y., Liu, Y., Lu, S., Tang, X., Yang, J.: EG-Trans3DUNet: a single- staged transformer-based model for accurate vertebrae segmentation from spinal CT images. In: International Symposium on Biomedical Imaging, pp. 1-5 (2022)
work page 2022
Show all 22 references
-
[9]
Medical Physics, 50(10), 6296-6318 (2023)
You, X., Gu, Y., Liu, Y., Lu, S., Tang, X., Yang, J.: VerteFormer: A single-staged Transformer network for vertebrae segmentation from CT images with arbitrary field of views. Medical Physics, 50(10), 6296-6318 (2023)
2023
-
[10]
T., Warrington, A., Linderman, S
Smith, J. T., Warrington, A., Linderman, S. W.: Simplified state space layers for sequence modeling. In: International Conference on Learning Representations, (2022)
2022
-
[11]
In: First Conference on Language Modeling
Gu, A., Dao, T.: Mamba: Linear-time sequence modeling with selective state spaces. In: First Conference on Language Modeling. (2024)
2024
-
[12]
Pattern Recognition, 143, 109819 (2023)
Xu, G., Liao, W., Zhang, X., Li, C., He, X., Wu, X.: Haar wavelet downsampling: A simple but effective downsampling module for semantic segmentation. Pattern Recognition, 143, 109819 (2023)
2023
-
[13]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp
Li, Q., Shen, L., Guo, S., Lai, Z.: Wavelet integrated CNNs for noise-robust image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7245-7254 (2020)
2020
-
[14]
Neural Networks, 107: 3-11 (2018)
Elfwing, S., Uchibe, E., Doya, K.: Sigmoid-weighted linear units for neural net- work function approximation in reinforcement learning. Neural Networks, 107: 3-11 (2018)
2018
-
[15]
E., Bayat, A., Löffler, M., Liebl, H., Li, H., Kirschke, J
Sekuboyina, A., Husseini, M. E., Bayat, A., Löffler, M., Liebl, H., Li, H., Kirschke, J. S.: VerSe: a vertebrae labelling and segmentation benchmark for multi-detector CT images. Medical Image Analysis, 73, 102166 (2021)
2021
-
[16]
A., Becherucci, E
Khalil, Y. A., Becherucci, E. A., Kirschke, J. S., Karampinos, D. C., Breeuwer, M., Baum, T., Sollmann, N.: Multi-scanner and multi-modal lumbar vertebral body and intervertebral disc segmentation database. Scientific Data, 9(1), 97 (2022)
2022
-
[17]
F., Kohl, S
Isensee, F., Jaeger, P. F., Kohl, S. A., Petersen, J., Maier-Hein, K. H.: nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nature Methods, 18(2), 203-211 (2021)
2021
-
[18]
R., Landman, B., Xu, D., Hatamizadeh, A.: Self-supervised pre-training of swin transformers for 3d medical image analysis
Tang, Y., Yang, D., Li, W., Roth, H. R., Landman, B., Xu, D., Hatamizadeh, A.: Self-supervised pre-training of swin transformers for 3d medical image analysis. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 20730-20740 (2022)
2022
-
[19]
In: Medical Image Computing and Computer Assisted Intervention, pp
Xie, Y., Zhang, J., Shen, C., Xia, Y.: Cotr: Efficiently bridging cnn and transformer for 3d medical image segmentation. In: Medical Image Computing and Computer Assisted Intervention, pp. 171-180 (2021)
2021
-
[20]
arXiv preprint arXiv:2401.04722 (2024)
Ma, J., Li, F., Wang, B.: U-mamba: Enhancing long-range dependency for biomed- ical image segmentation. arXiv preprint arXiv:2401.04722 (2024)
2024 arXiv
-
[21]
In: Medical Image Computing and Computer-Assisted Intervention, pp
Xing, Z., Ye, T., Yang, Y., Liu, G., Zhu, L.: Segmamba: Long-range sequential modeling mamba for 3d medical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention, pp. 578-588 (2024)
2024
-
[22]
arXiv preprint arXiv:2409.12533 (2024)
Bian, C., Xia, N., Yang, X., Wang, F., Wang, F., Wei, B., Dong, Q.: Mambaclinix: Hierarchical gated convolution and mamba-based u-net for enhanced 3d medical image segmentation. arXiv preprint arXiv:2409.12533 (2024)
2024 arXiv
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.