REVIEW 4 major objections 4 minor 13 references
Tetrahedron-Net for Medical Image Registration
T0 review · 4 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read The paper claims that appending a second decoder, which fuses encoder and first-decoder features, to any U-Net-like registration backbone yields consistent accuracy gains on LPBA40, IXI, and OASIS.
desk verdict A simple, plausibly useful second-decoder plug-in for registration U-Nets, but the paper never isolates the decoder's contribution from a pretraining advantage and lacks variance reporting. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing piece is the two-level decoder, a second decoder branch appended to an off-the-shelf encoder-decoder backbone. In the default U-UNet instantiation, Decoder 2 mirrors Decoder 1's structure but its $k$-th block takes as input the concatenation of the corresponding encoder feature, the previous Decoder-1 feature, and its own previous feature: $x^k_{\mathrm{dec2}} = \mathrm{Up}(\mathrm{CR}([x^{L-k}_{\mathrm{enc}}, x^{k-1}_{\mathrm{dec1}}, x^{k-1}_{\mathrm{dec2}}]))$. This turns registration into a coarse-to-fine refinement: Decoder 1 supplies a prior, and Decoder 2 fuses it with multi-scale encoder details to predict the final deformation field. The paper tests the same machinery with UNet++, UNet3+, and DenseUNet as second-decoder structures, reporting the best scores with the dense-block version.
What would settle it
Retrain each comparison model with the same two-stage pretraining schedule used for Tetrahedron-Net (encoder and first decoder first, then the full network) and compare Dice on LPBA40; if the gap essentially disappears, the second decoder is not the source of the gain.
Extended reading notes
Core claim
The paper's central claim is that a U-Net-style registration network produces better deformation fields when its decoder is replaced by two cooperative decoders sharing one encoder: the first decoder reconstructs multi-scale features exactly as in U-Net, and the second decoder refines that reconstruction by concatenating, at each scale, the encoder feature with the preceding outputs of both decoders. This makes the final prediction a coarse-to-fine refinement of the first decoder's result. The paper reports that using a DenseUNet-style second decoder gives the best configuration, reaching 0.681 average Dice on LPBA40 compared with 0.658 for the VoxelMorph baseline, and that the same appended-decoder recipe produces consistent gains when applied to VoxelMorph, ViT-V-Net, TransMorph, and TransMorph-bspl on LPBA40, IXI, and OASIS.
Load-bearing premise
For the reported gains to show what the paper claims, the comparison models must differ from Tetrahedron-Net only by the added decoder, but the proposed models were pretrained in two stages while the comparison models were not, so pretraining could be carrying part of the improvement.
Editorial extensions
If this is right
- Because the appended decoder couples only through skip connections and the loss is unchanged, any U-Net-like registration network can adopt the two-level decoder with a minimal code change.
- The reported gains hold for both convolutional (VoxelMorph) and transformer-based (ViT-V-Net, TransMorph) backbones, so the benefit does not depend on a particular encoder.
- The internal design of the second decoder matters: a DenseUNet-style second decoder outperforms plain UNet, UNet++, and UNet3+ second decoders on LPBA40.
- Adding more than two decoders continues to improve Dice but roughly doubles parameters per decoder, so the paper chooses two levels as the default trade-off.
- Pretraining the encoder and first decoder before adding the second decoder adds a small but consistent gain across all second-decoder variants.
Reading between the lines
- Editorial inference: because the appended decoder is agnostic to the encoder and loss function, the same recipe should transfer to other dense prediction tasks, such as medical image segmentation, which the authors list as future work.
- Editorial inference: the reported comparisons do not isolate the decoder from the two-stage pretraining protocol, so a replication that pretrains single-decoder baselines identically is needed before the full improvement is attributed to Decoder 2.
- Editorial inference: the LPBA40 evaluation uses one nine-volume test set with no error bars, so repeated runs with different seeds are needed to show whether the 0.6 to 2.3 point Dice differences are stable.
- Editorial inference: the reported faster convergence with Decoder 2 suggests the second branch acts partly as an optimization aid, which could be separated from capacity effects by measuring epoch-wise accuracy in a low-data setting.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Tetrahedron-Net, an extension of U-Net-like architectures for unsupervised 3D medical image registration. The central idea is to append a second decoder that receives skip connections from both the encoder and the first decoder, enabling a coarse-to-fine prediction of the deformation field. The authors instantiate three versions of the second decoder (UNet++, UNet3+, DenseUNet) and also integrate the two-level decoder into VoxelMorph, ViT-V-Net, TransMorph, and TransMorph-bspl. Experiments are reported on LPBA40, IXI, and OASIS, showing consistent improvements in Dice score and reductions in the percentage of non-positive Jacobian determinants. Ablation studies examine the impact of pretraining, encoder skip connections, the number of decoder levels, and the structure of the second decoder.
Significance. If the reported gains hold under a controlled comparison, the contribution is valuable: the two-level decoder is a simple, architecture-agnostic modification that can be bolted onto any U-Net-like registration network, and the paper demonstrates it on four public backbones across three datasets. The ablations are a strength, as they attempt to isolate the contribution of the second decoder and its skip connections. However, the current evaluation does not establish that the gains come from the decoder itself rather than from the pretraining schedule, and the lack of any variance or significance reporting makes the small absolute improvements difficult to interpret. The work is therefore potentially significant but not yet convincingly supported.
major comments (4)
- [§4.2.1, §4.2.4, Tables 1, 4, 5] The main comparison is confounded by pretraining. Section 4.2.4 states that the proposed models are 'loaded with pre-trained Enc and Dec1', and Table 1 shows that this pretraining alone improves Dice by 0.2–0.3% on LPBA40 (e.g., U-UNet from 0.665 to 0.667). The baselines in Tables 4 and 5 (VoxelMorph, ViT-V-Net, TransMorph) are not described as receiving any equivalent warm-start. Since the reported gains of Tetrahedron-Net over these baselines are 1.0–2.3% (e.g., VoxelMorph 0.658 vs. U-DenseUNet 0.681 in Table 4), part or all of the advantage could be due to the pretraining stage rather than the second decoder. The authors should rerun the baselines under the same two-stage pretraining protocol, or train all models from scratch, to isolate the architectural contribution.
- [Tables 4 and 5] No measures of uncertainty are reported anywhere. The LPBA40 test set has only 9 volumes, and the IXI and OASIS splits are also relatively small. The reported differences (e.g., 0.671 vs. 0.658 for U-UNet vs. VoxelMorph in Table 4) could easily fall within run-to-run variability. The paper should report mean and standard deviation over at least three independent training runs with different seeds, and ideally include paired statistical tests (e.g., Wilcoxon signed-rank) for the Dice comparisons. Without this, the central claim of 'consistent performance gains' is not statistically supported.
- [Tables 4 and 5] There is an internal inconsistency in the reported %|J|<0 for VoxelMorph on LPBA40: Table 4 lists 0.384, while Table 5 lists 0.288 for the same dataset and baseline. Since the paper uses the Jacobian metric to claim improved regularity of deformation fields, this discrepancy undermines the reliability of that claim. The authors should clarify which value is correct and ensure that all tables are consistent.
- [§4.2.4, §4.3] The choice of DenseUNet as the second decoder for the main results in Table 5 is made based on LPBA40 test-set performance (Section 4.2.4 states that DenseUNet 'achieves the best results'), and the default two-level decoder configuration is similarly selected based on LPBA40 (Section 4.2.3). This is a form of model selection on the test set, which can inflate results on LPBA40 and may not generalize. The authors should either select the Dec2 variant using a validation set or report results for all Dec2 variants on IXI and OASIS to demonstrate that the choice is not overfitted to LPBA40.
minor comments (4)
- [§3.3, §3.4] The description of the UNet++-based second decoder says 'each decoder layer is connected to all preceding decoder layers', but the general equation in Section 3.2.3 (Eq. 5) only concatenates the immediately previous Dec1 and Dec2 features. The relation between the specific decoder structures and the general formulation should be clarified, either by giving separate equations for each variant or by stating that Eq. (5) is the simplest case.
- [Table 3] The 'Level of decoder 1' entry reports DSC of 0.657, while the U-UNet baseline in Table 1 without pretraining is 0.665 and in Table 2 without encoder features is 0.667. The relationship between these numbers is not explained; if the ablation in Table 3 uses a different configuration (e.g., without pretraining or with different skip connections), this should be stated explicitly.
- [§4.1.2] Please state the number of random seeds used, the hardware/software versions, and the approximate training time. No code or trained models are provided, so these details are important for reproducibility. The current description ('one NVIDIA RTX 3090 GPU') is insufficient for an independent replication.
- [§5 'Limitations and future work'] The stated limitation ('validated only on medical image registration') is framed as a limitation, but the paper explicitly claims generality to other dense prediction tasks in the introduction; the more relevant limitation is the absence of a controlled ablation isolating the decoder's benefit from the pretraining schedule, as noted above. Consider rephrasing the limitations section to address the actual threats to validity.
Circularity Check
No circularity: the paper's claims are empirical architecture comparisons against external benchmarks, and no prediction is forced by definition or by self-citation.
full rationale
This is an empirical architecture study, not a derivation-based paper. The central claim, that a second decoder concatenating encoder and first-decoder features improves registration accuracy, is supported by direct comparisons against external baselines (VoxelMorph, ViT-V-Net, TransMorph) and by ablation experiments. Equations (3)-(5) define the encoder and two decoder branches, but the claimed improvement is not a logical consequence of these definitions; it is an empirical observation measured by Dice score and Jacobian determinants. There are no load-bearing self-citations, no imported uniqueness theorems, and no ansatz smuggled in via citations from the same authors. The paper does not rename a known result under new coordinates, and it does not fit a parameter and then relabel that fit as a prediction. The only notable concerns are experimental rather than circular: the DenseUNet variant of Dec2 was selected based on LPBA40 test performance and then reported on the same dataset, and the proposed models use a pretrained Enc/Dec1 warm-start while the baseline models are not described as receiving the same pretraining. These are threats to internal validity or fairness of comparison, not circularity, because no reported quantity reduces to its own input by construction. Accordingly, the circularity score is 0.
Assumptions & free parameters
free parameters (3)
- Pretraining of Enc+Dec1 =
True
- Second-level decoder structure =
DenseUNet
- Regularization weight lambda =
1
assumptions (3)
- domain assumption NCC similarity plus diffusion regularization is a valid registration objective
- domain assumption The public benchmarks with FreeSurfer preprocessing are comparable across methods
- domain assumption Dice overlap on 9 test volumes (LPBA40) is a reliable performance signal
Cite this review
Pith. "Pith review of Tetrahedron-Net for Medical Image Registration." pith.science (2026). https://pith.science/paper/EMOU3RZZ
@misc{pith2026250504380,
author = {Pith},
title = {Pith review of: Tetrahedron-Net for Medical Image Registration},
year = {2026},
howpublished = {\url{https://pith.science/paper/EMOU3RZZ}},
note = {Machine review of arXiv:2505.04380}
}
read the original abstract
Medical image registration plays a vital role in medical image processing. Extracting expressive representations for medical images is crucial for improving the registration quality. One common practice for this end is constructing a convolutional backbone to enable interactions with skip connections among feature extraction layers. The de facto structure, U-Net-like networks, has attempted to design skip connections such as nested or full-scale ones to connect one single encoder and one single decoder to improve its representation capacity. Despite being effective, it still does not fully explore interactions with a single encoder and decoder architectures. In this paper, we embrace this observation and introduce a simple yet effective alternative strategy to enhance the representations for registrations by appending one additional decoder. The new decoder is designed to interact with both the original encoder and decoder. In this way, it not only reuses feature presentation from corresponding layers in the encoder but also interacts with the original decoder to corporately give more accurate registration results. The new architecture is concise yet generalized, with only one encoder and two decoders forming a ``Tetrahedron'' structure, thereby dubbed Tetrahedron-Net. Three instantiations of Tetrahedron-Net are further constructed regarding the different structures of the appended decoder. Our extensive experiments prove that superior performance can be obtained on several representative benchmarks of medical image registration. Finally, such a ``Tetrahedron'' design can also be easily integrated into popular U-Net-like architectures including VoxelMorph, ViT-V-Net, and TransMorph, leading to consistent performance gains.
Figures
Figures from the paper (6 more)
Reference graph
Works this paper leans on
-
[3]
U-resnet: Ultimate coupling of registration and seg- mentation with deep nets, in: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part III 22, pp. 310–319. Fischl, B.,
work page 2019
-
[5]
Transformers in medical image analysis. Intelligent Medicine 3, 59–78. He,K.,Zhang,X.,Ren,S.,Sun,J.,2016. Deepresiduallearningforimage recognition,in:ProceedingsoftheIEEEconferenceoncomputervision and pattern recognition, pp. 770–778. Hu, M., Zhang, J., Matkovic, L., Liu, T., Yang, X.,
work page 2016
-
[8]
Medical ImageAnalysis85,102762
Transformingmedicalimagingwithtransformers?acomparativereview of key properties, current progresses, and future perspectives. Medical ImageAnalysis85,102762. doi: https://doi.org/10.1016/j.media.2023. 102762. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.,
-
[9]
arXivpreprint arXiv:1804.03999
Attentionu-net:Learningwheretolookforthepancreas. arXivpreprint arXiv:1804.03999 . Razzak, M.I., Naz, S., Zaib, A.,
-
[10]
Classification in BioApps: Automation of decision making , 323–350
Deep learning for medical image processing: Overview, challenges and the future. Classification in BioApps: Automation of decision making , 323–350. Ronneberger,O.,Fischer,P.,Brox,T.,2015. U-net:Convolutionalnetworks for biomedical image segmentation, in: International Conference on Medical Image Computing and Computer-Assisted Intervention. Sheikhjafari,...
work page 2015
-
[12]
arXiv preprint arXiv:1809.03443
Inverse-consistent deep networks for unsupervised de- formable image registration. arXiv preprint arXiv:1809.03443 . 10 Zhang, J., Wang, J., Wang, X., Feng, D.,
-
[97]
URL: https://dx.doi.org/10.1088/0031-9155/59/1/97, doi:10. 1088/0031-9155/59/1/97. Zhao, A., Balakrishnan, G., Durand, F., Guttag, J.V., Dalca, A.V., 2019a. Dataaugmentationusinglearnedtransformsforone-shotmedicalimage segmentation. ArXiv abs/1902.09383. Zhao, S., Dong, Y., Chang, E.I., Xu, Y., et al., 2019b. Recursive cascaded networks for unsupervised m...
-
[2014]
arXiv preprint arXiv:1412.6980
Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 . Kuang, D., Schmah, T.,
Show all 13 references
-
[2015]
Going deeper with convolu- tions, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1–9. Wang, H., Cao, P., Wang, J., Zaiane, O.R., 2022a. Uctransnet: rethinking the skip connections in u-net from a channel-wise perspective with transformer...
2021
-
[2018]
ArXiv abs/1811.09243
Faim - a convnet method for unsupervised 3d medical image registration. ArXiv abs/1811.09243. Li, J., Chen, J., Tang, Y., Wang, C., Landman, B.A., Zhou, S.K.,
-
[2019]
IEEE Transactions on medical imaging 38, 1788–1800
Voxelmorph: a learning framework for deformable medical image reg- istration. IEEE Transactions on medical imaging 38, 1788–1800. Chen,J.,Frey,E.C.,He,Y.,Segars,W.P.,Li,Y.,Du,Y.,2022. Transmorph: Transformer for unsupervised medical image registration. Medical image analysis 8...
2022 arXiv
-
[2020]
arXiv preprint arXiv:2010.11929
An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 . Estienne, T., Vakalopoulou, M., Christodoulidis, S., Battistela, E., Ler- ousseau,M.,Carre,A.,Klausner,G.,Sun,R.,Robert,C.,Mougiakakou, S., et al.,
2010 arXiv
-
[2023]
arXiv preprint arXiv:2309.00727
Deep learning in medical image registration: introduction and survey. arXiv preprint arXiv:2309.00727 . He,K.,Gan,C.,Li,Z.,Rekik,I.,Yin,Z.,Ji,W.,Gao,Y.,Wang,Q.,Zhang, J., Shen, D.,
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.