REVIEW 3 major objections 5 minor 16 references
Combining Multi-Sequence and Synthetic Images for Improved Segmentation of Late Gadolinium Enhancement Cardiac MRI
T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read A U-Net trained on real multi-sequence MRI plus CycleGAN-synthesized LGE and rotated scar images reaches average Dice scores of 0.898 (LV), 0.810 (MYO), and 0.866 (RV) on the 40-patient test set, rivaling a network trained on five times…
desk verdict A credible challenge write-up with strong test Dice, but the central claim that synthetic and augmented training helps is selected on a one-patient validation set and never shown on the test set. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The argument rests on three components. The first is CycleGAN, an unpaired image-to-image translation network that converts bSSFP cine images into synthetic LGE images while preserving the underlying cardiac geometry, so the bSSFP ground-truth contours can supervise LGE segmentation. The second is shape-guided scar augmentation: 50 landmarks placed around the epicardium and endocardium allow the myocardial wall—and the scar within it—to be rotated in 20 steps of 7.2 degrees, spreading scar locations across up to 144 degrees. The third is a modified U-Net with deep supervision in the upsampling path and a reduced number of filters after each upsampling to match the label count; each sequence is fed as a separate single-channel input so one set of weights learns across modalities. These components together let the model exploit multi-sequence information and enlarged training sets without any registration step.
What would settle it
Measure, on the same patients, the contour displacement between synthetic LGE images and their real LGE counterparts at end-diastole; if the mean displacement approaches or exceeds the LGE slice thickness (5 mm), or if a model trained only on synthetic LGE fails to beat a model trained only on real LGE on a common held-out test set, the claim that synthetic LGE provides valid boundary information is refuted.
Extended reading notes
Core claim
The central claim is that LGE-MRI segmentation accuracy is improved by complementary information from non-contrast MRI sequences, provided through a single network that consumes each sequence as one input channel and does not require inter-sequence registration. The paper's best model—trained on all three sequences (LGE, bSSFP, T2), with synthetic LGE images generated by CycleGAN from bSSFP, and with shape-guided rotations of the myocardium that move scar locations around the wall—achieves average Dice scores of 0.898 (LV), 0.810 (MYO), and 0.866 (RV) on the 40-case challenge test set. In the authors' comparison, this is on par with a recent deep learning method trained on 25 labeled LGE volumes, five times more than the five used here. The authors also report that a model trained on synthetic LGE alone (Dice 0.809 for LV on the five labeled LGE volumes) far exceeds a model trained on bSSFP alone (0.503), which they take as evidence that the synthesized images carry useful information for LGE segmentation.
Load-bearing premise
The load-bearing premise is that the CycleGAN-generated synthetic LGE images keep the cardiac boundaries in the same place as the bSSFP images they were made from, so the bSSFP ground-truth contours are valid supervision for LGE segmentation; the paper supports this with qualitative examples and an indirect segmentation test rather than a direct measurement of boundary fidelity.
Editorial extensions
If this is right
- A segmentation network trained on all three sequences plus synthetic LGE and scar-rotation augmentation outperforms, on the challenge validation set, every other configuration tested, including models trained on real LGE alone or on real multi-sequence data without synthesis.
- With only five labeled LGE volumes, the method attains Dice scores similar to a recent deep learning LGE segmentation system trained on 25 labeled volumes, suggesting that synthesis and augmentation can substitute for a substantial amount of manual annotation.
- Synthetic LGE images generated from bSSFP carry enough boundary information that a model trained on them alone segments the five labeled LGE volumes with a LV Dice of 0.809, well above the 0.503 obtained by training on the original bSSFP images.
- Because the proposed pipeline does not register the sequences, it can be applied to multi-sequence cardiac data with differently aligned slices and consistently different boundary shapes.
- Rotating the myocardial wall and scar within the LGE images reduces the risk of overfitting to a small number of scar locations, and in the qualitative examples it corrects segmentation errors that remain after adding synthetic images alone.
Reading between the lines
- If synthetic LGE inherits bSSFP geometry, the same unpaired-translation recipe could extend to other contrast-enhanced modalities with scarce labels, such as delayed-enhancement CT, whenever a non-contrast sequence from the same anatomy is available.
- The authors leave open whether the gain comes from faithful transfer of boundaries or from extra texture variation; a quantitative synthetic-to-real contour displacement measurement would settle which mechanism is doing the work.
- A direct comparison of the rigid scar rotation used here against the proposed elastic deformations would test whether scar-location diversity, rather than global shape change, is the active ingredient of the augmentation gain.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a deep-learning pipeline for segmenting the left ventricle, myocardium, and right ventricle in late gadolinium enhancement cardiac MRI (LGE-MRI), trained with only five labeled LGE volumes. To compensate for the small labeled dataset, the method augments the LGE training set in two ways: shape-guided rotations of the myocardium and LV to relocate scar tissue, and CycleGAN-based translation from bSSFP cine images into synthetic LGE images. A modified U-Net is then trained on eight configurations that combine real LGE, bSSFP, T2, synthetic LGE, and the scar-rotation augmentation. The authors select configuration 8 (all sequences plus synthetic LGE and rotations) based on validation performance and report its results on the 40-patient MS-CMRSeg test set, with average Dice scores of 0.898 (LV), 0.810 (MYO), and 0.866 (RV). The paper claims that multi-sequence training with synthetic images and augmentation improves LGE segmentation over conventional training with real LGE data only.
Significance. If the central claim holds, the paper would offer a practically valuable solution to the scarcity of annotated LGE-MRI data: it would show that non-contrast sequences and synthetic examples can substitute for large numbers of real LGE annotations. The use of an external challenge test set for the final model is a strength, as are the reported standard deviations and the comparison with a prior method trained on five times more LGE data. The work is also reproducible in style, as it identifies the public CycleGAN implementation and reports training details. However, the improvement claim is not currently established on unseen data, because test-set metrics are reported only for the selected configuration and the intermediate comparisons are evaluated on training volumes. The practical value therefore depends on additional experiments that the paper itself acknowledges are still needed.
major comments (3)
- [Section 3, Table 3] The central claim that configuration 8 improves over conventional training is not supported by unseen-data evidence. Test-set Dice are reported only for the selected model (Table 3), and no test-set results are given for configurations 1, 2, 3, or 4, so the reader cannot verify the claimed improvement on the 40-patient test set. The only quantitative comparison between models trained with and without synthetic images (Table 2) is performed on the five labeled LGE volumes, which are part of the training data, not an independent test set. The paper's own conclusion in Section 4 states that 'extensive validation will be performed to assess in detail the relative importance of the different steps,' which confirms that the relative contribution of each component is not established in this manuscript. I would ask the authors to report test-set metrics for all eight configurations, or, if the challenge organizers cannot supply per-configuration test results, to provide a multi-fold cross-validation on the five labeled LGE patients and clearly separate training, validation, and test folds.
- [Section 2.3, Section 3] The model selection among the eight training configurations is based on a validation set consisting of 20% of the five labeled LGE volumes, i.e., a single patient. Ranking eight configurations on one volume cannot reliably distinguish genuine improvements from noise, especially when the selection considers three Dice metrics simultaneously. The reported gains from synthetic images and scar-rotation augmentation may therefore reflect overfitting to that single validation volume rather than a generalizable effect. Please provide either a leave-one-patient-out cross-validation over the five labeled LGE volumes or, preferably, test-set results for all eight configurations so that the selection is not made on a single patient.
- [Section 2.2, Table 2] The synthetic LGE images are evaluated only qualitatively (Figure 2) and indirectly through a segmentation experiment on the five labeled LGE volumes (Table 2). The paper assumes that the bSSFP ground-truth contours are valid supervision for the synthetic LGE images, but the anatomical fidelity of the synthetic images is not quantitatively verified. The reported Dice scores for the model trained with synthetic LGE (0.809 LV, 0.688 MYO, 0.820 RV) are not compared against an upper bound or against a model trained with real LGE images on a held-out set, so they do not establish that the synthetic images preserve cardiac boundaries well enough for LGE segmentation. Please add a quantitative measure of boundary fidelity (for example, boundary displacement between synthetic LGE and real LGE in matched slices, or a manual quality rating) and evaluate the synthetic-LGE ablation on unseen LGE data.
minor comments (5)
- [Section 2.2] The CycleGAN training description would benefit from specifying the image size, normalization, and preprocessing used for the generators, since these details affect the quality of the synthetic LGE images.
- [Figure 4] The columns in Figure 4 are not labeled with the corresponding configuration numbers (3, 7, 8); adding explicit labels or extending the caption would make the qualitative comparison easier to follow.
- [Section 2.2] Please clarify whether the scar-rotation augmentation is applied only to real LGE images or also to synthetic LGE images, since configuration 4 and configuration 8 differ in exactly which images receive the rotations.
- [Section 2.3] The sentence describing the reduction of filters after upsampling is a little ambiguous; it would be clearer to state that the number of filters in the final upsampling block is reduced to match the number of segmentation labels, as in the cited reference [16].
- [Section 3] The comparison with the results of Yue et al. [3] is informal; please indicate whether the Dice scores quoted for that method come from the same MS-CMRSeg test set and whether any statistical significance testing was performed.
Circularity Check
No significant circularity: the paper is an empirical multi-sequence segmentation pipeline with independent test evaluation, and no load-bearing claim reduces to its inputs by construction.
full rationale
The derivation chain in this paper is empirical rather than analytical. The central claim is that training a U-Net on multi-sequence inputs plus CycleGAN-synthesized LGE images and rotated scar augmentation improves LGE-MRI segmentation. The synthesized LGE images are generated from bSSFP inputs using an external CycleGAN implementation, and the segmentation model is then evaluated on an independently scored 40-patient MS-CMRSeg test set. The test Dice scores in Table 3 are not fitted constants and do not reduce by definition to any training input. Table 2 does compare models trained on bSSFP versus synthetic LGE using the five labeled LGE volumes, and these volumes overlap with the training/validation pool, which is a methodological limitation rather than circularity: the comparison is an internal experiment, not a prediction that is forced by construction. Configurations 1-8 are ranked on the validation set and only configuration 8 is reported on the test set; this is standard model selection practice, and the test set remains unseen during that selection. The paper's own conclusion that 'extensive validation will be performed to assess in detail the relative importance of the different steps' is a stated limitation, not evidence that the reported improvement is defined into existence. There are no self-citation chains invoked to justify the method's premises, no fitted parameter renamed as a prediction, and no uniqueness theorem imported from the authors' prior work. Therefore the appropriate finding is no significant circularity, with score 0.
Assumptions & free parameters
free parameters (3)
- Number of scar-location rotations =
20
- Rotation step size =
7.2 degrees
- Number of landmarks for epicardium/endocardium =
50
assumptions (3)
- domain assumption The provided ground-truth segmentations for bSSFP, T2, and the five labeled LGE volumes are accurate.
- domain assumption The CycleGAN-generated synthetic LGE images preserve the cardiac boundaries from the source bSSFP images.
- domain assumption All sequences were acquired at end-diastole and are sufficiently aligned for cross-sequence learning.
Cite this review
Pith. "Pith review of Combining Multi-Sequence and Synthetic Images for Improved Segmentation of Late Gadolinium Enhancement Cardiac MRI." pith.science (2026). https://pith.science/paper/L3V2DIDD
@misc{pith2026190901182,
author = {Pith},
title = {Pith review of: Combining Multi-Sequence and Synthetic Images for Improved Segmentation of Late Gadolinium Enhancement Cardiac MRI},
year = {2026},
howpublished = {\url{https://pith.science/paper/L3V2DIDD}},
note = {Machine review of arXiv:1909.01182}
}
read the original abstract
Accurate segmentation of the cardiac boundaries in late gadolinium enhancement magnetic resonance images (LGE-MRI) is a fundamental step for accurate quantification of scar tissue. However, while there are many solutions for automatic cardiac segmentation of cine images, the presence of scar tissue can make the correct delineation of the myocardium in LGE-MRI challenging even for human experts. As part of the Multi-Sequence Cardiac MR Segmentation Challenge, we propose a solution for LGE-MRI segmentation based on two components. First, a generative adversarial network is trained for the task of modality-to-modality translation between cine and LGE-MRI sequences to obtain extra synthetic images for both modalities. Second, a deep learning model is trained for segmentation with different combinations of original, augmented and synthetic sequences. Our results based on three magnetic resonance sequences (LGE, bSSFP and T2) from 45 different patients show that the multi-sequence model training integrating synthetic images and data augmentation improves in the segmentation over conventional training with real datasets. In conclusion, the accuracy of the segmentation of LGE-MRI images can be improved by using complementary information provided by non-contrast MRI sequences.
Figures
Figures from the paper (1 more)
Reference graph
Works this paper leans on
-
[1]
Magnetic resonance in medicine 72(6), 1775–1784 (2014)
Alba, X., Figueras i Ventura, R.M., Lekadir, K., Tobon-Gomez, C., Hoogendoorn, C., Frangi, A.F.: Automatic cardiac LV segmentation in MRI using modified graph cuts with smoothness and interslice constraints. Magnetic resonance in medicine 72(6), 1775–1784 (2014)
work page 2014
-
[2]
Com- puterized Medical Imaging and Graphics 59, 13–27 (2017)
Kurzendorfer, T., Forman, C., Schmidt, M., Tillmanns, C., Maier, A., Brost, A.: Fully automatic segmentation of left ventricular anatomy in 3-D LGE-MRI. Com- puterized Medical Imaging and Graphics 59, 13–27 (2017)
work page 2017
-
[3]
Cardiac Segmentation from LGE MRI Using Deep Neural Network Incorporating Shape and Spatial Priors
Yue, Q., Luo, X., Ye, Q., Xu, L., Zhuang, X.: Cardiac segmentation from LGE MRI using deep neural network incorporating shape and spatial priors. arXiv preprint arXiv:1906.07347 (2019)
work page Pith review arXiv 2019
-
[4]
In: International Conference on Medical Image Computing and Computer-Assisted Intervention
Wei, D., Sun, Y., Chai, P., Low, A., Ong, S.H.: Myocardial segmentation of late gadolinium enhanced MR images by propagation of contours from cine MR images. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 428–435. Springer (2011)
work page 2011
-
[5]
Journal of Magnetic Resonance Imaging 42(2), 390–399 (2015)
Tao, Q., Piers, S.R., Lamb, H.J., van der Geest, R.J.: Automated left ventricle segmentation in late gadolinium-enhanced MRI for objective myocardial scar as- sessment. Journal of Magnetic Resonance Imaging 42(2), 390–399 (2015)
work page 2015
-
[6]
IEEE transactions on pattern analysis and machine intelli- gence (2018)
Zhuang, X.: Multivariate mixture model for myocardial segmentation combining multi-source images. IEEE transactions on pattern analysis and machine intelli- gence (2018)
work page 2018
-
[7]
In: Pro- ceedings of the IEEE Conference on Computer Vision and Pattern Recognition
Zhang, Z., Yang, L., Zheng, Y.: Translating and segmenting multimodal medical volumes with cycle-and shape-consistency generative adversarial network. In: Pro- ceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 9242–9251 (2018)
2018
-
[8]
Medical image analysis 52, 174–184 (2019)
Cai, J., Zhang, Z., Cui, L., Zheng, Y., Yang, L.: Towards cross-modal organ trans- lation and segmentation: A cycle-and shape-consistent generative adversarial net- work. Medical image analysis 52, 174–184 (2019)
work page 2019
Show all 16 references
-
[9]
arXiv preprint arXiv:1901.08211 (2019)
Chen, C., Dou, Q., Chen, H., Qin, J., Heng, P.A.: Synergistic image and feature adaptation: Towards cross-modality domain adaptation for medical image segmen- tation. arXiv preprint arXiv:1901.08211 (2019)
2019 arXiv
-
[10]
IEEE transactions on medical imaging 38(4), 1016–1025 (2018)
Huo, Y., Xu, Z., Moon, H., Bao, S., Assad, A., Moyo, T.K., Savona, M.R., Abram- son, R.G., Landman, B.A.: Synseg-net: Synthetic segmentation without target modality ground truth. IEEE transactions on medical imaging 38(4), 1016–1025 (2018)
2018
-
[11]
In: International Conference on Medical Image Computing and Computer-Assisted Intervention
Zhang, Y., Miao, S., Mansi, T., Liao, R.: Task driven generative modeling for unsupervised domain adaptation: Application to x-ray image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 599–607. Springer (2018)
2018
-
[12]
IEEE transactions on medical imaging 38(1), 46–56 (2018)
Zhao, H., Li, H., Maurer-Stroh, S., Guo, Y., Deng, Q., Cheng, L.: Supervised seg- mentation of un-annotated retinal fundus images by synthesis. IEEE transactions on medical imaging 38(1), 46–56 (2018)
2018
-
[13]
In: Proceedings of the IEEE interna- tional conference on computer vision
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE interna- tional conference on computer vision. pp. 2223–2232 (2017) 10 V. M. Campello et al
2017
-
[14]
In: International Conference on Medical image computing and computer-assisted intervention
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedi- cal image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. pp. 234–241. Springer (2015)
2015
-
[15]
In: International workshop on statistical atlases and computational models of the heart
Isensee, F., Jaeger, P.F., Full, P.M., Wolf, I., Engelhardt, S., Maier-Hein, K.H.: Automatic cardiac disease assessment on cine-MRI via time-series segmentation and domain specific features. In: International workshop on statistical atlases and computational models of the heart...
2017
-
[16]
In: Inter- national Workshop on Statistical Atlases and Computational Models of the Heart
Baumgartner, C.F., Koch, L.M., Pollefeys, M., Konukoglu, E.: An exploration of 2D and 3D deep learning techniques for cardiac MR image segmentation. In: Inter- national Workshop on Statistical Atlases and Computational Models of the Heart. pp. 111–119. Springer (2017)
2017
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.