REVIEW 4 major objections 5 minor 21 references
Direct vascular territory segmentation on cerebral digital subtraction angiography
T0 review · 4 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read A trained network maps brain territories invisible on DSA scans
desk verdict The core direction is likely right — a nnUNet can segment ICA/MCA territories on DSA and beat atlas registration — but the reference labels inherit the atlas's provenance, so the absolute accuracy claims are over-stated and the headline numbers need reconciling. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the nnUNet, a self-configuring U-Net architecture adapted to the data, operating on 2D minimal-intensity projections built from each DSA sequence. The training labels come from atlas-registered territory masks that were manually adjusted for size, rotation, and scaling; the ICA mask is reconstructed as the union of the anterior cerebral artery (ACA) and MCA labels. Morphological erosion, connected-component analysis, and dilation clean the predicted masks before evaluation.
What would settle it
Segment the same DSA images with reference labels derived from co-registered CT angiography rather than from a 2D atlas, and compare the model's Dice and surface distance against both label sources; if the advantage over atlas registration shrinks or vanishes against the CTA-based labels, the claimed superiority is an artifact of label bias.
Extended reading notes
Core claim
The central claim is that an nnUNet trained on minimal-intensity projections of cerebral DSA, with labels that are manually adjusted versions of atlas-based segmentations, can predict the internal carotid artery (ICA) and middle cerebral artery (MCA) territories directly from the image. Compared with a conventional atlas registration method, the segmentation model achieved higher Dice similarity (0.96 vs 0.82 for the ICA territory), lower average surface distance, and a higher qualitative success rate (85% versus 66% on the external test set), while running in about 4 seconds instead of 141 seconds. The model relies most on the capillary phase of contrast passage; non-contrast frames produce substantially worse segmentations.
Load-bearing premise
The reference standard is assumed to be true vascular territory, but it comes from manually adjusted atlas projections, so if the atlas inherited a systematic bias, every comparison metric inherits it too.
Editorial extensions
If this is right
- Replacing atlas registration in the existing reperfusion-scoring pipeline would raise the overall per-patient success rate from 66% to about 80% while cutting runtime from more than two minutes to under ten seconds.
- Because the model reads all phases but performs best on capillary-phase frames, future versions could select the capillary phase when available or be trained phase-specifically to improve robustness in ICA occlusions.
- The same direct-segmentation approach could be extended to other territories with unclear borders, such as the posterior cerebral artery or functional regions like Broca's and Wernicke's areas, and to other X-ray-guided interventions.
- Pre-EVT images, especially with proximal ICA occlusions, remain harder than post-EVT images, so larger, more balanced training sets would be needed before relying on the model in the most occluded cases.
Reading between the lines
- The measured margin over atlas registration may partly reflect the model learning the human editors' corrections of the same atlas labels, so a comparison against labels from an independent modality would be needed to gauge the true anatomical accuracy.
- The model's strong dependence on the capillary phase suggests it is reading contrast fill of the parenchyma rather than bone or vessel silhouettes, which is consistent with learning a proxy for perfusion territory.
- A testable extension would be to feed the model phase-selected capillary minimal-intensity projections only, which the phase-dependency results predict should improve segmentation quality in pre-EVT ICA-occlusion cases.
- If the approach transfers to other anatomical structures, it would offer a general route to soft-tissue visualization during X-ray-guided procedures, where such anatomy is otherwise invisible.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This manuscript reports a deep learning approach, based on nnUNet, to segment internal carotid artery (ICA) and middle cerebral artery (MCA) vascular territories directly from 2D minimal intensity projection (MinIP) cerebral DSA images acquired during endovascular thrombectomy. The model was trained on 1,224 acquisitions from 361 patients whose reference labels were autoTICI atlas segmentations manually adjusted for size, rotation, and scaling. The authors compare the model with an atlas registration baseline (autoTICI) using Dice similarity coefficient, Jaccard index, average surface distance, and Hausdorff distance, and also report a qualitative Likert-scale success-rate comparison on a held-out cohort. The paper reports significantly better metric values for the deep learning model, a higher qualitative success rate, and much lower computational time, and it concludes that direct segmentation can replace atlas registration for vascular territory visualization in DSA.
Significance. If the reported results hold, the paper would offer a practically useful and much faster alternative to atlas-based vascular territory mapping in DSA, with potential value for the autoTICI reperfusion scoring pipeline and for broader visualization during X-ray-guided procedures. The study has several strengths: patient-level stratified splits, a multicenter registry cohort, use of a strong segmentation baseline (nnUNet), public code, and an external qualitative assessment by two raters. The claimed computational speedup (seconds versus over two minutes) is clinically relevant. However, the central comparison is weakened by the shared provenance of the reference labels and the atlas baseline: the labels are manually corrected autoTICI atlas masks and the comparator is the automatic autoTICI atlas registration. This does not invalidate the practical claim that the learned model could replace atlas registration inside the autoTICI pipeline, but it limits the strength of the anatomical-accuracy claim.
major comments (4)
- [Methods, Section 2; Discussion, Section 4] The reference standard labels are human-adjusted masks derived from the autoTICI atlas, and the comparator is the automatic autoTICI atlas registration. This shared provenance means the reported DSC, ASD, and success-rate advantages may partly measure the model's ability to mimic human corrections to the same atlas prior, rather than recovery of independently established vascular anatomy. The Discussion acknowledges this possibility, but the manuscript's central claim of 'accurate segmentations' of true vascular territories rests on the reference standard. Please provide a sensitivity analysis on a subset with an independent reference, for example territories delineated on CTA and co-registered to DSA, or at least re-annotate a random sample with a protocol that does not start from the atlas. Without such evidence, the conclusions should be explicitly limited to 'superior to atlas registration within the autoTICI framework'.
- [Abstract; Results, Section 3.2; Table 1] Several numbers reported in the abstract and body are mutually inconsistent. The abstract states a success rate of 85% for the segmentation model, whereas the per-patient success rate reported in Section 3.2 is 80%; the abstract reports ICA ASD of 13.8 versus 47.3, while Table 1 gives medians of 14 and 47; and Table 1 reports the atlas ICA DSC as 0.82 [0.62-0.80], which is impossible because the upper IQR bound is below the median. Please correct these inconsistencies and state unambiguously which values are means, medians, per-view, or per-patient.
- [Methods, Section 3.2; Abstract] The term 'external test set' in the abstract is misleading. The qualitative comparison was performed on 564 out of 660 patients from a previous study in the same MR CLEAN Registry, excluding patients who overlapped with training or test sets. This is an external cohort in the sense of not being used for training, but it is not an independent acquisition protocol or institution. Please reword to 'held-out cohort' or 'external to training' and clarify the relationship to the registry.
- [Results, Section 3.2 (success rate comparison)] The qualitative Likert assessment is central to the success-rate claim, but the methods do not state whether the two raters were blinded to the method producing each segmentation, nor is inter-rater agreement (e.g., Cohen's kappa) reported. If the raters were aware of which output came from the atlas versus the deep learning model, bias in scoring is possible. Please provide blinding details and inter-rater reliability.
minor comments (5)
- [Results, Section 3.2 (Model performance)] There is a typo in the text: 'significantly better DCS' should read 'DSC'.
- [Methods, Section 2 (Model training)] The phrase 'non-statistical significant different performance' should be reworded, for example to 'no statistically significant difference in performance'.
- [Discussion, Section 4] The sentence 'if very few or no vessels are depicted, the might be little use for specific vessel territory assessment' contains a grammatical error ('the might be') and should be revised.
- [Table 2] The symbols and asterisks in Table 2 are not fully explained: only some phase-specific comparisons are marked with '***', but the text does not state what the significance markers refer to (presumably comparison with the arterial or non-contrast phase). Please clarify in the table caption or text.
- [General / References] Reference 6 is listed as an arXiv preprint although the journal version of the nnU-Net paper is already cited as reference 5; please check whether both are necessary and cite the peer-reviewed version consistently.
Circularity Check
Reference labels are human-adjusted autoTICI atlas masks, so the model's DSC/ASD advantage over the same atlas pipeline is partly built into the label construction; human Likert scoring provides some independent support.
-
fitted input called prediction
[Section 2 Methods, Model; Section 3.1 Data; Section 4 Discussion, Limitations]
"This model was trained using manually segmented vessel territories for the internal carotid artery (ICA) and middle cerebral artery (MCA), derived from autoTICI atlases for pre- and post-EVT DSA MinIPs[16]. The atlases were manually adjusted for size, rotation, and scaling. ... First, the manual annotation of reference standards could have introduced bias, particularly given the difficulty in visually delineating borders due to over-projection. As such, the results may not entirely reflect the true vascular territories."
The reference labels used for training and evaluation are manually adjusted autoTICI atlas masks, while the baseline comparator is the same autoTICI atlas registration pipeline without these manual adjustments. The reported DSC/ASD superiority of the segmentation model is therefore measured against a target that is constructed from the very atlas method it is compared with. The model can learn to imitate the human corrections applied to the atlas, whereas the atlas baseline receives no such correction, so the advantage partly reduces to fitting the evaluation standard rather than recovering independently established anatomy.
full rationale
The paper's central comparison is a supervised segmentation model versus the autoTICI atlas registration method. The model's training labels are 'derived from autoTICI atlases' and 'manually adjusted for size, rotation, and scaling', so the ground truth and the baseline share provenance. This makes the quantitative DSC/ASD comparison partially circular: the model is optimized to reproduce human-edited atlas masks while the atlas baseline is not, so the measured gap partly reflects imitation of manual corrections rather than independent anatomical truth. However, the qualitative success-rate comparison ('80% vs 66%, p < 0.001') is based on independent human Likert scoring of anatomical correctness against the raters' expectations, not on the atlas-derived masks, which gives the central claim some independent content. The paper also honestly acknowledges the reference-standard bias in the Discussion. There are no load-bearing self-citation chains, uniqueness theorems, or ansatz-smuggling steps; the autoTICI citations identify the baseline and label source but do not by themselves force the result. Additional numerical inconsistencies (e.g., abstract 85% vs body per-patient 80% success rate, abstract ASD 13.8 vs Table 1 ASD 14, and an impossible atlas ICA DSC median of 0.82 with IQR [0.62-0.80]) are reporting or correctness concerns, not circularity. Overall, the quantitative head-to-head comparison is partially circular, but the human-rated success outcome and the acknowledged limitation keep the paper from being fully self-referential, so a moderate score of 4 is appropriate.
Assumptions & free parameters
assumptions (4)
- domain assumption Expert manual adjustment of autoTICI atlas masks yields valid reference standard vascular territories.
- domain assumption Post-EVT DSA after successful reperfusion makes the occluded vascular territory visible enough to annotate accurately.
- domain assumption MinIP projections preserve enough spatial information to localize vascular territories from 2D DSA.
- domain assumption Normal atlas territory definitions, after manual scaling and rotation, approximate the vascular territories of stroke patients with proximal occlusions.
Cite this review
Pith. "Pith review of Direct vascular territory segmentation on cerebral digital subtraction angiography." pith.science (2026). https://pith.science/paper/QM2VT7W4
@misc{pith2026250813821,
author = {Pith},
title = {Pith review of: Direct vascular territory segmentation on cerebral digital subtraction angiography},
year = {2026},
howpublished = {\url{https://pith.science/paper/QM2VT7W4}},
note = {Machine review of arXiv:2508.13821}
}
read the original abstract
X-ray digital subtraction angiography (DSA) is frequently used when evaluating minimally invasive medical interventions. DSA predominantly visualizes vessels, and soft tissue anatomy is less visible or invisible in DSA. Visualization of cerebral anatomy could aid physicians during treatment. This study aimed to develop and evaluate a deep learning model to predict vascular territories that are not explicitly visible in DSA imaging acquired during ischemic stroke treatment. We trained an nnUNet model with manually segmented intracranial carotid artery and middle cerebral artery vessel territories on minimal intensity projection DSA acquired during ischemic stroke treatment. We compared the model to a traditional atlas registration model using the Dice similarity coefficient (DSC) and average surface distance (ASD). Additionally, we qualitatively assessed the success rate in both models using an external test. The segmentation model was trained on 1224 acquisitions from 361 patients with ischemic stroke. The segmentation model had a significantly higher DSC (0.96 vs 0.82, p<0.001) and lower ASD compared to the atlas model (13.8 vs 47.3, p<0.001). The success rate of the segmentation model (85%) was higher compared to the atlas registration model (66%) in the external test set. A deep learning method for the segmentation of vascular territories without explicit borders on cerebral DSA demonstrated superior accuracy and quality compared to the traditional atlas-based method. This approach has the potential to be applied to other anatomical structures for enhanced visualization during X-ray guided medical procedures. The code is publicly available at https://github.com/RuishengSu/autoTICI.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
Neuroimage 46(3), 726–738 (2009) 10 P.M
Aljabar, P., Heckemann, R.A., Hammers, A., Hajnal, J.V., Rueckert, D.: Multi- atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46(3), 726–738 (2009) 10 P.M. van der Sluijs et al
work page 2009
-
[2]
Handbook of Biomedical Imaging: Methodologies and Clinical Research pp
Bach Cuadra, M., Duay, V., Thiran, J.P.: Atlas-based segmentation. Handbook of Biomedical Imaging: Methodologies and Clinical Research pp. 221–244 (2015)
2015
-
[3]
Brust, J., Shafer, S.Q., Richter, R.W., Bruun, B.: Aphasia in acute stroke. Stroke 7(2), 167–174 (1976)
work page 1976
-
[4]
Informatik 2009–Im Focus das Leben (2009)
Heckel, F., Schwier, M., Peitgen, H.O.: Object-oriented application development with mevislab and python. Informatik 2009–Im Focus das Leben (2009)
work page 2009
-
[5]
Nature methods 18(2), 203–211 (2021)
Isensee, F., Jaeger, P.F., Kohl, S.A., Petersen, J., Maier-Hein, K.H.: nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nature methods 18(2), 203–211 (2021)
2021
-
[6]
arXiv preprint arXiv:1904.08128 (2019)
Isensee, F., Jäger, P.F., Kohl, S.A., Petersen, J., Maier-Hein, K.H.: Automated design of deep learning methods for biomedical image segmentation. arXiv preprint arXiv:1904.08128 (2019)
arXiv 2019
-
[7]
Journal of NeuroInterventional Surgery12(10), 1023–1027 (2020)
Jin, H., Geng, J., Yin, Y., Hu, M., Yang, G., Xiang, S., Zhai, X., Ji, Z., Fan, X., Hu, P., et al.: Fully automated intracranial aneurysm detection and segmentation from digital subtraction angiography series using an end-to-end spatiotemporal deep neural network. Journal of NeuroInterventional Surgery12(10), 1023–1027 (2020)
work page 2020
-
[8]
Liu, W., Tian, T., Wang, L., Xu, W., Li, L., Li, H., Zhao, W., Tian, S., Pan, X., Deng,Y.,etal.:Dias:adatasetandbenchmarkforintracranialarterysegmentation in dsa sequences. Medical Image Analysis p. 103247 (2024)
work page 2024
Show all 21 references
-
[9]
Neurocomputing 373, 123–134 (2020)
Meng, C., Sun, K., Guan, S., Wang, Q., Zong, R., Liu, L.: Multiscale dense con- volutional neural network for dsa cerebrovascular segmentation. Neurocomputing 373, 123–134 (2020)
2020
-
[10]
Proc VISIGRAPP (2018)
Neumann, C., Tönnies, K.D., Pohle-Fröhlich, R.A.: a convolutional neural network for vessel segmentation in cerebral dsa series. Proc VISIGRAPP (2018)
2018
-
[11]
In: Medical Imaging 2020: Computer-Aided Diagnosis
Patel, T.R., Paliwal, N., Jaiswal, P., Waqas, M., Mokin, M., Siddiqui, A.H., Meng, H., Rai, R., Tutino, V.: Multi-resolution cnn for brain vessel segmenta- tion from cerebrovascular images of intracranial aneurysm: a comparison of u-net and deepmedic. In: Medical Imaging 2020:...
2020
-
[12]
Neurosur- gical Focus 54(6), E13 (2023)
Patel, T.R., Patel, A., Veeturi, S.S., Shah, M., Waqas, M., Monteiro, A., Baig, A.A., Pinter, N., Levy, E.I., Siddiqui, A.H., et al.: Evaluating a 3d deep learning pipeline for cerebral vessel and intracranial aneurysm segmentation from computed tomography angiography–digital ...
2023
-
[13]
European radiology experimental8, 136 (12 2024)
Reder, S., Kronfeld, A., Gröschel, S., Civelek, A., Gröschel, K., Brockmann, M., Uphaus, T., Hahn, M., Brockmann, C., Othman, A.: Dsa-based perfusion parame- ters versus tici score after mechanical thrombectomy in acute ischaemic stroke pa- tients: a congruence analysis. Europ...
2024 doi
-
[14]
van der Sluijs, P.M., Su, R., Cornelissen, S., van Es, A.C.G.M., Lycklama à Ni- jeholt, G.J., van Doormaal, P.J., van Zwam, W.H., Dippel, D.W.J., van Walsum, T., van der Lugt, A., investigators, M.C.R.: Assessment of automated tici scoring during endovascular treatment in pati...
2024
-
[15]
Journal of NeuroInterventional Surgery (2024).https://doi.org/ 10.1136/jnis-2024-022428 Direct vascular territory segmentation on cerebral DSA 11
Song, Z., Fang, X., Jia, X., Liu, R., Yang, D., Liao, A., Kasaer, F., Xu, Y., Zhang, Z., Zhu, W., Huang, K., Liu, X.: Combined collaterals and hemodynamic features to predict the prognosis in acute ischemic stroke patients undergoing mechanical thrombectomy. Journal of NeuroIn...
2024 doi
-
[16]
IEEE transactions on medical imaging40(9), 2380–2391 (2021)
Su, R., Cornelissen, S.A., Van der Sluijs, M., Van Es, A.C., Van Zwam, W.H., Dippel, D.W., Lycklama, G., van Doormaal, P.J., Niessen, W.J., van der Lugt, A., et al.: autotici: automatic brain tissue reperfusion scoring on 2d dsa images of acute ischemic stroke patients. IEEE t...
2021
-
[17]
Computer- ized Medical Imaging and Graphics115, 102392 (2024)
Su, R., van der Sluijs, P.M., Chen, Y., Cornelissen, S., van den Broek, R., van Zwam, W.H., van der Lugt, A., Niessen, W.J., Ruijters, D., van Walsum, T.: Cave: Cerebral artery–vein segmentation in digital subtraction angiography. Computer- ized Medical Imaging and Graphics115...
2024
-
[18]
Neuroradiology pp
Tolhuisen, M.L., Ernst, M., Boers, A.M., Brown, S., Beenen, L.F., Guillemin, F., Roos, Y.B., Saver, J.L., van Oostenbrugge, R., Demchuck, A.M., et al.: Value of infarct location in the prediction of functional outcome in patients with an anterior large vessel occlusion: result...
2022
-
[19]
In: Proceedings of the IEEE/CVF Winter Conference on applications of computer vision
Vepa, A., Choi, A., Nakhaei, N., Lee, W., Stier, N., Vu, A., Jenkins, G., Yang, X., Shergill, M., Desphy, M., et al.: Weakly-supervised convolutional neural networks for vessel segmentation in cerebral angiography. In: Proceedings of the IEEE/CVF Winter Conference on applicati...
2022
-
[20]
NeuroImage 34(4), 1612–1618 (2007)
Wu, M., Rosano, C., Lopez-Garcia, P., Carter, C.S., Aizenstein, H.J.: Optimum template selection for atlas-based segmentation. NeuroImage 34(4), 1612–1618 (2007)
2007
-
[21]
Computer methods and programs in biomedicine185, 105159 (2020) 12 P.M
Zhang, M., Zhang, C., Wu, X., Cao, X., Young, G.S., Chen, H., Xu, X.: A neural network approach to segment brain blood vessels in digital subtraction angiogra- phy. Computer methods and programs in biomedicine185, 105159 (2020) 12 P.M. van der Sluijs et al. Appendix A Fig.4: V...
2020
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.