{"id":"52bc682e-24fb-43d0-9a95-02ab13378647","arxiv_id":"2411.16637","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":2,"one_line_summary":"A registration pipeline maps a 3D brain vascular territory atlas onto 2D DSA images with median SSIM 0.81, but validation is self-referential and no quantitative angiography was performed.","lead":"This paper describes a pipeline that overlays a 3D map of brain blood-supply territories onto 2D X-ray angiograms, so doctors can see which arterial region is being imaged during aneurysm treatment. The authors report a median overlay similarity of 0.81 across 2,247 images, but the quality score is measured against the same data used to fit the overlay and no clinical validation is included.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The headline SSIM is computed against the same processed-DSA mask used as the registration target, and no affine-only comparison is shown, so 'deformable registration was essential' and 'precise overlays' are not independently established.","rationale":"The reader identifies the processed DSA mask as ground truth and the weakest assumption; I agree that this is the core weakness, but I would sharpen it: the metric is not merely a flawed independent ground truth, it is the registration target itself, so the reported SSIM conflates optimization success with clinical accuracy. I also add a second, more specific gap: the paper's key causal claim that deformable registration was essential is never quantitatively supported by an affine-only comparison. Because the paper explicitly states that quantitative angiography analysis was not performed, the title's central promise is not delivered in this manuscript. None of this suggests fraud; the pipeline is plausible, uses standard SimpleITK/ASTRA tools, and the authors are transparent about the missing quantitative analysis. However, as a feasibility report, the current evidence supports at most a conditional acceptance pending an independent accuracy assessment (e.g., manual expert delineations or synthetic phantom deformations) and a reported affine-vs-B-spline comparison. I therefore keep the reader's CONDITIONAL verdict.","tokens_in":4515,"tokens_out":6272,"duration_ms":64094,"concrete_test":"Take a stratified sample of 50 DSAs (25 AP, 25 lateral). Have two interventional neuroradiologists independently delineate the perfused territory boundary on a mid-arterial DSA frame. Run the pipeline with affine-only and with B-spline, and compute Dice between the projected atlas territory and the manual delineations. If B-spline Dice is not clearly above affine Dice, or if absolute B-spline Dice is low (<~0.7), the claims of precise overlay and of deformable registration being essential are unsupported; this also bypasses the self-referential mask-based SSIM.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central quantitative claim is the reported SSIM distribution (0.69 ± 0.27; median 0.81) in §3. That metric is described in Methods as being computed 'with reference to the processed DSA data' — the same temporally averaged, thresholded, morphologically cleaned mask that the affine and B-spline registrations were aligned to. SSIM is therefore a measure of how well the deformed atlas matches the registration target itself, not of anatomical accuracy; it cannot distinguish a correct overlay from an optimizer that has overfit the mask. The paper also asserts that 'affine transformations alone were insufficient' and that 'deformable registration was essential,' but §3 reports no affine-only SSIM results or any quantitative comparison, so 'essential' is not demonstrated even relative to the self-referential metric. Finally, §4 concedes 'quantitative analysis was not included in this study,' so the title's 'Targeted Quantitative Angiography Analysis' remains future work.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper proposes an automated pipeline for registering a 3D neurovascular territory atlas (Brain Arterial Vascular Model) to 2D digital subtraction angiography (DSA) images, with the goal of overlaying arterial territory labels onto DSA for targeted quantitative angiography. The method comprises manual labeling of injection site and view, cone-beam projection of selected atlas regions using DICOM geometry, affine and B-spline registration of the projected atlas to a processed DSA mask, and evaluation via SSIM. On 2,247 DSA sequences, the authors report a mean SSIM of 0.69 ± 0.27 and a median of 0.81, and conclude that deformable registration was essential for precise overlay, enabling segmentation into arterial territories in 1–3 minutes. The paper claims that this approach enables targeted quantitative angiography analysis for SAH interventions.","tokens_in":4701,"tokens_out":2454,"duration_ms":24951,"significance":"If the registration accuracy were independently validated, the work would be a practical contribution to interventional neuroradiology: mapping a public 3D territory atlas onto routine 2D DSA in a few minutes could support territory-level visualization and future quantitative analysis. The scale of the evaluation (2,247 DSAs) is a notable strength, as is the transparent use of a public atlas and the explicit description of the imaging geometry. However, the validity of the central quantitative claim rests on the evaluation metric being computed against the same processed DSA mask used as the registration target, which is a circular measure; this, together with the unsupported assertion that deformable registration was 'essential,' limits the current evidence to feasibility. The paper is more a demonstration of an automated workflow than a validated clinical tool.","major_comments":[{"comment":"The evaluation is circular: the SSIM values reported in Results §3 are computed 'with reference to the processed DSA data' (Methods §2), which is the same temporally-averaged, thresholded, morphologically-cleaned mask that drives both the affine and B-spline registration. Measuring similarity to the registration target cannot distinguish a genuinely accurate anatomical overlay from one that has overfit the mask. The high median SSIM of 0.81 therefore partially reflects convergence to the target, not agreement with an independent standard. The authors should validate the overlays against an independent ground truth, for example manually delineated arterial territories by a clinician, or at minimum report expert visual scoring on a random sample of cases.","section":"Methods §2, Results §3"},{"comment":"The claim that 'affine transformations alone were insufficient' and that 'deformable registration was essential' is not supported by any quantitative comparison. The paper shows B-spline results but reports no affine-only SSIM values or statistical test comparing affine to deformable registration. Without these data, the necessity of the deformable step is an assertion rather than a finding. Please include affine-only SSIM (or a comparable metric) on the same 2,247 DSAs and a paired comparison.","section":"Results §3"},{"comment":"There is a direct contradiction between the abstract's claim that the approach 'enabled the extraction of targeted quantitative angiography parameters' and §4's explicit statement that 'quantitative analysis was not included in this study.' The title also promises 'Targeted Quantitative Angiography Analysis,' but the paper only saves transformation parameters for future work. Either remove the quantitative-analysis claims from the abstract and title, or include the promised quantitative analysis (e.g., territory-specific wash-in/wash-out parameters) in the manuscript.","section":"Abstract, §4"}],"minor_comments":[{"comment":"The sentence 'This mask facilitated the initial coarse alignment of the projected 3D atlas to the DSA perfused territory deformable registration techniques' is grammatically incomplete; it appears to be missing a verb and continuity with the next sentence.","section":"Abstract"},{"comment":"The first paragraph ends with 'excluded.at', which appears to be a typographical fragment; the sentence should be completed.","section":"Methods §2"},{"comment":"The mask generation parameters (threshold value, minimum component size, morphological structuring element, erosion kernel size) are not specified. Without these details the mask construction is not reproducible, and the sensitivity of SSIM to these choices is unknown.","section":"Methods §2"},{"comment":"The histogram in Figure 2 shows a skewed distribution, but the paper does not report the number of cases with SSIM below, say, 0.5, nor does it analyze whether failures correlate with lateral vs. anteroposterior views, injection site, or image quality. Such a breakdown would strengthen the claims about 'higher proportions in anteroposterior views.'","section":"Results §3"},{"comment":"The paper uses 'posterior' inconsistently in Methods §2: 'the projection view of the DSA data, either lateral or posterior' is likely meant to be 'lateral or anteroposterior'; using 'posterior' for a viewing direction is confusing because it is also an injection-site label.","section":"General"}],"recommendation":"major_revision","confidential_remarks":"The central methodological concern is the self-referential evaluation, which is load-bearing for the paper's main claim. This is fixable within the scope of a revision if the authors add an independent validation (e.g., manual territory delineations) and an affine-only comparison. However, if the authors cannot provide such validation, the paper will remain a feasibility demonstration rather than a validated method, which may be below the bar for a full research article in this venue. The novel aspects—using DICOM geometry for atlas projection and the large dataset—are worth preserving."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: this is a plausible feasibility study for overlaying a 3D arterial-territory atlas onto routine 2D DSA, tested on 2,247 cases. The pipeline uses standard building blocks (ASTRA cone-beam projection, SimpleITK affine plus B-spline registration, SSIM), and the specific combination with the Brain Arterial Vascular Model atlas appears to be new. If the overlay were validated against an independent standard, it would be a useful clinical tool. The paper does not do that, so take the quantitative claims with salt.\n\nWhat it does well: a large, real clinical dataset; a sensible workflow starting from injection-site and view labeling; and an honest-sounding conclusion that quantitative analysis was not actually performed. The 1–3 minute runtime is a useful practical data point. The authors also cite the atlas source and use well-known libraries.\n\nNow the soft spots, and they matter. The SSIM values in Results are computed with reference to the same processed DSA mask that served as the registration target. That is a circular measure: the optimizer is rewarded for deforming the atlas to match the mask, so a high median SSIM (0.81) mostly shows the optimizer converged, not that the overlay is anatomically correct. The paper never compares against an independent ground truth, manual expert outlines, or even a simple affine-only SSIM distribution. That last point is crucial because the paper claims affine transformations were insufficient and deformable registration was essential, but no affine-only numbers are shown anywhere. The claim may well be true, but it is currently asserted, not demonstrated.\n\nThe title and abstract promise 'targeted quantitative angiography analysis,' yet the methods produce only overlays and the conclusion explicitly says quantitative analysis was excluded. So the contribution is a registration pipeline, not a quantitative-angiography result. Also, the mask itself is built from thresholding and morphology, which can miss small vessels or include artifacts, and the paper does not check whether the B-spline deformation is physically plausible. No code or data are provided, which is not fatal but makes independent verification harder.\n\nThe stress-test note largely lands. I disagree only with calling the circularity 'load-bearing' beyond the specific SSIM claim — the qualitative overlays in Figure 1 do show sensible alignment. But for a methods paper, the missing affine comparison and circular metric are enough to require major revision.\n\nWho is this for? Interventional neuroradiologists and image-registration researchers working on atlas-to-DSA alignment. It deserves a serious referee, because the dataset is large and the idea is clinically motivated, but it should not be accepted without an independent accuracy check and the missing comparison. I would bring it to a reading group only to discuss evaluation pitfalls; I would not cite it in my own work until the validation is fixed.","headline":"Feasibility report with a large dataset, but the headline SSIM is circular and 'deformable was essential' is asserted without a comparison.","tokens_in":5257,"tokens_out":1297,"would_cite":false,"duration_ms":14685,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Deformable registration of a 3D arterial territory atlas onto 2D DSA reaches median SSIM 0.81 across 2,247 DSAs, making territory-level quantitative angiography feasible during subarachnoid hemorrhage interventions.","keywords":["subarachnoid hemorrhage","digital subtraction angiography","3D vascular territory atlas","deformable image registration","B-spline registration","structural similarity index measure","arterial territory segmentation","quantitative angiography"],"falsifier":"Take 50 DSAs with independent expert manual tracing of arterial territories; if the B-spline overlay does not improve agreement with those tracings over the affine-only overlay, the central claim that deformable registration is essential would be falsified. A second check is to find a case where the perfused-region mask visibly misses a distal vessel branch: a high SSIM there would show the metric validating the mask rather than the anatomy.","tokens_in":4355,"feed_emoji":"🧠","tokens_out":11702,"duration_ms":99368,"temperature":0.7,"pith_summary":"The paper tries to establish that a 3D arterial-territory atlas can be projected into the imaging geometry of a 2D digital subtraction angiography (DSA) sequence and then deformed to match the perfused regions of a given patient, so that every artery bed seen in the angiogram can be labeled. Across 2,247 DSA studies the full pipeline reaches a median SSIM of 0.81 (mean 0.69±0.27) between the registered atlas projection and the DSA-derived perfused-region mask. The authors report that affine alignment alone is not enough; a B-spline deformable step is required to accommodate individual anatomical variation. Because the overlay and segmentation take roughly 1 to 3 minutes, the intended payoff is territory-level quantitative angiography at the time of an intervention for subarachnoid hemorrhage.","feed_headline":"Deformable registration maps 3D brain territories onto 2D DSA","feed_subtitle":"Affine alone fails; B-spline registration reaches median SSIM 0.81 across 2,247 DSAs","key_machinery":"The load-bearing object is a 3D arterial-territory atlas in which each arterial region carries a numeric label, combined with a cone-beam projection that simulates the X-ray projection from the DSA's recorded geometry. The DSA side is summarized by a perfused-region mask built through temporal averaging, thresholding, small-component removal, morphological erosion, and hole filling. A two-stage registration — first affine, then B-spline — driven by a mutual information cost function aligns the projected atlas to the mask, with SSIM computed against the mask as the final overlay quality score.","core_discovery":"The central claim is that a two-stage registration — an affine transform initialized by the perfused-region mask, followed by a B-spline deformable transform — brings the projected 3D atlas into precise overlay with the DSA's perfused territories, and that this overlay can be segmented into named arterial territories automatically. The evidence is 2,247 DSAs with a median SSIM of 0.81 and a mean of 0.69±0.27, with a strongly left-skewed distribution; the authors interpret the skew as many near-perfect overlays plus a tail of poor ones. They also observe that exceptional overlays occur in higher proportions in anteroposterior views than lateral views. The paper is careful to state that quantitative territory analysis itself is not yet included; what is demonstrated is the registered, segmented overlay and saved transformation parameters that would support such analysis.","pith_inferences":["Not stated in the paper: because the quality score is computed against the same perfused-region mask that guides the registration, the reported SSIM values may be optimistic for true anatomical overlap, and an independent manual or angiographic standard would be needed to know how much.","A testable extension is to compare territory overlays from repeated injections of the same vessel in the same patient; consistency across repeats would give an artifact-free check of the registration that does not depend on the mask.","The authors do not yet report territory-specific quantitative parameters; the saved transformation parameters make such territory-wise parametric maps a natural next step, and the same atlas-to-DSA pipeline could be adapted to other indications by changing the injection-site lookup table."],"forward_implications":["Once registered, each DSA can be segmented into named arterial territories, allowing quantitative angiography parameters to be read per territory rather than over the whole image.","The saved affine and B-spline transformation parameters mean the atlas overlay can be recomputed for later analysis without re-running the registration.","The full workflow from loading a DSA to a segmented overlay takes about 1 to 3 minutes, which is compatible with use during an endovascular intervention.","The SSIM distribution is left-skewed with a median of 0.81, so most overlays are near the top of the quality range; the paper reports that exceptional cases appear more often in anteroposterior than in lateral views."],"supporting_citations":[{"why":"Supplies the digital 3D arterial-territory atlas with numeric region labels; it is the source of the regions being projected, registered, and segmented.","marker":"[11]"},{"why":"Documents quantitative angiography and parametric imaging methods that the territory overlay is designed to make region-specific; without these the targeted quantitative analysis has no clinical target.","marker":"[7-10]"},{"why":"Establishes subarachnoid hemorrhage as a common and dangerous condition, framing the clinical problem that motivates a 1-to-3-minute interventional workflow.","marker":"[1-2]"}],"fun_headline_variants":["B-spline overlay maps brain territories onto DSA with SSIM 0.81","Deformable registration improves 3D-to-2D brain atlas overlay","Automated atlas-to-DSA registration enables targeted angiography analysis","Two-step registration aligns 3D atlas to DSA for SAH analysis"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The perfused-region mask derived from the DSA by averaging, thresholding, small-component removal, erosion, and hole filling is treated as ground truth for the perfused arterial territories, and SSIM is measured against that mask, so registration quality is only as good as the mask.","fun_headline_variants_meta":{"raw":{"variants":["B-spline overlay maps brain territories onto DSA with SSIM 0.81","Deformable registration improves 3D-to-2D brain atlas overlay","Automated atlas-to-DSA registration enables targeted angiography analysis","Two-step registration aligns 3D atlas to DSA for SAH analysis"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000593,"raw_usage":{"total_tokens":2824,"prompt_tokens":1039,"completion_tokens":1785,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":655,"completion_tokens_details":{"reasoning_tokens":1704}},"tokens_in":655,"tokens_out":1785,"duration_ms":12622,"temperature":1.0,"reasoning_tokens":1704,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-12T12:52:55.940102+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Take 50 DSAs with independent expert manual tracing of arterial territories; if the B-spline overlay does not improve agreement with those tracings over the affine-only overlay, the central claim that deformable registration is essential would be falsified. A second check is to find a case where the perfused-region mask visibly misses a distal vessel branch: a high SSIM there would show the metric validating the mask rather than the anatomy.","supporting_citations":[{"cited_title":"Sci Data, 2023","cited_arxiv_id":null,"evidence_quote":"Supplies the digital 3D arterial-territory atlas with numeric region labels; it is the source of the regions being projected, registered, and segmented."}],"review_version":1}