REVIEW 3 major objections 5 minor 2 references
Comparison of three reconstruction algorithms for low-dose phase-contrast computed tomography of the breast with synchrotron radiation
T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read At a fixed 2 mGy dose, the cSART reconstruction algorithm yields more Shannon information per photon in phase-contrast breast CT than UTR or FBP, yet radiologists still prefer the higher-contrast FBP images.
desk verdict Useful three-way reconstruction comparison with a real objective/subjective split, but the objective superiority claim for cSART is undercut by parameter tuning on the same data and by using a linear-systems metric on a nonlinear algorithm. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing identity is the objective image-quality characteristic $Q_s = SNR/Res^{1.5}$ at fixed dose, which is proportional to the Shannon information capacity of a linear imaging system and is invariant under linear filtering; the paper measures it at fixed 2 mGy dose and interprets it as the information extracted per detected photon. The other half of the machinery is the paired three-panel observer protocol using visual grading characteristics (VGC) with bootstrapping, run on 3-mm thick axial slices, with intraclass correlation to confirm reader agreement. Contrast is defined as $(\beta_{\max}-\beta_{\min})/(\beta_{\max}+\beta_{\min})$ from a five-bin histogram across adipose–glandular interfaces, and the contrast measured this way is the one objective metric that tracks the subjective preference.
What would settle it
A clean test would freeze cSART's parameters after training on one set of mastectomy samples and apply them, without any re-tuning, to a newly scanned separate set, comparing against FBP and UTR with their standard settings on all five objective metrics; if cSART no longer dominates on SNR, resolution, and $SNR/Res^{1.5}$, the central claim fails. A second check is to rerun the observer study with per-algorithm window/level optimization: if the FBP preference persists even when all three image sets are displayed at their individually optimal contrast settings, the contrast-weighting explanation is supported rather than being an artifact of a global rescaling.
Extended reading notes
Core claim
The central claim is that, at a clinically relevant dose of 2 mGy, the customized SART algorithm reconstructs phase-contrast breast CT images that contain more measurable Shannon information per incident photon than either UTR or FBP, as quantified by the ratio $SNR/Res^{1.5}$ among the three algorithms, while the same images receive lower perceptual scores from trained readers. This apparent contradiction is resolved by a hypothesis: in subjective radiological evaluation, image contrast carries far more perceptual weight than noise suppression, so the lower-contrast but higher-SNR cSART images lose out to FBP despite FBP having the poorest objective information content. The paper presents this as an argument rather than a settled conclusion, and it frames the methodology as a template for combining physics-based objective metrics with visual grading characteristics analysis.
Load-bearing premise
The head-to-head superiority of cSART rests on parameters that were tuned on a thin slice drawn from the same datasets and evaluated with the same SNR and resolution metrics that later declared cSART the winner, while FBP and UTR were used with fixed, unoptimized settings.
Editorial extensions
If this is right
- If cSART truly puts more Shannon information per photon into its images, then for fixed dose it is the better input for automated and AI-based diagnostic tools, since those tools rely on objective information content rather than human perceptual preferences.
- The observed preference for FBP suggests that radiologist-facing image display, windowing, or post-processing of cSART images would need to be adjusted to make the objective advantage perceptually visible.
- For clinical deployment of phase-contrast breast CT at synchrotron facilities, algorithm choice will depend on the reading workflow: human reading may favor FBP or UTR, while automated analysis favors cSART.
- The methodology—pairing SNR, CNR, contrast, resolution, and $SNR/Res^{1.5}$ with a VGC observer study—can be applied to any CT reconstruction or denoising algorithm, not just these three.
Reading between the lines
- An untested extension of the paper's contrast-weighting explanation is that applying a contrast-enhancement or unsharp-masking post-process to cSART volumes would close the subjective gap; this could be tested with a similar observer study.
- If cSART provides more Shannon information at the same dose, it may also allow dose reduction for automated screening tasks while preserving diagnostic information for machine readers—a testable prediction.
- The fixed linear rescaling from 32-bit floating point to 12-bit integers with a global window may itself disadvantage cSART, whose noise statistics and histogram shape differ from FBP's; an observer test with per-algorithm window/level optimization would be a fairer perceptual comparison.
- The paper's own observation that calcification artifacts appear in some cSART images suggests the thresholding/binning step used to make thick axial slices may interact with the reconstruction algorithm; refining that step could change the subjective ranking.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript compares three CT reconstruction algorithms—FBP, UTR, and cSART—combined with Paganin phase retrieval for synchrotron-based phase-contrast breast CT at 2 mGy on ten fresh mastectomy specimens. Objective metrics (contrast, SNR, CNR, spatial resolution, and Q_s = SNR/Res^{1.5}) indicate that cSART outperforms UTR and FBP, while a seven-observer radiological study finds that FBP images are preferred overall, reportedly because radiologists weight contrast more than noise. The authors interpret the objective advantage as evidence that cSART extracts more Shannon information per incident photon, and they propose that this makes cSART attractive for automated image analysis despite the subjective preference for FBP.
Significance. The study is valuable as a realistic, clinically oriented comparison at a fixed low dose, with real mastectomy samples, a consistent acquisition protocol, a reproducible public implementation of UTR, and a structured subjective evaluation with ICC and VGC analyses. If the central objective claim were supported by a fair comparison and a valid information-theoretic metric, the finding that cSART provides more useful information per photon would be important for the design of synchrotron breast CT reconstruction pipelines and for AI-based image analysis. However, the present evidence for that claim is weakened by two load-bearing issues: circular parameter optimization for cSART and the use of a metric whose information-theoretic interpretation is proven only for linear systems.
major comments (3)
- [2c.ii, 3a] cSART's parameters were selected on a 1-mm slice from the same datasets using the same SNR, spatial-resolution, and noise-power-spectrum criteria used in the evaluation, whereas UTR (noise-to-signal ratio 0.05) and FBP (Hamming filter) were used with fixed, unoptimized parameters. This means that the reported superiority of cSART on the objective metrics is partly a consequence of fitting those metrics on the same data. The comparison should be repeated with a proper train/test split, or the authors should demonstrate that the selected parameters are optimal for independent data and that the conclusion is unchanged.
- [2e, Eq. (6), 3a (Figure 2e)] The quantity Q_s defined in Eq. (6) is derived from linear-systems theory, and Section 2e states that this ratio 'can be changed only by means of non-linear processing.' cSART is a nonlinear reconstruction method (periodic bilateral 3D filter plus iterative regularization, Section 2c.ii), and SNR and resolution are measured in flat adipose ROIs where a bilateral filter suppresses noise. Therefore the larger Q_s for cSART may reflect nonlinear denoising within the ROIs rather than additional Shannon information per incident photon. The claim that 'cSART-reconstructed slices objectively contained more measurable (Shannon) information' (Section 3a) is not supported without an information-theoretic analysis that is valid for nonlinear reconstruction, or at least a demonstration that the Q_s advantage is not due to the bilateral filter.
- [2d, 3b] The subjective assessment was performed on 3-mm axial slices created by the 30-pixel binning procedure that, as acknowledged in Section 3b, produced calcification-like artefacts from amplified bright noisy pixels, with an example shown for cSART in Fig. 3(c). Since these artefacts appear to affect the very images that were rated, the observed lower subjective scores of cSART on calcification visibility and overall image quality may be confounded by the binning method rather than by the reconstruction algorithms themselves. The statement that this effect is not expected to be major is not quantitatively supported; the authors should report the number and extent of affected images and, if possible, re-analyze the subjective data with a binning method that does not amplify noise.
minor comments (5)
- [3a] The pair 'cSART vs. FFBP' contains a typo; it should read 'cSART vs. FBP.'
- [2d] The typesetting of the threshold value and of Eq. (1) is garbled; the numerical value of the threshold and the mapping formula should be rendered cleanly so that the binning procedure is reproducible.
- [Figure 5] Two panels are labeled (b); the labels should be corrected to (a)–(f) so that the panels are unambiguous.
- [2e] The notation Res is used for both the spatial-resolution measure and its reciprocal relationship in Eq. (8); the definitions should be consolidated to avoid confusion.
- [3c] The statement that radiologists assign low weight to SNR is an informal interpretation; the VGC analysis only compares pairs of algorithms and does not directly estimate attribute weights, so this conclusion should be framed as a hypothesis rather than a demonstrated cause.
Circularity Check
cSART's objective superiority is partly circular: its parameters were optimized on the same data and with the same SNR/resolution metrics later used to declare it superior, while UTR and FBP were fixed.
-
fitted input called prediction
[Section 2c.ii (cSART parameter optimization), leveraged in Section 3a objective comparisons]
"Following the optimization discussed in (Donato et al., 2022), a subset of optimal parameters is selected based on a threshold value for the frequency peak of the 1D noise power spectrum compared to the equivalent FBP one, evaluated in uniform region of interests within the adipose tissue. Reconstructions falling within this threshold (difference less than 15%) are then compared in terms of signal-to-noise ratio and spatial resolution. The subset of parameters that yields the best values for both metrics is then chosen to perform the full volume reconstruction."
cSART hyperparameters were tuned on 1-mm slices from the same mastectomy acquisitions by selecting the combination with the best measured SNR and spatial resolution (after an NPS threshold against FBP). Section 3a then reports cSART as superior in SNR, spatial resolution, and Qs = SNR/Res^1.5 (Figs. 2b,d,e and 4b,d,e), which are the very metrics used for the selection. UTR and FBP were run with fixed, unoptimized parameters (UTR noise-to-signal ratio 0.05; FBP Hamming filter). The claim that cSART objectively outperforms the other algorithms is therefore partly a re-measurement of the fitted criterion rather than an independent prediction, and no held-out validation is described to show the tuning generalizes.
full rationale
The main circular element is the parameter-selection loop: cSART's four parameters were chosen by maximizing SNR and spatial resolution on 1-mm slices from the same datasets, and then those same metrics, together with Qs derived from them, are used to declare cSART objectively superior to UTR and FBP, whose parameters were fixed. This makes the central objective-superiority claim partially an artifact of fitting to the evaluation metric and data. The Shannon-information interpretation is additionally weakened by the nonlinearity caveat in Section 2e: Qs is justified by linear-systems theory (Gureyev et al. 2014, 2016), while the paper itself states the SNR/resolution ratio can be changed by nonlinear processing, and cSART includes a periodic bilateral 3D filter. That said, the subjective reader study is an independent, non-circular component and actually favors FBP, which prevents a higher circularity rating. The score of 6 reflects one strong fitted-input loop plus this validity caveat, rather than total circularity.
Assumptions & free parameters
free parameters (4)
- Paganin phase retrieval gamma =
275
- cSART relaxation/filter parameters (w, sigma_xy,z, sigma_v) =
w=0.04, sigma_xy,z=10, sigma_v=0.20 for 1200/1800 projections; w=0.06, sigma_xy,z=10, sigma_v=0.07 for 2400 projections
- UTR noise-to-signal ratio =
0.05
- Binning threshold for calcification/soft tissue separation =
Not clearly specified in text (garbled)
assumptions (4)
- domain assumption SNR^2/Res^3 is proportional to Shannon information capacity of a CT imaging system (Gureyev et al. 2014, 2016)
- domain assumption Spatial ergodicity: ensemble averages can be replaced by spatial averages in flat regions
- domain assumption The imaging system is linear and shift-invariant, so PSF width can be estimated from the noise power spectrum in flat regions
- domain assumption Paganin's TIE-Hom phase retrieval with a single gamma value is valid for breast tissue at 32 keV
Cite this review
Pith. "Pith review of Comparison of three reconstruction algorithms for low-dose phase-contrast computed tomography of the breast with synchrotron radiation." pith.science (2026). https://pith.science/paper/W75NTXXF
@misc{pith2026241211641,
author = {Pith},
title = {Pith review of: Comparison of three reconstruction algorithms for low-dose phase-contrast computed tomography of the breast with synchrotron radiation},
year = {2026},
howpublished = {\url{https://pith.science/paper/W75NTXXF}},
note = {Machine review of arXiv:2412.11641}
}
read the original abstract
Three different computed tomography (CT) reconstruction algorithms: Filtered Back Projection (FBP), Unified Tomographic Reconstruction (UTR) and customized Simultaneous Algebraic Reconstruction Technique (cSART), have been systematically compared and evaluated using experimental data from CT scans of ten fresh mastectomy samples collected at the Imaging and Medical beamline of the Australian Synchrotron. All the scans were collected at the mean glandular dose of 2 mGy, using monochromatic X-rays with 32 keV energy, flat-panel detectors with 0.1 mm pixels and 6 meter distance between the rotation stage and the detector. Paganin's phase retrieval method was used in conjunction with all three CT reconstruction algorithms. The reconstructed images were compared in terms of the objective image quality characteristics, including spatial resolution, contrast, signal-to-noise, and contrast-to-noise ratios. The images were also evaluated by seven experienced medical imaging specialists, rating perceptible contrast, sharpness of tissue interfaces, image noise, calcification visibility and overall image quality. Of the three compared algorithms, cSART was clearly superior to UTR and FBP in terms of most measured objective image quality characteristics. At the same time, the results of the subjective quality evaluation consistently favoured the images reconstructed by FBP, followed by UTR, with cSART receiving lower scores on average. We argue that this apparent disagreement between the objective and subjective assessments of image quality can be explained by the importance assigned to image contrast in the subjective assessment, while the signal-to-noise ratio seemed to receive relatively low weighting. This study was conducted in preparation for phase-contrast breast CT imaging of live patients at Australian Synchrotron (Melbourne, Australia).
Figures
Reference graph
Works this paper leans on
-
[472]
Mammography with Synchrotron Radiation: First Clinical Experience with Phase- Detection Technique
https://doi.org/10.1364/JOSAA.19.000472 Castelli, E., Tonutti, M., Arfelli, F., Longo, R., Quaia, E., Rigon, L., Sanabor, D., Zanconati, F., Dreossi, D., Abrami, A., Quai, E., Bregant, P., Casarin, K., Chenda, V., Menk, R.H., Rokvic, T., Vascotto, A., Tromba, G., Cova, M.A., 2011. Mammography with Synchrotron Radiation: First Clinical Experience with Phas...
-
[2011]
Toolbox for advanced X-ray image processing. Proceedings of SPIE, vol. 8141, pp.81410B-1 - 81410B- 14. Gureyev, T. E., Nesterets, Y. I., de Hoog, F., Schmalz, G., Mayo, S. C., Mohammadi, S. & Tromba, G., 2014, Duality between noise and spatial resolution in linear systems. Opt. Expr 22, 9087-9094. Gureyev, T. E., Nesterets, Y. I. & de Hoog, F., 2016. Spat...
work page Pith review arXiv 2018
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.