Pith. sign in

REVIEW 5 major objections 8 minor 60 references

Cardiac-CLIP: A Vision-Language Foundation Model for 3D Cardiac CT Images

T0 review · 5 major / 8 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Cardiac-CLIP: a single 3D cardiac CT vision-language model that, the paper argues, outperforms existing 3D medical foundation models on classification, retrieval, and clinical risk prediction, including zero-shot two-year acute coronary…

desk verdict First dedicated 3D cardiac CT vision-language model with a genuinely new soft-label contrastive loss, but the zero-shot ACS claim needs prompt disclosure before the 'emergent' language can be taken at face value. read the letter →

arxiv 2507.22024 v1 pith:MPQPO6SP submitted 2025-07-29 eess.IV cs.CV

Yutao Hu , Ying Zheng , Shumei Miao , Xiaolei Zhang , Jiahao Xia , Yaolei Qi , Yiyang Zhang , Yuting He
show 15 more authors
Qian Chen Jing Ye Hongyan Qiao Xiuhua Hu Lei Xu Jiayin Zhang Hui Liu Minwen Zheng Yining Wang Daimin Zhang Ji Zhang Wenqi Shao Yun Liu Longjiang Zhang Guanyu Yang
This is my paper · ORCID
classification eess.IVcs.CV
keywords 3DcardiacCTvision-languagepretrainingmaskedautoencodercontrastivelearningsoft-labelmatrixzero-shotclassificationacutecoronarysyndromepredictionarterycalciumgrading
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Cardiac-CLIP is a vision-language model built for 3D cardiac CT volumes paired with radiology reports, and the paper claims that one pretrained model can classify cardiovascular abnormalities, retrieve relevant reports and images, and support clinical risk prediction across hospitals without per-site retraining. The central claim is that a two-stage recipe—self-supervised 3D masked autoencoding followed by soft-label contrastive alignment with standardized reports—produces representations that transfer better than existing 3D medical foundation models in both zero-shot and fine-tuned settings. The strongest evidence is the clinical analysis: prospective two-year acute coronary syndrome risk reaches 0.742 AUROC zero-shot and 0.802 after fine-tuning, functional coronary stenosis reaches 0.782, and coronary artery calcium grading reaches an average ordinal AUROC of 0.844 zero-shot. If these results hold, a single cardiac CT foundation model could reduce the annotation burden and domain-shift problems that currently limit AI-based cardiovascular diagnostics.

What carries the argument

The load-bearing component is the soft-label affinity matrix that replaces the usual one-hot contrastive target. Each scan is summarized as a pathology vector of seven binary attributes (for example, coronary stenosis, coronary calcification, cardiomegaly), and pairwise cosine similarities between these vectors become the supervision matrix $\tilde{A}$ used to train the image-text similarity matrix. The visual encoder is a vision transformer with 3D patch embeddings, pretrained with a 75%-masked autoencoder on 130k volumes, and the text encoder is a biomedical language model. Free-text reports are first standardized into 'There is [abnormality]' and 'There is no [abnormality]' statements, and the contrastive loss is symmetrized cross-entropy between $\text{Softmax}(S/\tau)$ and $\tilde{A}$. This machinery lets the model treat cases with partially overlapping pathology as softly positive pairs, which is what the authors credit for fine-grained cardiovascular semantics.

What would settle it

Inspect the exact text query used for the zero-shot ACS experiment in Section 3.4.1. If the query is one of the structured templates (for example, 'There is coronary stenosis') or includes the phrase 'acute coronary syndrome', then the result is a trained correlate rather than an emergent capability; a definitive test is to retrain the second stage with all ACS-related wording removed from the reports and check whether the zero-shot AUROC still exceeds 0.7.

Watch

Extended reading notes

Core claim

The paper's central discovery is that contrastive pretraining against standardized radiology reports with soft labels gives a cardiac-CT vision-language model substantially better zero-shot and transfer performance than prior 3D medical foundation models. On internal and external classification, Cardiac-CLIP consistently leads across seven abnormalities; on a public chest CT dataset never used in pretraining, it outperforms a model trained directly on that dataset. The paper identifies the clinical-analysis results as emergent capabilities: although terms like 'acute coronary syndrome' and 'functional stenosis' and explicit calcification grades were not part of the training text, the model still separates ACS events from controls, identifies hemodynamically significant stenosis, and ranks calcium severity. The reported numbers—0.742 zero-shot AUROC for ACS, 0.782 for functional stenosis, and 0.844 average ordinal AUROC for calcium grading—are the quantitative core of the claim.

Load-bearing premise

The load-bearing premise is that the acute coronary syndrome zero-shot result is genuinely zero-shot: the text query used to get the 0.742 AUROC is not one of the seven trained report templates and does not otherwise expose the model to ACS-related wording when it learns to match images to reports.

Editorial extensions

If this is right

  • A single Cardiac-CLIP pretraining provides zero-shot classification of seven cardiovascular abnormalities across contemporaneous, temporally shifted, and external datasets, with the largest gains over prior 3D foundation models exceeding 30 AUROC points on cardiomegaly and pericardial effusion.
  • The visual encoder transfers with little supervision: fine-tuning on only 10% of labeled data already gives competitive average AUROC on the two large public CT evaluation sets.
  • Zero-shot keyword-guided retrieval, using phrases like 'There is coronary stenosis', retrieves the correct cardiac CTs better than prior models on internal and external pools, including on a public chest CT dataset whose training split was never seen in pretraining.
  • Prospective two-year acute coronary syndrome risk can be predicted from a prior CCTA at 0.742 AUROC with no fine-tuning, and at 0.802 after fine-tuning, while a fully supervised 3D vision transformer baseline reaches only 0.529.
  • Coronary calcium severity is inferable from non-contrast CT without explicit score labels: the zero-shot ordinal AUROC averages 0.844 across grade thresholds.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper does not disclose the exact text query used for the zero-shot ACS prediction; if that query is one of the seven trained report templates, then the 0.742 AUROC would be a trained correlate rather than an emergent zero-shot ability, so the claim is testable immediately.
  • Because the soft-label matrix is built from only seven abnormality attributes, the apparent emergence of ACS and functional-stenosis knowledge may be mediated entirely by those attributes; ablating each attribute from the pathology vectors would reveal which cues carry the prognostic signal.
  • The same soft-label contrastive recipe could transfer to other 3D modalities with paired reports, such as abdominal or neuro CT, provided a small set of report attributes can be standardized; the paper's comparisons suggest that domain-specific attribute construction, rather than model scale alone, drives the gains.
  • Real-world retrieval would likely use free-text queries rather than the structured templates; testing with raw reports and clinician-typed phrases would clarify whether the alignment survives realistic input.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 8 minor

Summary. The manuscript presents Cardiac-CLIP, a 3D vision-language foundation model for cardiac CT built through a two-stage pretraining pipeline: a 3D masked autoencoder trained on 130,889 CT volumes, followed by contrastive alignment of cardiac CT images with radiology reports. Free-text reports are structured into seven abnormality templates, converted into +/-1 pathology vectors, and used to build a soft-label affinity matrix for contrastive learning. The model is evaluated on abnormality classification in zero-shot and fine-tuning settings, image-text retrieval, and three clinical tasks: prospective two-year ACS prediction, functional coronary stenosis diagnosis, and CAC grading, using internal and external multi-center data. The paper reports consistent AUROC and recall improvements over Merlin, CT-CLIP, M3D, and 3D-ViT, and claims emergent zero-shot capability for ACS and CAC grading.

Significance. Cardiac-CLIP addresses a real gap: there is no large-scale cardiac CT vision-language foundation model, and the authors assemble an unusually large private multi-center dataset and make code available. If the claims hold, the model would offer zero-shot abnormality classification, clinically useful retrieval, and prospective risk prediction from 3D CT, which would be valuable. The soft-label contrastive idea is a plausible way to leverage structured diagnostic attributes, and the evaluation breadth across 12 institutions, public NLST and CT-RATE data, a temporal-shift cohort, and clinical endpoints is a strength. However, the strongest generalization claims currently rest on two under-specified components: the ACS zero-shot prompt and the contrastive loss target, together with dataset-separation ambiguities that must be resolved before the central conclusions can be relied upon.

major comments (5)
  1. [Section 3.4.1 / Fig. 5(a)] The zero-shot ACS result (AUROC 0.742) is reported without stating the text prompt passed to the textual encoder. The only zero-shot prompts defined in the paper are the seven abnormality templates from Sec. 5.3.1, and Sec. 4 explicitly says that the term 'acute coronary syndrome' is not in the training data. If the prompt was one of the seven trained templates, such as 'There is coronary stenosis', the result is a learned correlate and not an emergent zero-shot diagnosis of ACS; if it was a novel phrase, the paper must supply the exact prompt and demonstrate robustness to prompt wording. This is load-bearing for the abstract's 'emergent capabilities' claim and for the Discussion's ACS paragraph. Please report the exact prompt, the event/control retrieval protocol, and confidence intervals for the 650-patient cohort.
  2. [Section 5.3.3, Eq. (6)] The contrastive loss is written as CE(Softmax(S/tau), A) with A_ij = y_i . y_j / (||y_i|| ||y_j||). Since the pathology vectors have +/-1 entries, A entries lie in [-1,1] and rows are not normalized to sum to 1, so A is not a valid target distribution for cross-entropy. In addition, the diagonal of A is always 1, so the loss may be dominated by the diagonal rather than by the intended off-diagonal soft supervision. Please replace Eq. (6) with a well-defined objective, for example by row-normalizing and clipping the soft targets or by using a squared-error loss, and state the exact conversion from A to a probability target.
  3. [Section 2.2, PD-1] The paper does not state that the 1,663 contemporaneous evaluation images from 946 patients are disjoint from the 16,641 pretraining images from 4,708 patients. Both cohorts are from Jinling Hospital over the same period, so without an explicit patient-level split the internal AUROC numbers in Fig. 3(c) and the ablation study in Fig. 6 could be inflated by training/evaluation overlap. Please specify the split and report evaluation metrics at the patient level.
  4. [Section 3.2.2 and Section 2.1 (OD-1)] NLST is described as an external dataset for classification, but all NLST cardiac-cropped images except the held-out test set are included in the first-stage MAE pretraining (114,248 images). A model pretrained on unlabeled NLST images is not external to NLST for the purpose of measuring transfer; any NLST gain could reflect in-distribution representation learning rather than generalization. Please either retrain a version without NLST for the external evaluation, or explicitly describe the NLST classification result as same-distribution pretraining rather than external validation.
  5. [Section 3.4.3 and Section 5.3.1] The zero-shot CAC grading protocol uses the prompt 'There is Coronary Artery Calcium' as a proxy for calcification severity, but the paper does not explain the relationship between this prompt and the seven pretraining abnormality names, nor why a cosine similarity to a single presence/absence prompt should be monotone in Agatston grade. As written, the ordinal AUROC table in Fig. 5(c) cannot be reproduced, and the comparison with other foundation models under unspecified zero-shot protocols is not apples-to-apples. Please provide the exact prompts, thresholds, and normalization used for all models.
minor comments (8)
  1. [Section 1 and Section 2.1] The total number of pretraining scans is given as 130,889 in the introduction, 130,899 in Section 2.1, and 130,889 in the abstract; please make the counts consistent.
  2. [Section 3.2.2] The text says 'As shown in Fig. 3(d)' for the fine-tuning evaluation, but in the caption Fig. 3(d) is the external zero-shot panel and Fig. 3(e) is the fine-tuning panel; please fix the cross-references.
  3. [Figure 6] The ablation table does not show which rows correspond to which combination of MAE, structured report, and soft matrix; add checkmarks or a configuration column so the four configurations can be read directly.
  4. [Section 5.3.1] The structured reports are generated with GPT-4o, but no quality-control or error analysis is reported; a small validation of the structuring on a random sample would help assess label noise.
  5. [Throughout] The paper alternates between '3D-ViT' and 'M3DNet/M3D' naming and between 'AUC' and 'AUROC'; please unify the terminology.
  6. [References] Reference [43] is formatted with 'null null' as the author list; use the actual National Lung Screening Trial Research Team author string.
  7. [Eq. (2)] In Eq. (2), 'construction loss' should be 'reconstruction loss'.
  8. [Section 4] The statement that the radiology reports contain related terminology such as 'coronary', 'stenosis', and 'calcification' is helpful, but it should be connected to the prompt disclosure requested for Section 3.4.1 rather than appearing only in the Discussion.

Circularity Check

0 steps flagged · score 0.0 of 10

No equation-level circularity: standard CLIP-style alignment; ACS prompt omission is a reproducibility gap, not a demonstrated reduction.

full rationale

The paper's derivation chain is a standard two-stage contrastive-learning pipeline: MAE pre-training, report structuring into seven abnormality templates, pathology-vector soft labels, and CLIP-style contrastive loss. The zero-shot classification of those seven abnormalities uses the very prompts that define the structured reports (Sec. 3.1.1 vs. Sec. 5.3.1), but that is the normal CLIP evaluation protocol, not a circular reduction: the prompts are the intended semantic vocabulary, and the test images are not the training images. The soft-label matrix (Eqs. 3-6) is a training-time label-smoothing scheme; it does not by itself fix the test-time AUROC values, which are measured on held-out and external data. The paper's strongest claim, zero-shot ACS prediction (AUROC 0.742), is not shown to be circular by any quoted equation: the paper states that 'acute coronary syndrome' is not in the pre-training data and explicitly attributes the result to 'related terminology, such as coronary, stenosis, and calcification' in the Discussion. However, the exact text prompt used for the zero-shot ACS experiment is never disclosed; the only zero-shot prompts defined in the paper are the seven trained templates, and Section 3.4.1 reports only the dataset and the AUROC. That is a serious reproducibility and support gap, but without the prompt we cannot exhibit an equation-level identity such as Eq. 4 = Eq. 5 or a fitted parameter renamed as a prediction, so under the hard rules it is not counted as circularity. The CAC-grading experiment likewise uses a disclosed proxy - cosine similarity to 'There is Coronary Artery Calcium', semantically the trained 'coronary calcification' attribute - and the paper explicitly calls it a proxy-based approach rather than a grade-label prediction, so it is an imperfect but transparent evaluation, not a renamed fitted parameter. The only self-citation is reference [47], used in a cluster to motivate fine-grained soft-label supervision; it is not load-bearing for any reported result. The paper also contains independent external evidence, notably zero-shot performance on CT-RATE, which was not used in pre-training. Overall, the central derivation is self-contained against external benchmarks; the ACS prompt omission should be fixed, but it does not rise to demonstrated circularity.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The model rests on standard deep learning building blocks (MAE, CLIP, BERT). The main burden is the 7-abnormality binary vocabulary that simultaneously defines the training labels and the evaluation labels, plus the unnormalized soft-label loss and the undocumented zero-shot prompt.

free parameters (3)
  • Contrastive temperature tau = not specified
    Eq. 6 scales logits by tau; the value is not given in the paper, and it is a hand-set hyperparameter.
  • MAE mask ratio = 0.75
    Sec 5.4 sets the first-stage masking fraction to 75%; this is a hand-chosen design parameter.
  • Seven predefined abnormality attributes (D=7) = 7
    Sec 5.3.2 defines the pathology vector dimension and the prompt templates; this choice defines both the training target and the zero-shot evaluation labels.
assumptions (4)
  • ad hoc to paper The soft-label matrix ~A in Eq. 4 is a valid target for cross-entropy loss in Eq. 6, even though its entries lie in [-1,1] and rows are not normalized to sum to 1.
    No normalization or transformation of ~A is specified; standard cross-entropy expects a probability distribution, so the training objective is not well-defined on the printed equations.
  • domain assumption Radiology reports that do not mention a condition are treated as stating its absence ("There is no [abnormality]").
    Sec 5.3.1 maps "no mention" to a negative label, which can mislabel cases where the radiologist did not assess the finding.
  • domain assumption Cardiac region cropping with a RetinaNet detector preserves all diagnostic information needed for downstream tasks.
    Sec 2.1 applies cropping to both pretraining and evaluation; if cropping removes relevant context, all results would be affected.
  • domain assumption The text encoder PubMedBERT supplies enough prior knowledge for phrases not seen in contrastive training (e.g., "acute coronary syndrome") for zero-shot generalization.
    Sec 4 relies on the text encoder's prior to bridge trained terms like "coronary" and "stenosis" to untrained terms like "acute coronary syndrome."

how reviews work

0 comments
Cite this review

Pith. "Pith review of Cardiac-CLIP: A Vision-Language Foundation Model for 3D Cardiac CT Images." pith.science (2026). https://pith.science/paper/MPQPO6SP

@misc{pith2026250722024,
  author       = {Pith},
  title        = {Pith review of: Cardiac-CLIP: A Vision-Language Foundation Model for 3D Cardiac CT Images},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/MPQPO6SP}},
  note         = {Machine review of arXiv:2507.22024}
}
read the original abstract

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model designed for 3D cardiac CT images. Cardiac-CLIP is developed through a two-stage pre-training strategy. The first stage employs a 3D masked autoencoder (MAE) to perform self-supervised representation learning from large-scale unlabeled volumetric data, enabling the visual encoder to capture rich anatomical and contextual features. In the second stage, contrastive learning is introduced to align visual and textual representations, facilitating cross-modal understanding. To support the pre-training, we collect 16641 real clinical CT scans, supplemented by 114k publicly available data. Meanwhile, we standardize free-text radiology reports into unified templates and construct the pathology vectors according to diagnostic attributes, based on which the soft-label matrix is generated to supervise the contrastive learning process. On the other hand, to comprehensively evaluate the effectiveness of Cardiac-CLIP, we collect 6,722 real-clinical data from 12 independent institutions, along with the open-source data to construct the evaluation dataset. Specifically, Cardiac-CLIP is comprehensively evaluated across multiple tasks, including cardiovascular abnormality classification, information retrieval and clinical analysis. Experimental results demonstrate that Cardiac-CLIP achieves state-of-the-art performance across various downstream tasks in both internal and external data. Particularly, Cardiac-CLIP exhibits great effectiveness in supporting complex clinical tasks such as the prospective prediction of acute coronary syndrome, which is notoriously difficult in real-world scenarios.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

60 extracted references · 53 canonical work pages

  1. [1]

    2025 heart disease and stroke statistics: A report of us and global data from the american heart association.Circulation, 2025

    Seth S Martin, Aaron W Aday, Norrina B Allen, Zaid I Almarzooq, Cheryl AM Anderson, Pankaj Arora, Christy L Avery, Carissa M Baker-Smith, Nisha Bansal, Andrea Z Beaton, et al. 2025 heart disease and stroke statistics: A report of us and global data from the american heart association.Circulation, 2025

    work page 2025

  2. [2]

    Forecasting cardiovascular disease risk and burden in china from 2020 to 2030: a simulation study based on a nationwide cohort

    Runsi Wang, Yunfeng Wang, Jiapeng Lu, Yichong Li, Chaoqun Wu, Yang Yang, Jianlan Cui, Wei Xu, Lijuan Song, Hao Yang, Wenyan He, Yan Zhang, Xingyi Zhang, Xi Li, and Shengshou Hu. Forecasting cardiovascular disease risk and burden in china from 2020 to 2030: a simulation study based on a nationwide cohort. Heart, 111(5):205–211, December 2024. ISSN 1468-201X

    work page 2020

  3. [3]

    Deep convolutional neural networks to predict cardiovascular risk from computed tomography.Nature communications, 12(1):715, 2021

    Roman Zeleznik, Borek Foldyna, Parastou Eslami, Jakob Weiss, Ivanov Alexander, Jana Taron, Chintan Parmar, Raza M Alvi, Dahlia Banerji, Mio Uno, et al. Deep convolutional neural networks to predict cardiovascular risk from computed tomography.Nature communications, 12(1):715, 2021

    work page 2021

  4. [4]

    Implementation of a national ai technology program on cardiovascular outcomes and the health system.Nature Medicine, pages 1–8, 2025

    Timothy A Fairbairn, Liam Mullen, Edward Nicol, Gregory YH Lip, Matthias Schmitt, Matthew Shaw, Laurence Tidbury, Ian Kemp, Jennifer Crooks, Girvan Burnside, et al. Implementation of a national ai technology program on cardiovascular outcomes and the health system.Nature Medicine, pages 1–8, 2025

    work page 2025

  5. [5]

    Oikonomou, Girish N

    Rohan Khera, Evangelos K. Oikonomou, Girish N. Nadkarni, Jessica R. Morley, Jenna Wiens, Atul J. Butte, and Eric J. Topol. Transforming cardiovascular care with artificial intelligence: From discovery to practice. Journal of the American College of Cardiology, 84(1):97–114, July 2024. ISSN 0735-1097

    work page 2024

  6. [6]

    Wolterink, Tim Leiner, Richard A

    Jelmer M. Wolterink, Tim Leiner, Richard A. P. Takx, Max A. Viergever, and Ivana Isgum. Automatic coronary calcium scoring in non-contrast-enhanced ecg-triggered cardiac ct with ambiguity detection. IEEE Transactions on Medical Imaging, 34(9):1867–1878, September 2015. ISSN 1558-254X

    work page 2015

  7. [7]

    Automatic coronary calcium scoring using noncontrast and contrast ct images: Automatic coronary calcium scoring

    Guanyu Yang, Yang Chen, Xiufang Ning, Qiaoyu Sun, Huazhong Shu, and Jean-Louis Coatrieux. Automatic coronary calcium scoring using noncontrast and contrast ct images: Automatic coronary calcium scoring. Medical Physics, 43(5):2174–2186, April 2016. ISSN 0094-2405

    work page 2016

  8. [8]

    Wolterink, Tim Leiner, Bob D

    Jelmer M. Wolterink, Tim Leiner, Bob D. de Vos, Robbert W. van Hamersvelt, Max A. Viergever, and Ivana Išgum. Automatic coronary artery calcium scoring in cardiac ct angiography using paired convolutional neural networks.Medical Image Analysis, 34:123–136, December 2016. ISSN 1361-8415

    work page 2016

Show all 60 references
  1. [9]

    Alvi, Dahlia Banerji, Mio Uno, Yasuka Kikuchi, Julia Karady, Lili Zhang, Jan-Erik Scholtz, Thomas Mayrhofer, Asya Lyass, Taylor F

    Roman Zeleznik, Borek Foldyna, Parastou Eslami, Jakob Weiss, Ivanov Alexander, Jana Taron, Chintan Parmar, Raza M. Alvi, Dahlia Banerji, Mio Uno, Yasuka Kikuchi, Julia Karady, Lili Zhang, Jan-Erik Scholtz, Thomas Mayrhofer, Asya Lyass, Taylor F. Mahoney, Joseph M. Massaro, Ram...

    2021

  2. [10]

    Khalaf, Alexander T

    David Eng, Christopher Chute, Nishith Khandwala, Pranav Rajpurkar, Jin Long, Sam Shleifer, Mo- hamed H. Khalaf, Alexander T. Sandhu, Fatima Rodriguez, David J. Maron, Saeed Seyyedi, Daniele Marin, Ilana Golub, Matthew Budoff, Felipe Kitamura, Marcelo Straus Takahashi, Ross W. ...

    2021

  3. [11]

    van Hamersvelt, Jelmer M

    Majd Zreik, Robbert W. van Hamersvelt, Jelmer M. Wolterink, Tim Leiner, Max A. Viergever, and Ivana Isgum. A recurrent cnn for automatic detection and classification of coronary artery plaque and stenosis in coronary ct angiography.IEEE Transactions on Medical Imaging, 38(7):1...

    2019

  4. [12]

    Deeplearningpredictscardiovascular disease risks from lung cancer screening low dose computed tomography.Nature Communications, 12(1), May 2021

    Hanqing Chao, Hongming Shan, Fatemeh Homayounieh, Ramandeep Singh, Ruhani Doda Khera, Hengtao Guo, TimothySu, GeWang, MannudeepK.Kalra, andPingkunYan. Deeplearningpredictscardiovascular disease risks from lung cancer screening low dose computed tomography.Nature Communications...

    2021

  5. [13]

    Majd Zreik, Robbert W Van Hamersvelt, Nadieh Khalili, Jelmer M Wolterink, Michiel Voskuil, Max A Viergever, Tim Leiner, and Ivana Išgum. Deep learning analysis of coronary arteries in cardiac ct angiography for detection of patients requiring invasive coronary angiography.IEEE...

    2019

  6. [14]

    Deep learning for automatic calcium scoring in ct: validation using multiple cardiac ct and chest ct protocols

    Sanne GM van Velzen, Nikolas Lessmann, Birgitta K Velthuis, Ingrid EM Bank, Desiree HJG van den Bongard, Tim Leiner, Pim A de Jong, Wouter B Veldhuis, Adolfo Correa, James G Terry, et al. Deep learning for automatic calcium scoring in ct: validation using multiple cardiac ct a...

    2020

  7. [15]

    Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation

    Yaolei Qi, Yuting He, Xiaoming Qi, Yuan Zhang, and Guanyu Yang. Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 6070–6079, 2023

    2023

  8. [16]

    Coronary artery plaque characterization from ccta scans using deep learning and radiomics

    Felix Denzinger, Michael Wels, Nishant Ravikumar, Katharina Breininger, Anika Reidelshöfer, Joachim Eckert, Michael Sühling, Axel Schmermund, and Andreas Maier. Coronary artery plaque characterization from ccta scans using deep learning and radiomics. InMedical Image Computing...

    2019

  9. [17]

    Integrated prediction of lesion-specific ischaemia from quantitative coronary ct angiography using machine learning: a multicentre study

    DaminiDey, SaraGaur, KristianAOvrehus, PiotrJSlomka, JulianBetancur, MarkusGoeller, MichaelaM Hell, Heidi Gransar, Daniel S Berman, Stephan Achenbach, et al. Integrated prediction of lesion-specific ischaemia from quantitative coronary ct angiography using machine learning: a ...

    2018

  10. [18]

    Artificial intelligence and digital pathology: challenges and opportunities

    Hamid Reza Tizhoosh and Liron Pantanowitz. Artificial intelligence and digital pathology: challenges and opportunities. Journal of Pathology Informatics, 9(1):38, 2018

    2018

  11. [19]

    Annotation-efficientdeeplearningforautomaticmedicalimagesegmentation

    Shanshan Wang, Cheng Li, Rongpin Wang, Zaiyi Liu, Meiyun Wang, Hongna Tan, Yaping Wu, Xinfeng Liu, HuiSun, RuiYang, etal. Annotation-efficientdeeplearningforautomaticmedicalimagesegmentation. Nature Communications, 12(1):5915, 2021

    2021

  12. [20]

    Real world federated learning with a knowledge distilled transformer for cardiac ct imaging.npj Digital Medicine, 8(1):88, 2025

    Malte Tölle, Philipp Garthe, Clemens Scherer, Jan Moritz Seliger, Andreas Leha, Nina Krüger, Stefan Simm, Simon Martin, Sebastian Eble, Halvar Kelm, et al. Real world federated learning with a knowledge distilled transformer for cardiac ct imaging.npj Digital Medicine, 8(1):88, 2025

    2025

  13. [21]

    Domain adaptation for medical image analysis: a survey.IEEE Transactions on Biomedical Engineering, 69(3):1173–1185, 2021

    Hao Guan and Mingxia Liu. Domain adaptation for medical image analysis: a survey.IEEE Transactions on Biomedical Engineering, 69(3):1173–1185, 2021

    2021

  14. [22]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervision. InInternational Conf...

    2021

  15. [23]

    Scaling up visual and vision-language representation learning with noisy text supervision

    Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc Le, Yun-Hsuan Sung, Zhen Li, and Tom Duerig. Scaling up visual and vision-language representation learning with noisy text supervision. In International Conference on Machine Learning, pages 4904–4916....

    2021

  16. [24]

    Flava: A foundational language and vision alignment model

    Amanpreet Singh, Ronghang Hu, Vedanuj Goswami, Guillaume Couairon, Wojciech Galuba, Marcus Rohrbach, and Douwe Kiela. Flava: A foundational language and vision alignment model. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15638–15650, 2022

    2022

  17. [25]

    Nirschl, Joel Neal, Maximilian Diehn, Sen Yang, and Ruijiang Li

    Jinxi Xiang, Xiyue Wang, Xiaoming Zhang, Yinghua Xi, Feyisope Eweje, Yijiang Chen, Yuchen Li, Colin Bergstrom, Matthew Gopaulchan, Ted Kim, Kun-Hsing Yu, Sierra Willens, Francesca Maria Olguin, Jeffrey J. Nirschl, Joel Neal, Maximilian Diehn, Sen Yang, and Ruijiang Li. A visio...

    2025

  18. [26]

    Lu, Bowen Chen, Drew F

    Ming Y. Lu, Bowen Chen, Drew F. K. Williamson, Richard J. Chen, Ivy Liang, Tong Ding, Guillaume Jaume, Igor Odintsov, Long Phi Le, Georg Gerber, Anil V. Parwani, Andrew Zhang, and Faisal Mahmood. A visual-language foundation model for computational pathology.Nature Medicine, 3...

  19. [27]

    Montine, and James Zou

    Zhi Huang, Federico Bianchi, Mert Yuksekgonul, Thomas J. Montine, and James Zou. A visual–language foundation model for pathology image analysis using medical twitter.Nature Medicine, 29(9):2307–2316, August 2023. ISSN 1546-170X

    2023

  20. [28]

    Knowledge-enhanced visual- language pre-training on chest radiology images

    Xiaoman Zhang, Chaoyi Wu, Ya Zhang, Weidi Xie, and Yanfeng Wang. Knowledge-enhanced visual- language pre-training on chest radiology images. Nature Communications, 14(1), July 2023. ISSN 2041-1723

    2023

  21. [29]

    Enhancing representation in radiography-reports foundation model: a gran- ular alignment algorithm using masked contrastive learning.Nature Communications, 15(1), September

    Weijian Huang, Cheng Li, Hong-Yu Zhou, Hao Yang, Jiarun Liu, Yong Liang, Hairong Zheng, Shaoting Zhang, and Shanshan Wang. Enhancing representation in radiography-reports foundation model: a gran- ular alignment algorithm using masked contrastive learning.Nature Communications...

  22. [30]

    Generalized radiograph representation learning via cross-supervision between images and free-text radiology reports

    Hong-Yu Zhou, Xiaoyu Chen, Yinghao Zhang, Ruibang Luo, Liansheng Wang, and Yizhou Yu. Generalized radiograph representation learning via cross-supervision between images and free-text radiology reports. Nature Machine Intelligence, 4(1):32–40, January 2022. ISSN 2522-5839

    2022

  23. [31]

    Medklip: Medical knowledge enhanced language-image pre-training for x-ray diagnosis

    Chaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang, and Weidi Xie. Medklip: Medical knowledge enhanced language-image pre-training for x-ray diagnosis. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 21372–21383, October 2023

    2023

  24. [32]

    Kevin Zhou

    Haoran Lai, Qingsong Yao, Zihang Jiang, Rongsheng Wang, Zhiyang He, Xiaodong Tao, and S. Kevin Zhou. Carzero: Cross-attention alignment for radiology zero-shot classification. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11137–1114...

    2024

  25. [33]

    Medclip: Contrastive learning from unpaired medical images and text

    Zifeng Wang, Zhenbang Wu, Dinesh Agarwal, and Jimeng Sun. Medclip: Contrastive learning from unpaired medical images and text. InProceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2022

    2022

  26. [34]

    Gadgil, Alex J

    Chanwoo Kim, Soham U. Gadgil, Alex J. DeGrave, Jesutofunmi A. Omiye, Zhuo Ran Cai, Roxana Daneshjou, and Su-In Lee. Transparent medical image ai via an image–text foundation model grounded in medical literature.Nature Medicine, 30(4):1154–1165, April 2024. ISSN 1546-170X

    2024

  27. [35]

    Pre-trained multimodal large language model enhances dermatological diagnosis using skingpt-4.Nature Communications, 15(1), July 2024

    Juexiao Zhou, Xiaonan He, Liyuan Sun, Jiannan Xu, Xiuying Chen, Yuetan Chu, Longxi Zhou, Xingyu Liao, Bin Zhang, Shawn Afvari, and Xin Gao. Pre-trained multimodal large language model enhances dermatological diagnosis using skingpt-4.Nature Communications, 15(1), July 2024. IS...

    2024

  28. [36]

    Merlin: A vision language foundation model for 3d computed tomography.Research Square, pages rs–3, 2024

    Louis Blankemeier, Joseph Paul Cohen, Ashwin Kumar, Dave Van Veen, Syed Jamal Safdar Gardezi, Magdalini Paschali, Zhihong Chen, Jean-Benoit Delbrouck, Eduardo Reis, Cesar Truyts, et al. Merlin: A vision language foundation model for 3d computed tomography.Research Square, page...

    2024

  29. [37]

    Developing generalist foundation models from a multimodal dataset for 3d computed tomography, 2024

    Ibrahim Ethem Hamamci, Sezgin Er, Furkan Almas, Ayse Gulnihan Simsek, Sevval Nil Esirgun, Irem Dogan, Muhammed Furkan Dasdelen, Omer Faruk Durugol, Bastian Wittmann, Tamaz Amiranashvili, Enis Simsar, Mehmet Simsar, Emine Bensu Erdemir, Abdullah Alanbay, Anjany Sekuboyina, Berk...

    2024

  30. [38]

    M3d: Advancing 3d medical image analysis with multi-modal large language models.arXiv preprint arXiv:2404.00578, 2024

    Fan Bai, Yuxin Du, Tiejun Huang, Max Q-H Meng, and Bo Zhao. M3d: Advancing 3d medical image analysis with multi-modal large language models.arXiv preprint arXiv:2404.00578, 2024

    2024 arXiv

  31. [39]

    Weiwei Cao, Jianpeng Zhang, Yingda Xia, Tony C. W. Mok, Zi Li, Xianghua Ye, Le Lu, Jian Zheng, Yuxing Tang, and Ling Zhang. Bootstrapping chest ct image understanding by distilling knowledge from x-ray expert models. InProceedings of the IEEE/CVF Conference on Computer Vision ...

    2024

  32. [40]

    Pmc- clip: Contrastive language-image pre-training using biomedical documents

    Weixiong Lin, Ziheng Zhao, Xiaoman Zhang, Chaoyi Wu, Ya Zhang, Yanfeng Wang, and Weidi Xie. Pmc- clip: Contrastive language-image pre-training using biomedical documents. InInternational Conference on Medical Image Computing and Computer-Assisted Intervention, pages 525–536. S...

    2023

  33. [41]

    Multi-modal Masked Autoencoders for Medical Vision-and-Language Pre-training, pages 679–689

    Zhihong Chen, Yuhao Du, Jinpeng Hu, Yang Liu, Guanbin Li, Xiang Wan, and Tsung-Hui Chang. Multi-modal Masked Autoencoders for Medical Vision-and-Language Pre-training, pages 679–689. Springer Nature Switzerland, 2022. ISBN 9783031164439

    2022

  34. [42]

    Chia, Siegfried K

    Yukun Zhou, Mark A. Chia, Siegfried K. Wagner, Murat S. Ayhan, Dominic J. Williamson, Robbert R. Struyven, Timing Liu, Moucheng Xu, Mateo G. Lozano, Peter Woodward-Court, Yuka Kihara, Naomi Allen, John E. J. Gallacher, Thomas Littlejohns, Tariq Aslam, Paul Bishop, Graeme Black...

    2023

  35. [43]

    Reduced lung-cancer mortality with low-dose computed tomographic screening.New England Journal of Medicine, 365(5):395–409, August 2011

    null null. Reduced lung-cancer mortality with low-dose computed tomographic screening.New England Journal of Medicine, 365(5):395–409, August 2011. ISSN 1533-4406

    2011

  36. [44]

    Masked autoencoders are scalable vision learners

    Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollar, and Ross Girshick. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, June 2022

    2022

  37. [45]

    Self-distillation: Towards efficient and compact neural networks

    Linfeng Zhang, Chenglong Bao, and Kaisheng Ma. Self-distillation: Towards efficient and compact neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(8):4388–4403, 2021

    2021

  38. [46]

    Lin Wang and Kuk-Jin Yoon. Knowledge distillation and student-teacher learning for visual intelligence: A review and new outlooks.IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6): 3048–3068, 2021

    2021

  39. [47]

    Hierarchical self-distilled feature learning for fine-grained visual categorization.IEEE Transactions on Neural Networks and Learning Systems, 2021

    Yutao Hu, Xiaolong Jiang, Xuhui Liu, Xiaoyan Luo, Yao Hu, Xianbin Cao, Baochang Zhang, and Jun Zhang. Hierarchical self-distilled feature learning for fine-grained visual categorization.IEEE Transactions on Neural Networks and Learning Systems, 2021

    2021

  40. [48]

    Acute coronary syndromes.The Lancet, 399(10332):1347–1358, 2022

    Brian A Bergmark, Njambi Mathenge, Piera A Merlini, Marilyn B Lawrence-Wright, and Robert P Giugliano. Acute coronary syndromes.The Lancet, 399(10332):1347–1358, 2022

    2022

  41. [49]

    Machine learning-based prediction of acute coronary syndrome using only the pre-hospital 12-lead electrocardiogram.Nature Communications, 11(1):3966, 2020

    Salah Al-Zaiti, Lucas Besomi, Zeineb Bouzid, Ziad Faramand, Stephanie Frisch, Christian Martin-Gill, Richard Gregg, Samir Saba, Clifton Callaway, and Ervin Sejdić. Machine learning-based prediction of acute coronary syndrome using only the pre-hospital 12-lead electrocardiogra...

    2020

  42. [50]

    Brian S Ko, James D Cameron, Ravi K Munnur, Dennis TL Wong, Yasuko Fujisawa, Takuya Sakaguchi, Kenji Hirohata, Jacqui Hislop-Jambrich, Shinichiro Fujimoto, Kazuhisa Takamura, et al. Noninvasive ct-derived ffr based on structural and fluid analysis: a comparison with invasive f...

    2017

  43. [51]

    Distilling the knowledge in a neural network.arXiv preprint arXiv:1503.02531, 2015

    Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. Distilling the knowledge in a neural network.arXiv preprint arXiv:1503.02531, 2015

    2015 arXiv

  44. [52]

    Knowledge distillation meets self-supervision

    Guodong Xu, Ziwei Liu, Xiaoxiao Li, and Chen Change Loy. Knowledge distillation meets self-supervision. In Proceedings of the European Conference on Computer Vision, pages 588–604. Springer, 2020

    2020

  45. [53]

    Diagnos- tic accuracy of fractional flow reserve from anatomic ct angiography.Jama, 308(12):1237–1245, 2012

    James K Min, Jonathon Leipsic, Michael J Pencina, Daniel S Berman, Bon-Kwon Koo, Carlos Van Mieghem, Andrejs Erglis, Fay Y Lin, Allison M Dunning, Patricia Apruzzese, et al. Diagnos- tic accuracy of fractional flow reserve from anatomic ct angiography.Jama, 308(12):1237–1245, 2012

    2012

  46. [54]

    Quantification of coronary artery calcium using ultrafast computed tomography.Journal of the American College of Cardiology, 15(4):827–832, 1990

    Arthur S Agatston, Warren R Janowitz, Frank J Hildner, Noel R Zusmer, Manuel Viamonte Jr, and Robert Detrano. Quantification of coronary artery calcium using ultrafast computed tomography.Journal of the American College of Cardiology, 15(4):827–832, 1990

    1990

  47. [55]

    Harvey S Hecht, Paul Cronin, Michael J Blaha, Matthew J Budoff, Ella A Kazerooni, Jagat Narula, David Yankelevitz, and Suhny Abbara. 2016 scct/str guidelines for coronary artery calcium scoring of noncontrast noncardiac chest ct scans: a report of the society of cardiovascular...

    2016

  48. [56]

    Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers

    Hila Chefer, Shir Gur, and Lior Wolf. Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers. InProceedings of the IEEE/CVF international conference on computer vision, pages 397–406, 2021

    2021

  49. [57]

    Gpt-4o system card.arXiv preprint arXiv:2410.21276, 2024

    Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al. Gpt-4o system card.arXiv preprint arXiv:2410.21276, 2024

    2024 arXiv

  50. [58]

    An image is worth 16x16 words: Transformers for image recognition at scale.arXiv preprint arXiv:2010.11929, 2020

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale.arXiv preprint arXiv:...

    2010 arXiv

  51. [59]

    Bert: Pre-training of deep bidirectional transformers for language understanding

    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. InProceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human langua...

    2019

  52. [60]

    Domain-specific language model pretraining for biomedical natural language processing

    Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, and Hoifung Poon. Domain-specific language model pretraining for biomedical natural language processing. ACM Transactions on Computing for Healthcare, 3(1):1–23, 2021. |23

    2021

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.