Pith. sign in

REVIEW 4 major objections 5 minor 188 references

Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research

T0 review · 4 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Pith's one-line read This review systematically maps 86 foundation models and 161 datasets for brain imaging and identifies the leading models per task, the first consolidated survey of the field.

desk verdict A useful first map of brain imaging foundation models with an honest limitations section; the model rankings are illustrative rather than authoritative. read the letter →

arxiv 2506.13306 v1 pith:QNZDAAKG submitted 2025-06-16 eess.IV cs.CV

classification eess.IVcs.CV
keywords brainimagingdeeplearningfoundationmodelscancerneurodegenerativediseasesneurovascularsystematicreviewbenchmarking
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims to be the first systematic review devoted entirely to foundation models for brain imaging, spanning 161 datasets and 86 model architectures. It maps the field's design choices, training strategies, and tasks, and then tries to identify which models lead on each major benchmark. The payoff for a reader is a consolidated atlas of a scattered literature: it shows where brain foundation models have concentrated effort (MRI-based cancer segmentation), where they have neglected available data (PET imaging, mental-health conditions), and where evaluation is too inconsistent to support confident comparisons. If the review is right, it gives both clinicians and machine learning researchers a shared starting point and a list of blind spots to fix.

What carries the argument

Two devices carry the analysis. First, a tournament graph of reported performance: a directed edge from model A to model B means B beat A in at least one publication, and 'green' nodes mark peer-reviewed models with over 50 citations that no surveyed approach has yet outperformed; this is what produces the lists of leading models. Second, benchmark tables that line up self-reported scores on the few common testbeds — BraTS for segmentation and VQA-RAD for question answering — where the review can compare variants side by side. The inclusion criterion that defines a foundation model (training on at least two imaging modalities, two organs, or two brain pathologies) is what lets the review sweep in the 86 architectures in the first place.

What would settle it

Re-run the models the review crowns as leaders (e.g., MoME, BrainSegFounder, Med-VLP, MUMC, RadFM) on one shared benchmark — BraTS 2021 for segmentation and VQA-RAD for question answering — under identical preprocessing and metrics; if the tournament order changes materially, the paper's 'best model' conclusions fail.

Watch

Extended reading notes

Core claim

The central discovery the authors claim is that brain imaging foundation models now form a recognizable but uneven research field: 86 architectures, most built on a handful of backbones (SAM, CLIP, U-Net, BERT), with a burst of growth after 2023. On benchmarks, the review crowns specific leaders — MoME and BrainSegFounder on BraTS segmentation, Med-VLP and MUMC on VQA-RAD question answering, RadFM among generative multimodal systems — while cautioning that the comparisons inherit whatever datasets and metrics the original papers chose. It also documents structural problems: about six percent of 3D imaging studies are duplicates or derivatives, creating leakage risk; only six models address demographic bias; only seven include human evaluation; and pathology coverage in models diverges from both disease prevalence and dataset availability. The authors therefore frame the review as a snapshot and a call for standardized benchmarks, broader pathology coverage, and clinically grounded evaluation.

Load-bearing premise

The rankings assume that the numbers reported by different papers, measured on different dataset versions and with different metrics, can be compared side by side; the paper itself concedes in Section 8 that the synthesis relies entirely on published claims.

Editorial extensions

If this is right

  • Researchers can use the 161-dataset, 86-model atlas as an entry point when choosing backbones and benchmarks for a new brain imaging project.
  • The tournament singles out a short list of leaders (such as MoME and BrainSegFounder for segmentation, Med-VLP and MUMC for question answering) that new methods should be compared against.
  • The finding that about six percent of 3D imaging studies come from duplicate datasets warns that multi-dataset training should include explicit deduplication to avoid leakage.
  • The scarcity of standardized benchmarks, with no dataset used by more than five models outside the two dominant ones, implies that the field needs shared evaluation protocols before progress becomes measurable.
  • Because only seven of 86 models included any human expert evaluation, clinical translation claims rest on algorithmic metrics that may not reflect diagnostic utility.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A fair side-by-side re-evaluation on fixed splits could reshuffle the tournament leaders, since the ranking is built from heterogeneous self-reported numbers; the paper's method naturally extends into a living leaderboard.
  • The mismatch between pathology prevalence and model coverage suggests that future dataset contributions (e.g., PET and mental-health cohorts) may advance the field more than new architectures.
  • The bias-aware practices of the six models that address demographic balance provide a testable template: requiring stratified performance reporting for every brain FM would let the field verify fairness claims.
  • The inclusion criteria treat models trained on two modalities, organs, or pathologies as foundation models, so the review's 'foundation model' category spans very different scales; separating genuinely large pretrained systems from smaller multi-task models might change the conclusions.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. This manuscript is a systematic literature review of foundation models (FMs) applied to brain imaging. Following a PRISMA-based protocol (Section 3), the authors screened 541 records from Semantic Scholar, Crossref, and PubMed, augmented the list via surveys and snowballing, and included 86 FM architectures and 161 brain imaging datasets in their analysis. The review maps general trends (publication timeline, venues, code availability), architectural choices (backbones, encoders), training strategies (contrastive/masked learning, adapters/LoRA, MoE), task and pathology coverage, and a dataset inventory with modality, license, and deduplication statistics. It also proposes a 'tournament' approach (Section 6.1) and benchmark tables (Tables 2-3) to identify the best-performing models per task, and discusses pitfalls including bias, pathology imbalance, and evaluation weaknesses. The central claims are that this is the first comprehensive curated review of brain-imaging FMs, that it systematically analyzes 161 datasets and 86 model architectures, and that it highlights the leading models for each task.

Significance. If the inventory and trend analysis are accurate, the paper provides a valuable consolidated map of an active, fast-moving field. The dataset analysis—covering deduplication, licensing, anonymization, modality and pathology distribution—is particularly useful, as is the model analysis of backbone reliance, parameter-efficient fine-tuning, and task coverage. The explicit search protocol and the public interactive atlas on Notion are strengths that support reproducibility and updateability. However, the leaderboard component is not yet methodologically reliable: the tournament and benchmark tables rank models across different BraTS versions, different metric types (ACC vs F1 vs BERT similarity), and different evaluation conditions, using self-reported numbers. The paper itself concedes this in Section 8 ('our synthesis relies entirely on the figures and claims reported in the reviewed literature'), yet the 'best model' statements remain a prominent contribution. The citation-based 'not outperformed' criterion in Section 6.1 is defensible only as a literature-status snapshot, not as a performance ranking.

major comments (4)
  1. [Section 6.2, Table 2] The statement 'The results show that the best performing models are MoME and BrainSegFounder' is inconsistent with the numbers in Table 2, where MAE-Seg Africa24 (92.90) and OBJ-SAM (91.90) report higher DICE scores than either MoME (92.10) or BrainSegFounder (91.15). The caveats listed in the text (missing contrasts, small training subsets, population shift) do not explain the omission of MAE-Seg and OBJ-SAM from the 'best' designation, nor is any explicit exclusion criterion given. Please specify the exact inclusion and exclusion rules for the leaderboard (e.g., benchmark version, full-contrast evaluation, metric type) and apply them consistently to all rows of the table.
  2. [Section 6.2, Table 3 and Section 6.1] The rankings mix incomparable quantities. In Table 3, most rows report Accuracy, but RadFM and Med-PaLMM report F1, Med-Flamingo reports a BERT similarity score, and LLaVA-Med's open-ended column is Recall; in Table 2, BraTS versions from 2013 through 2024 are combined, and the text notes that some DICE values were converted from AUC. Ranking these together and then asserting which model is 'best' (e.g., 'Med-VLP achieving the best accuracy', 'MUMC achieving the best performance', 'RadFM achieving the best score of 78.09') is not methodologically sound. Because the identification of leading models is a central contribution (Abstract, Section 1, Section 6), please either (a) restrict all leaderboard claims to same-version, same-metric comparisons, (b) present the tables without any cross-metric 'best' statements, or (c) add a sensitivity analysis that omits non-comparable entries and shows whether the rankings are stable.
  3. [Section 3.1] The text says 'We restrict our research to the last 5 years' for the database search on 18 February 2025, which would exclude papers from 2019. Yet Section 4.1 includes Genesis and Med3D, both published in 2019, as the first models in scope. This is presumably because the augmentation step (surveys and snowballing) was not time-restricted, but the manuscript does not say so. Please state explicitly that the five-year window applies only to the database query and not to the augmentation/snowballing step, and adjust the wording in Section 4.1 accordingly.
  4. [Section 8 and Section 3] The single-reviewer screening is disclosed in the Limitations section, but Section 3 claims adherence to PRISMA 2020, which recommends at least two independent reviewers for screening. This deviation is load-bearing for the reliability of the included-study list. Please move or repeat the disclosure in the Methodology section, describe any mitigation (e.g., verification of a random subset by a second author), and discuss the potential impact of screening bias on the final set of 86 included models.
minor comments (5)
  1. [Section 4.2] The sentence 'Among the 32 vision-language brain FMs included in our study, 34% are based on CLIP [167, 42, 86, 40, 17, 122, 118, 70]' is arithmetically inconsistent with the cited list, which contains 8 items: 8/32 is 25%, not 34%. Please correct this percentage and audit nearby percentages in Section 4 for consistency.
  2. [Figures 2 and 3] The captions for Fig. 2 ('Cumulative number of FMs publications over the years') and Fig. 3 ('Most cited FM over the time period') appear to be mismatched with their content: the text around Fig. 2 discusses cumulative publication counts, while Fig. 3 shows a task-distribution chart that resembles Fig. 7. Please verify all figure-caption pairings.
  3. [Section 3.3] The word 'interative' should be 'interactive'. In addition, the Notion links are hosted on a third-party platform; given the review's reproducibility claims, consider archiving the interactive atlas (e.g., in Zenodo or as a supplementary PDF) so the data behind Tables 1-3 remains accessible.
  4. [Section 6.2] The text states that DICE scores were 'converted from AUC if the original only uses AUC metrics', but no conversion formula or reference is provided. AUC-to-DICE conversion is not a standard, well-defined operation; please either justify it with a citation or remove the converted entries from the leaderboard.
  5. [Global] Several typos and grammatical slips should be corrected in a final pass: 'metholodgy' (Section 3), 'keywods' and 'thee' (Section 3.1), 'anomymization' (Sections 5.2 and 8), 'Traditionnaly' (Section 7.1), 'dependant' (Section 4.2), 'speciliaized' (Section 7.2), and 'demyelating' (Section 5.2).

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the review's rankings and counts are aggregations of external literature, not quantities derived from this paper's own inputs.

full rationale

This is a systematic review, not a derivation chain. Its central outputs are curated counts (161 datasets, 86 models) and qualitative/ranking summaries. The only formal equations reproduced in the paper—LoRA's Delta-W = BA (Eq. 1-2), MoE gating (Eq. 3-4), and TCT (Eq. 5)—are quoted from external prior work ([56], [77], [41]) and are not used to derive the review's conclusions. The 'best model' identifications in Section 6 are obtained by aggregating self-reported evaluation figures from the surveyed papers, as the paper openly states: 'In both cases, we are relying on the empirical evaluation in the respective works' (Section 6), and Section 8 concedes 'Our synthesis relies entirely on the figures and claims reported in the reviewed literature...'. This is an input-to-output summarization of external results, not a fit-then-predict loop, so no quantity is constructed from itself. Some background citations are self-citations (e.g., [15], [48], [64], [65], [72], [106], [112], [168]), but they support generic statements about the importance of brain imaging or about ML bias and are not load-bearing for the inclusion criteria, dataset inventory, or model rankings. No uniqueness theorem or author-derived constraint is invoked to force any choice. The paper's own limitations about metric incomparability and single-reviewer screening weaken the strength of the rankings, but those are evidence-quality and reproducibility concerns, not circularity. Therefore the appropriate finding is no significant circularity.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The review carries no fitted constants. Its conclusions rest on three assumptions: an inclusion rule for what counts as a brain FM, trust in self-reported performance numbers, and citation counts as a proxy for impact. All three are stated or acknowledged in the paper in Sections 2.3, 6, and 8, and all three limit how much of the central map should be taken at face value.

assumptions (3)
  • ad hoc to paper Definition of 'foundation model' as models trained on at least two imaging modalities, two organs, or two pathologies (Section 2.3)
    This inclusion rule determines the entire corpus of 86 models; it is broader than Bommasani's definition and excludes organ-specific single-pathology models the authors might consider non-foundational.
  • domain assumption Google Scholar citation counts reflect impact (Section 5.1, Table 1 footnote and Figure 3)
    Used to rank models and datasets; citation counts are noisy, time-dependent, and not a direct measure of scientific quality.
  • domain assumption Self-reported evaluation numbers in the surveyed papers are accurate and comparable (Section 6), even though Section 8 warns they may not be
    The tournament and benchmark tables are built by comparing metrics reported in different papers with different dataset versions and metrics, e.g., ACC vs F1 vs BERT score in Table 3.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research." pith.science (2026). https://pith.science/paper/QNZDAAKG

@misc{pith2026250613306,
  author       = {Pith},
  title        = {Pith review of: Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/QNZDAAKG}},
  note         = {Machine review of arXiv:2506.13306}
}
read the original abstract

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled data. Although numerous surveys have reviewed the application of FM in healthcare care, brain imaging remains underrepresented, despite its critical role in the diagnosis and treatment of neurological diseases using modalities such as MRI, CT, and PET. Existing reviews either marginalize brain imaging or lack depth on the unique challenges and requirements of FM in this domain, such as multimodal data integration, support for diverse clinical tasks, and handling of heterogeneous, fragmented datasets. To address this gap, we present the first comprehensive and curated review of FMs for brain imaging. We systematically analyze 161 brain imaging datasets and 86 FM architectures, providing information on key design choices, training paradigms, and optimizations driving recent advances. Our review highlights the leading models for various brain imaging tasks, summarizes their innovations, and critically examines current limitations and blind spots in the literature. We conclude by outlining future research directions to advance FM applications in brain imaging, with the aim of fostering progress in both clinical and research settings.

Figures

Figures reproduced from arXiv: 2506.13306 by the authors.

Figure 1
Figure 1. Prisma Methodology followed in our SLR. The databases and registries are Scholar, Crossref, and PubMed; The other methods include [PITH_FULL_IMAGE:figures/full_fig_p006_1.png] view at source ↗
Figure 2
Figure 2. Cumulative number of FMs publications over the years [PITH_FULL_IMAGE:figures/full_fig_p007_2.png] view at source ↗
Figure 3
Figure 3. Most cited FM over the time period while the most cited publication in a conference tops at 698 citations (avg 84.03, median 37.5), and the most cited publication in a journal reaches 1433 citations (avg 131.88, median 11). The relative similarity of metrics between venues hints that very high impact in terms of citations can be achieved undifferentiable through jour￾nals, conferences, and preprints, which suggests … view at source ↗
Figures from the paper (10 more)
Figure 4
Figure 4. Figure 4: Distribution of venues ML; 19 Medical Imaging; 17 Health; 6 Computer Vision 8 General; 34 [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Distribution of communities license [4], 16 under the Apache 2.0 license [1], three under the GNU GPL license [3], and three un￾der Creative Commons Attribution Noncommercial li￾censes [2]. Lava-Med is under the Microsoft Research License that restricts commercial appl…
Figure 6
Figure 6. Figure 6: Mindmap of Training Techniques of FMs were published along models, and the count may re￾flect the interest of both the dataset and the model (on 01/04/2025). 9/15 of the 2d imaging datasets are multimodal datasets, with medical images and associated text data: figure c…
Figure 7
Figure 7. Figure 7: Distribution of tasks. The dashed tasks with red borders are [PITH_FULL_IMAGE:figures/full_fig_p011_7.png]
Figure 8
Figure 8. Figure 8: Distribution of pathologies in the Foundation Models. [PITH_FULL_IMAGE:figures/full_fig_p011_8.png]
Figure 10
Figure 10. Figure 10: Number of datasets per imaging modality and sequences. [PITH_FULL_IMAGE:figures/full_fig_p012_10.png]
Figure 9
Figure 9. Figure 9: Mindmap of 3D Brain MRI datasets split by pathologies. In parentheses the total number of studies of the datasets [PITH_FULL_IMAGE:figures/full_fig_p013_9.png]
Figure 11
Figure 11. Figure 11: Best Multimodal Foundation Models by tournament. In orange and green are the FM models covered, and in green are the best. A [PITH_FULL_IMAGE:figures/full_fig_p015_11.png]
Figure 12
Figure 12. Figure 12: Best 2D vision-only foundation models by tournament. In orange and green are the FM models covered, and in green are the best. A [PITH_FULL_IMAGE:figures/full_fig_p015_12.png]
Figure 13
Figure 13. Figure 13: Best 3D vision-only foundation models by tournament. In orange and green are the FM models covered, and in green are the best. A [PITH_FULL_IMAGE:figures/full_fig_p016_13.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

188 extracted references · 28 canonical work pages

  1. [1]

    Accessed: 2025-06-08

    Apache license, version 2.0.https://www.ap ache.org/licenses/LICENSE- 2.0, 2004. Accessed: 2025-06-08

  2. [2]

    Accessed: 2025-06-08

    Creative commons attribution noncommercial li- censes.https://wiki.creativecommons.o rg/wiki/Recommended_practices_for_at tribution, 2024. Accessed: 2025-06-08

  3. [3]

    Accessed: 2025-06-08

    Gnu general public license.https://en.wikip edia.org/wiki/GNU_General_Public_Lic ense, 2025. Accessed: 2025-06-08

  4. [4]

    Accessed: 2025-06- 08

    Mit license.https://en.wikipedia.org/w iki/MIT_License, 2025. Accessed: 2025-06- 08

  5. [5]

    Achey et al

    Rebecca L. Achey et al. Incidence and real- world burden of brain metastases from solid tu- mors.Journal of Clinical Oncology, 40(12): 1345–1355, 2022. doi: 10.1200/JCO.21.02783

  6. [6]

    Wang, Rachit Saluja, Heejong Kim, Xinzi He, Adrian V

    Alan Q. Wang, Rachit Saluja, Heejong Kim, Xinzi He, Adrian V . Dalca, and M. Sabuncu. BrainMorph: A Foundational Keypoint Model for Robust and Flexible Brain MRI Registration

  7. [7]

    Effectiveness of radiology modalities in diagnosing and characterizing brain disorders

    Sadeem Aljahdali, Ghofran Azim, Waad Zabani, Saeed Bafaraj, Jaber Alyami, and Ahmed Ab- duljabbar. Effectiveness of radiology modalities in diagnosing and characterizing brain disorders. Neurosciences Journal, 29(1):37–43, 2024

  8. [8]

    MedicoSAM: Towards foundation models for medical image segmentation, January 2025

    Anwai Archit, Luca Freckmann, and Constantin Pape. MedicoSAM: Towards foundation models for medical image segmentation, January 2025. URLhttp://arxiv.org/abs/2501.11734. arXiv:2501.11734 [eess]

Show all 188 references
  1. [9]

    FLAP-SAM: A Federated Learning-Friendly Approach for Parameter-Efficient Fine-Tuning of SAM in 3D Segmentation, July 2024

    Mothilal Asokan, Joseph Geo Benjamin, Mo- hammad Yaqub, and Karthik Nandakumar. FLAP-SAM: A Federated Learning-Friendly Approach for Parameter-Efficient Fine-Tuning of SAM in 3D Segmentation, July 2024. URL h t tp : / / a r x i v . o r g / a b s / 2 4 0 7 . 2 1 7 39. arXiv:240...

  2. [10]

    Foundational Mod- els in Medical Imaging: A Comprehensive Sur- vey and Future Vision, October 2023

    Bobby Azad, Reza Azad, Sania Eskandari, Af- shin Bozorgpour, Amirhossein Kazerouni, Islem Rekik, and Dorit Merhof. Foundational Mod- els in Medical Imaging: A Comprehensive Sur- vey and Future Vision, October 2023. URL h t tp : / / a r x i v . o r g / a b s / 2 3 1 0 . 1 8 6 8...

  3. [11]

    shortcuts

    Imon Banerjee, Kamanasish Bhattachar- jee, John L Burns, Hari Trivedi, Saptarshi Purkayastha, Laleh Seyyed-Kalantari, Bhavik N Patel, Rakesh Shiradkar, and Judy Gichoya. “shortcuts” causing bias in radiology artificial intelligence: causes, evaluation, and mitigation. Journal ...

  4. [12]

    A. et al. Ben Abacha. Vqa-med: Overview of the medical visual question answering task. InCLEF Working Notes, 2019

  5. [13]

    Artificial intelligence in medi- cal imaging: From task-specific models to large- scale foundation models.Chinese Medical Jour- nal, 138, 3 2025

    Yueyan Bian, Jin Li, Chuyang Ye, Xiuqin Jia, and Qi Yang. Artificial intelligence in medi- cal imaging: From task-specific models to large- scale foundation models.Chinese Medical Jour- nal, 138, 3 2025. ISSN 25425641. doi: 10.109 7/CM9.0000000000003489/ASSET/A4CABCE 3-58F1-4B...

  6. [14]

    Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S

    Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, An- toine Bosselut, Emma Brunskill, et al. On the op- portunities and risks of foundation models.arXiv preprint arXiv:2108.07258, 2021

  7. [16]

    Sabuncu, John Guttag, and Adrian V

    Victor Ion Butoi, Jose Javier Gonzalez Ortiz, Tianyu Ma, Mert R. Sabuncu, John Guttag, and Adrian V . Dalca. UniverSeg: Universal Med- ical Image Segmentation, April 2023. URL h t tp : / / a r x i v . o r g / a b s / 2 3 0 4 . 0 6 1 31. arXiv:2304.06131 [cs]

  8. [17]

    DCPL: Domain- Controlled Prompt Learning

    Qinglong Cao, Zhengqin Xu, Yuntian Chen, Chao Ma, and Xiaokang Yang. DCPL: Domain- Controlled Prompt Learning. 2024

  9. [18]

    AnatCL: Anatomical Foundation Models for Brain MRIs

    Carlo Alberto Barbano, Matteo Brunello, Benoit Dufumier, and Marco Grangetto. AnatCL: Anatomical Foundation Models for Brain MRIs

  10. [19]

    Med- SAM-Brain: How SAM Perceives Different mp- MRI Brain Tumor Domains? 2024

    Cecilia Diana-Albelda, Roberto Alcover-Couso, Álvaro García-Martín, and Jesús Bescós. Med- SAM-Brain: How SAM Perceives Different mp- MRI Brain Tumor Domains? 2024. doi: 10.110 9/CVPRW63382.2024.00501

  11. [20]

    doi: 10.48550/arXiv.2408.07079

  12. [21]

    MedBLIP: Bootstrapping Language- Image Pre-training from 3D Medical Images and Texts, May 2023

    Qiuhui Chen, Xinyue Hu, Zirui Wang, and Yi Hong. MedBLIP: Bootstrapping Language- Image Pre-training from 3D Medical Images and Texts, May 2023. URLhttp://arxiv.org/ab s/2305.10799. arXiv:2305.10799 [cs]

  13. [22]

    H. et al. Chen. Global burden of alzheimer’s dis- ease: a gbd 2021 study.Journal of Neurology,

  14. [23]

    M3AE: Multi-Modal Masked Autoen- coders for Medical Vision-and-Language Pre- Training, September 2022

    Zhihong Chen, Yuhao Du, Jinpeng Hu, Yang Liu, Guanbin Li, Xiang Wan, and Tsung-Hui Chang. M3AE: Multi-Modal Masked Autoen- coders for Medical Vision-and-Language Pre- Training, September 2022. URLhttp://arxi v.org/abs/2209.07098. arXiv:2209.07098 [cs]

  15. [24]

    Med-VLP: Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge, September 2022

    Zhihong Chen, Guanbin Li, and Xiang Wan. Med-VLP: Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge, September 2022. URLhttp://ar xiv.org/abs/2209.07118. arXiv:2209.07118 [cs]

  16. [25]

    Med3D: Transfer Learning for 3D Medical Im- age Analysis, July 2019

    Sihong Chen, Kai Ma, and Yefeng Zheng. Med3D: Transfer Learning for 3D Medical Im- age Analysis, July 2019. URLhttp://arxiv. org/abs/1904.00625. arXiv:1904.00625 [cs]

  17. [26]

    LaMiM: Medical image foundation models in assisting diagnosis of brain tumors: a pilot study

    Chen Mengyao, Zhang Meng, Yin Lijuan, Ma Lu, Ding Renxing, Zheng Tao, Yue Qiang, Lui 22 Su, and Sun Huaiqiang. LaMiM: Medical image foundation models in assisting diagnosis of brain tumors: a pilot study. 2024. doi: 10.1007/s003 30-024-10728-1

  18. [27]

    J. Cheng. Brain tumor dataset. Figshare, 2017. https://doi.org/10.6084/m9.figshare.1512427.v5

  19. [28]

    PTUnifier: To- wards Unifying Medical Vision-and-Language Pre-training via Soft Prompts, October 2023

    Zhihong Chen, Shizhe Diao, Benyou Wang, Guanbin Li, and Xiang Wan. PTUnifier: To- wards Unifying Medical Vision-and-Language Pre-training via Soft Prompts, October 2023. URLhttps://ieeexplore.ieee.org/do cument/10378529/

  20. [29]

    Heterogeneous lora for federated fine-tuning of on-device founda- tion models

    Yae Jee Cho, Luyang Liu, Zheng Xu, Aldi Fahrezi, and Gauri Joshi. Heterogeneous lora for federated fine-tuning of on-device founda- tion models. InProceedings of EMNLP, pages 12903–12913, 2024

  21. [30]

    Global burden of adhd: Gbd 2021 findings.Journal of Attention Disorders, 2025

    GBD 2021 ADHD Collaborators. Global burden of adhd: Gbd 2021 findings.Journal of Attention Disorders, 2025. URLhttps://www.health data.org/sites/default/files/methods _appendices/2021/nonfatal_cause_writ e_up_ADHD_updated_Feb_17.pdf

  22. [31]

    SAM-Med2D, August 2023

    Junlong Cheng, Jin Ye, Zhongying Deng, Jian- pin Chen, Tianbin Li, Haoyu Wang, Yanzhou Su, Ziyan Huang, Jilong Chen, Lei Jiang, Hui Sun, Junjun He, Shaoting Zhang, Min Zhu, and Yu Qiao. SAM-Med2D, August 2023. URL h t tp : / / a r x i v . o r g / a b s / 2 3 0 8 . 1 6 1 84. ar...

  23. [32]

    Global bur- den of epilepsy: Gbd 2021 analysis.The Lancet Public Health, 2025

    GBD 2021 Epilepsy Collaborators. Global bur- den of epilepsy: Gbd 2021 analysis.The Lancet Public Health, 2025. URLhttps://www.heal thdata.org/research-analysis/librar y/global-regional-and-national-burde n-epilepsy

  24. [33]

    Global burden of neurological disorders: a systematic analysis for the global burden of disease study 2021.The Lancet Neurology, 23(4):344–361,

    GBD 2021 Neurology Collaborators. Global burden of neurological disorders: a systematic analysis for the global burden of disease study 2021.The Lancet Neurology, 23(4):344–361,

  25. [34]

    Global epi- demiology of autism spectrum disorders.Molec- ular Autism, 2025

    GBD 2021 Autism Collaborators. Global epi- demiology of autism spectrum disorders.Molec- ular Autism, 2025. URLhttps://www.health data.org/research-analysis/library/gl obal-epidemiology-autism

  26. [35]

    BrainGB: A Benchmark for Brain Network Anal- ysis with Graph Neural Networks.IEEE Trans- actions on Medical Imaging (TMI), 2022

    Hejie Cui, Wei Dai, Yanqiao Zhu, Xuan Kan, An- tonio Aodong Chen Gu, Joshua Lukemire, Liang Zhan, Lifang He, Ying Guo, and Carl Yang. BrainGB: A Benchmark for Brain Network Anal- ysis with Graph Neural Networks.IEEE Trans- actions on Medical Imaging (TMI), 2022

  27. [36]

    Wood, Emily Guilhem, S

    D. Wood, Emily Guilhem, S. Kafiabadi, A. A. Busaidi, Kishan Dissanayake, Ahmed Hammam, Nina Mansoor, Matthew Townend, Siddharth Agarwal, Yiran Wei, Asif Mazumder, Gareth Barker, Peter Sasieni, S. Ourselin, James H Cole, and Thomas C. Booth. NeuroBERT: A self- supervised text-v...

  28. [37]

    doi: 10.1016/S1474-4422(24)00038-3

  29. [38]

    Stolte, Yun- chao Yang, Kang Liu, Kyle B

    Joseph Cox, Peng Liu, Skylar E. Stolte, Yun- chao Yang, Kang Liu, Kyle B. See, Huiwen Ju, and Ruogu Fang. BrainSegFounder: Towards 3D Foundation Models for Neuroimage Segmenta- tion, November 2024. URLhttp://arxiv.or g/abs/2406.10395. arXiv:2406.10395 [eess]

  30. [39]

    Sparse low-rank adaptation of pre-trained language models

    Ning Ding, Xingtai Lv, Qiaosen Wang, Yulin Chen, Bowen Zhou, Zhiyuan Liu, and Maosong Sun. Sparse low-rank adaptation of pre-trained language models. InProceedings of EMNLP, 2023

  31. [40]

    SegV ol: Universal and Interactive V olumet- ric Medical Image Segmentation, August 2024

    Yuxin Du, Fan Bai, Tiejun Huang, and Bo Zhao. SegV ol: Universal and Interactive V olumet- ric Medical Image Segmentation, August 2024. URLhttp://arxiv.org/abs/2311.13385. arXiv:2311.13385 [cs]

  32. [41]

    Imagenet: A large-scale hierarchical image database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In2009 IEEE con- ference on computer vision and pattern recogni- tion, pages 248–255. Ieee, 2009

  33. [42]

    SMoE: Sparse Mixture-of-Experts for Non-Uniform Noise Reduction in MRI Images, January 2025

    Zeyun Deng and Joseph Campbell. SMoE: Sparse Mixture-of-Experts for Non-Uniform Noise Reduction in MRI Images, January 2025. URLhttp://arxiv.org/abs/2501.14198. arXiv:2501.14198 [eess]

  34. [43]

    V .L. et al. Feigin. World stroke organization: Global stroke fact sheet 2025.PMC, 2025. URL 23 https://www.ncbi.nlm.nih.gov/pmc/art icles/PMC11786524/

  35. [44]

    Ghesu, B

    Florin C. Ghesu, B. Georgescu, Awais Mansoor, Y . Yoo, D. Neumann, Pragneshkumar B. Patel, R. S. Vishwanath, J. Balter, Yue Cao, Sasa Gr- bic, and D. Comaniciu. CLOpt: Contrastive self-supervised learning from 100 million med- ical images with optional supervision. 2022. doi: ...

  36. [45]

    Retrospective correction of motion artifact affected structural mri images using deep learning of simulated motion

    Ben A Duffy, Wenlu Zhang, Haoteng Tang, Lu Zhao, Meng Law, Arthur W Toga, and Ho- sung Kim. Retrospective correction of motion artifact affected structural mri images using deep learning of simulated motion. InMedical imag- ing with deep learning, 2018

  37. [46]

    PubMedCLIP: How Much Does CLIP Benefit Visual Question Answering in the Medi- cal Domain? 2023

    Sedigheh Eslami, Christoph Meinel, and Gerard de Melo. PubMedCLIP: How Much Does CLIP Benefit Visual Question Answering in the Medi- cal Domain? 2023

  38. [47]

    S. et al. Gatidis. A whole-body fdg-pet/ct dataset with manually annotated tumor lesions.Scientific Data, 9(1):601, 2022

  39. [48]

    On evaluating adversarial robustness of chest x-ray classification: Pitfalls and best practices

    Salah Ghamizi, Maxime Cordy, Mike Papadakis, and Yves Le Traon. On evaluating adversarial robustness of chest x-ray classification: Pitfalls and best practices. InThe Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI-23)- SafeAI, 2022

  40. [49]

    Zhang, Z

    G. Zhang, Z. Gao, C. Duan, J. Liu, Y . Lizhu, Y . Liu, Q. Chen, L. Wang, K. Fei, T. Wang, Y . Chen, Y . Guo, X. Lou, and Q. Dai. Brainfound: A Multimodal Vision-text AI Copilot for Brain Disease Diagnosis and Medical Imaging. 2025. doi: 10.1101/2025.01.09.25320293

  41. [50]

    PEE-FM: Associations of Postencephalitic Epilepsy Using Multi-Contrast Whole Brain MRI: A Large Self-Supervised Vi- sion Foundation Model Strategy

    Gao Ronghui, Peng Anjiao, Duan Yifei, Chen Mengyao, Zheng Tao, Zhang Meng, Chen Lei, and Sun Huaiqiang. PEE-FM: Associations of Postencephalitic Epilepsy Using Multi-Contrast Whole Brain MRI: A Large Self-Supervised Vi- sion Foundation Model Strategy. 2025. doi: 10.1002/jmri.29734

  42. [51]

    S.M.H. Hashemi. Crystal clean: Brain tumors mri dataset, 2023

  43. [52]

    A survey of large language models for healthcare: from data, technology, and applica- tions to accountability and ethics.arXiv preprint arXiv:2310.05694, 2023

    Kai He, Yizhi Li, Xinghe Yu, Rui Zheng, Yu- jia Zhang, Zhiyuan Liu, Jian Tang, and Yang Liu. A survey of large language models for healthcare: from data, technology, and applica- tions to accountability and ethics.arXiv preprint arXiv:2310.05694, 2023

  44. [53]

    Mazurowski

    Hanxue Gu, Haoyu Dong, Jichen Yang, and Ma- ciej A. Mazurowski. Finetune-SAM: How to build the best medical image segmentation algo- rithm using foundation models: a comprehensive empirical study with Segment Anything Model, May 2024. URLhttp://arxiv.org/abs/24 04.09957. arXiv...

  45. [54]

    CLIP-T2MedI: Fair text to medical im- age diffusion model with subgroup distribution aligned tuning

    Han Xu, Fan Fangfang, Rong Jingzhao, Li Zhen, El Fakhri Georges, Chen Qingyu, and Liu Xi- aofeng. CLIP-T2MedI: Fair text to medical im- age diffusion model with subgroup distribution aligned tuning. 2025. doi: 10.1117/12.3046450

  46. [55]

    Foundation Model for Advancing Health- care: Challenges, Opportunities, and Future Di- rections, April 2024

    Yuting He, Fuxiang Huang, Xinrui Jiang, Yuxi- ang Nie, Minghao Wang, Jiguang Wang, and Hao Chen. Foundation Model for Advancing Health- care: Challenges, Opportunities, and Future Di- rections, April 2024. URLhttp://arxiv.or g/abs/2404.03264. arXiv:2404.03264 [cs]

  47. [56]

    Lora: Low-rank adapta- tion of large language models.arXiv preprint arXiv:2106.09685, 2021

    Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, and Weizhu Chen. Lora: Low-rank adapta- tion of large language models.arXiv preprint arXiv:2106.09685, 2021

  48. [57]

    Deep residual learning for image recog- nition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016

  49. [58]

    GVSL: Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-training, March 2023

    Yuting He, Guanyu Yang, Rongjun Ge, Yang Chen, Jean-Louis Coatrieux, Boyu Wang, and Shuo Li. GVSL: Geometric Visual Similarity Learning in 3D Medical Image Self-supervised Pre-training, March 2023. URLhttp://arxi v.org/abs/2303.00874. arXiv:2303.00874 [cs]

  50. [59]

    STU- Net: Scalable and Transferable Medical Im- age Segmentation Models Empowered by Large- Scale Supervised Pre-training, April 2023

    Ziyan Huang, Haoyu Wang, Zhongying Deng, Jin Ye, Yanzhou Su, Hui Sun, Junjun He, Yun Gu, Lixu Gu, Shaoting Zhang, and Yu Qiao. STU- Net: Scalable and Transferable Medical Im- age Segmentation Models Empowered by Large- Scale Supervised Pre-training, April 2023. URL h t tp : / ...

  51. [60]

    Adaptive mix- tures of local experts.Neural Computation, 3(1): 79–87, 1991

    Robert A Jacobs, Michael I Jordan, Steven J Nowlan, and Geoffrey E Hinton. Adaptive mix- tures of local experts.Neural Computation, 3(1): 79–87, 1991

  52. [61]

    Foun- dation models and intelligent decision-making: Progress, challenges, and perspectives.The In- novation, 0:100948, 5 2025

    Jincai Huang, Yongjun Xu, Qi Wang, Qi ( Cheems, ) Wang, Xingxing Liang, Fei Wang, Zhao Zhang, Wei Wei, Boxuan Zhang, Libo Huang, Jingru Chang, Liantao Ma, Ting Ma, Yuxuan Liang, Jie Zhang, Jian Guo, Xuhui Jiang, Xinxin Fan, Zhulin An, Tingting Li, Xuefei Li, Zezhi Shao, Tangwe...

  53. [62]

    Y . et al. Huang. Segment anything model for medical images?Medical Image Analysis, 92: 103061, 2024

  54. [63]

    OBJ-SAM: Segmen- tation of Brain MRI Tumors by MedSAM with Prompts Generated by Object Detection

    Kai Zhou and Dandan Yu. OBJ-SAM: Segmen- tation of Brain MRI Tumors by MedSAM with Prompts Generated by Object Detection. 2024. doi: 10.1109/AINIT61980.2024.10581523

  55. [64]

    Quantitative pre- clinical imaging of hypoxia and vascularity using mri and pet.Methods in cell biology, 191, 1 2025

    Georgia Kanli, Selma Boudissa, Radovan Jirik, Tom Adamsen, Heidi Espedal, Hans Olav Rolf- snes, Frits Thorsen, Jesus Pacheco-Torres, Bas- sam Janji, and Olivier Keunen. Quantitative pre- clinical imaging of hypoxia and vascularity using mri and pet.Methods in cell biology, 191...

  56. [65]

    Jha and E

    S. Jha and E. J. Topol. Machine learning and bias in medical imaging.Frontiers in Radiology, 4: 10883605, 2024. URLhttps://pmc.ncbi.n lm.nih.gov/articles/PMC10883605/

  57. [66]

    Stolte, Yun- chao Yang, Kang Liu, Kyle B

    Joseph Cox, Peng Liu, Skylar E. Stolte, Yun- chao Yang, Kang Liu, Kyle B. See, Huiwen Ju, and Ruogu Fang. BrainFounder: Towards Brain Foundation Models for Neuroimage Anal- ysis. 2024. doi: 10.48550/arXiv.2406.10395

  58. [67]

    ALDM: Adap- tive Latent Diffusion Model for 3D Medical Im- age to Image Translation: Multi-modal Mag- netic Resonance Imaging Study

    Kim Jonghun and Park Hyunjin. ALDM: Adap- tive Latent Diffusion Model for 3D Medical Im- age to Image Translation: Multi-modal Mag- netic Resonance Imaging Study. 2024. doi: 10.1109/wacv57701.2024.00743

  59. [68]

    Segment anything

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. Segment anything. In Proceedings of the IEEE/CVF international con- ference on computer vision, pages 4015–4026, 2023

  60. [69]

    Olivier Keunen, Mikael Johansson, Anaïs Oudin, Morgane Sanzey, Siti A.Abdul Rahim, Fred Fack, Frits Thorsen, Torfinn Taxt, Michal Bar- tos, Radovan Jirik, Hrvoje Miletic, Jian Wang, Daniel Stieber, Linda Stuhr, Ingrid Moen, Ce- cilie Brekke Rygh, Rolf Bjerkvig, and Simone P. N...

  61. [70]

    Deva Priyakumar, and C

    Yash Khare, Viraj Bagal, Minesh Mathew, Adithi Devi, U. Deva Priyakumar, and C. V . Jawa- har. MMBERT: Multimodal BERT Pretraining for Improved Medical VQA, April 2021. URL h t tp : / / a r x i v . o r g / a b s / 2 1 0 4 . 0 1 3 94. arXiv:2104.01394 [cs]

  62. [71]

    Adam Kolides, Alyna Nawaz, Anshu Rathor, Denzel Beeman, Muzammil Hashmi, Sana Fa- tima, David Berdik, Mahmoud Al-Ayyoub, and Yaser Jararweh. Artificial intelligence foundation 25 and pre-trained models: Fundamentals, applica- tions, opportunities, and social impacts.Sim- ulati...

  63. [72]

    Manikis, Sofie Van Cauter, and Kostas Marias

    Eleftherios Kontopodis, Georgia Kanli, Geor- gios C. Manikis, Sofie Van Cauter, and Kostas Marias. Assessing treatment response through generalized pharmacokinetic modeling of dce- mri data.Cancer Informatics, 14:41–51, 5 2015. ISSN 11769351. doi: 10.4137/CIN.S19342 /ASSET/910...

  64. [73]

    Procedures for performing systematic reviews.Keele, UK, Keele University, 33(2004):1–26, 2004

    Barbara Kitchenham. Procedures for performing systematic reviews.Keele, UK, Keele University, 33(2004):1–26, 2004

  65. [74]

    MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentation, February 2025

    Taha Koleilat, Hojat Asgariandehkordi, Hassan Rivaz, and Yiming Xiao. MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentation, February 2025. URLhttp://ar xiv.org/abs/2409.19483. arXiv:2409.19483 [cs]

  66. [75]

    UniBrain: Uni- versal Brain MRI Diagnosis with Hierarchi- cal Knowledge-enhanced Pre-training, Septem- ber 2023

    Jiayu Lei, Lisong Dai, Haoyun Jiang, Chaoyi Wu, Xiaoman Zhang, Yao Zhang, Jiangchao Yao, Weidi Xie, Yanyong Zhang, Yuehua Li, Ya Zhang, and Yanfeng Wang. UniBrain: Uni- versal Brain MRI Diagnosis with Hierarchi- cal Knowledge-enhanced Pre-training, Septem- ber 2023. URLhttp://...

  67. [76]

    MedLSAM: Localize and Segment Anything Model for 3D CT Images, Oc- tober 2024

    Wenhui Lei, Xu Wei, Xiaofan Zhang, Kang Li, and Shaoting Zhang. MedLSAM: Localize and Segment Anything Model for 3D CT Images, Oc- tober 2024. URLhttp://arxiv.org/abs/23 06.14752. arXiv:2306.14752 [cs]

  68. [77]

    Harrison H. Lee, S. Sarah Chen, Benyou Wang, Quanzheng Li, and Hong Zhou. Foundation models for biomedical image segmentation: A survey.arXiv preprint arXiv:2401.07654, 2024

  69. [78]

    PIRTA: Improving Factuality of 3D Brain MRI Report Generation with Paired Image-domain Retrieval and Text- domain Augmentation, November 2024

    Junhyeok Lee, Yujin Oh, Dahyoun Lee, Hyon Keun Joh, Chul-Ho Sohn, Sung Hyun Baik, Cheol Kyu Jung, Jung Hyun Park, Kyu Sung Choi, Byung-Hoon Kim, and Jong Chul Ye. PIRTA: Improving Factuality of 3D Brain MRI Report Generation with Paired Image-domain Retrieval and Text- domain ...

  70. [79]

    MUMC: Masked Vision and Language Pre-training with Unimodal and Mul- timodal Contrastive Losses for Medical Visual Question Answering

    Pengfei Li, Gang Liu, Jinlong He, Zixu Zhao, and Shenjun Zhong. MUMC: Masked Vision and Language Pre-training with Unimodal and Mul- timodal Contrastive Losses for Medical Visual Question Answering. In Hayit Greenspan, Anant Madabhushi, Parvin Mousavi, Septimiu Salcud- ean, Ja...

  71. [80]

    Sarah Chen, Hong Zhou, Jiang Liu, and Yining Hua

    Qian Li, Benyou Wang, S. Sarah Chen, Hong Zhou, Jiang Liu, and Yining Hua. Progress and opportunities of foundation models in bioinfor- matics.arXiv preprint arXiv:2402.04286, 2024

  72. [81]

    Gshard: Scaling giant models with conditional computa- tion.arXiv preprint arXiv:2006.16668, 2020

    Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Yanping Chen, and Orhan Firat. Gshard: Scaling giant models with conditional computa- tion.arXiv preprint arXiv:2006.16668, 2020

  73. [82]

    LLaV A-Med: Training a Large Language-and- Vision Assistant for Biomedicine in One Day, June 2023

    Chunyuan Li, CliffWong, Sheng Zhang, Naoto Usuyama, Haotian Liu, Jianwei Yang, Tristan Naumann, Hoifung Poon, and Jianfeng Gao. LLaV A-Med: Training a Large Language-and- Vision Assistant for Biomedicine in One Day, June 2023. URLhttp://arxiv.org/abs/ 2306.00890. arXiv:2306.00890 [cs]

  74. [83]

    PMC-CLIP: Contrastive Language- Image Pre-training using Biomedical Docu- ments, March 2023

    Weixiong Lin, Ziheng Zhao, Xiaoman Zhang, Chaoyi Wu, Ya Zhang, Yanfeng Wang, and Weidi Xie. PMC-CLIP: Contrastive Language- Image Pre-training using Biomedical Docu- ments, March 2023. URLhttp://arxiv.or g/abs/2303.07240. arXiv:2303.07240 [cs]

  75. [84]

    T3D: Advancing 3D Medical Vision- Language Pre-training by Learning Multi-View Visual Consistency, February 2025

    Che Liu, Cheng Ouyang, Yinda Chen, Ce- sar César Quilodrán-Casas, Lei Ma, Jie Fu, Yike Guo, Anand Shah, Wenjia Bai, and Rossella Ar- cucci. T3D: Advancing 3D Medical Vision- Language Pre-training by Learning Multi-View Visual Consistency, February 2025. URLht tp : / / a r x i ...

  76. [85]

    nnSAM: Plug-and-play segment anything model improves nnUNet performance., 2024

    Li Yunxiang, Jing Bowen, Li Zihan, Wang Jing, and Zhang You. nnSAM: Plug-and-play segment anything model improves nnUNet performance., 2024

  77. [86]

    W. et al. Lin. Pmc-clip.arXiv preprint, 2023

  78. [87]

    Jiaxiang Liu, Tianxiang Hu, Yan Zhang, Yang Feng, Jin Hao, Junhui Lv, and Zuozhu Liu. VQA- adapter: Parameter-Efficient Transfer Learning for Medical Visual Question Answering.IEEE Transactions on Emerging Topics in Compu- tational Intelligence, 8(4):2816–2826, August

  79. [88]

    Qilin-Med- VL: Towards Chinese Large Vision-Language Model for General Healthcare, November 2023

    Junling Liu, Ziming Wang, Qichen Ye, Dading Chong, Peilin Zhou, and Yining Hua. Qilin-Med- VL: Towards Chinese Large Vision-Language Model for General Healthcare, November 2023. URLhttp://arxiv.org/abs/2310.17956. arXiv:2310.17956 [cs]

  80. [89]

    Sarah Chen, Benyou Wang, and Quanzheng Li

    Jiang Liu, Hong Zhou, S. Sarah Chen, Benyou Wang, and Quanzheng Li. Large language mod- els in bioinformatics: Applications and perspec- tives.arXiv preprint arXiv:2401.04155, 2024

  81. [90]

    ClipGPT: A ChatGPT Aided Explainable Frame- work for Zero-Shot Medical Image Diagnosis, July 2023

    Jiaxiang Liu, Tianxiang Hu, Yan Zhang, Xi- aotang Gai, Yang Feng, and Zuozhu Liu. ClipGPT: A ChatGPT Aided Explainable Frame- work for Zero-Shot Medical Image Diagnosis, July 2023. URLhttp://arxiv.org/abs/ 2307.01981. arXiv:2307.01981 [eess]

  82. [91]

    Alora: Allocating low-rank adaptation for fine- tuning large language models.arXiv preprint arXiv:2403.16187, 2024

    Jiawen Lyn, Yvette Graham, et al. Alora: Allocating low-rank adaptation for fine- tuning large language models.arXiv preprint arXiv:2403.16187, 2024

  83. [92]

    doi: 10.1109/TETC I.2023.3311333

    ISSN 2471-285X. doi: 10.1109/TETC I.2023.3311333. URLhttps://ieeexplore .ieee.org/document/10256025/

  84. [93]

    Advancing healthcare: the role and im- pact of ai and foundation models.American Jour- nal of Translational Research, 16:2166, 2024

    Nandhini Mahesh, Chitralekha S Devishamani, Keerthana Raghu, Maanasi Mahalingam, Pra- gathi Bysani, Arjun V Chakravarthy, and Rajiv Raman. Advancing healthcare: the role and im- pact of ai and foundation models.American Jour- nal of Translational Research, 16:2166, 2024. doi: ...

  85. [94]

    FedFMS: Exploring Federated Foundation Mod- els for Medical Image Segmentation, November

    Yuxi Liu, Guibo Luo, and Yuesheng Zhu. FedFMS: Exploring Federated Foundation Mod- els for Medical Image Segmentation, November

  86. [95]

    URLhttp://arxiv.org/abs/2403.0

  87. [96]

    Krumholz, Jure Leskovec, Eric J

    Michael Moor, Oishi Banerjee, Zahra Shak- eri Hossein Abad, Harlan M. Krumholz, Jure Leskovec, Eric J. Topol, and Pranav Rajpurkar. Foundation models for generalist medical arti- ficial intelligence.Nature, 616(7956):259–265,

  88. [97]

    Pro- gressiveAD: A Progressive Single-Modality to Multi-Modality Classification Framework for Alzheimer’s Disease Sub-type Diagnosis, July

    Yuxiao Liu, Mianxin Liu, Yuanwang Zhang, Kaicong Sun, and Dinggang Shen. Pro- gressiveAD: A Progressive Single-Modality to Multi-Modality Classification Framework for Alzheimer’s Disease Sub-type Diagnosis, July

  89. [98]

    arXiv:2407.18466 [cs]

    URLhttp://arxiv.org/abs/2407 .18466. arXiv:2407.18466 [cs]

  90. [99]

    3DUnet- Tumour: Deep learning model-based segmenta- tion of medical diseases from MRI and CT im- ages

    Murmu Anita and Kumar Piyush. 3DUnet- Tumour: Deep learning model-based segmenta- tion of medical diseases from MRI and CT im- ages. 2021. doi: 10.1109/tencon54134.2021.970 7278

  91. [100]

    MedSAM: Segment anything in medical images.Nature Communications, 15 (1):654, January 2024

    Jun Ma, Yuting He, Feifei Li, Lin Han, Chenyu You, and Bo Wang. MedSAM: Segment anything in medical images.Nature Communications, 15 (1):654, January 2024. ISSN 2041-1723. doi: 10.1038/s41467-024-44824-z. URLhttps: //www.nature.com/articles/s41467-024 -44824-z

  92. [101]

    LVM- Med: Learning Large-Scale Self-Supervised Vi- sion Models for Medical Imaging via Second- order Graph Matching

    Duy M H Nguyen, Hoang Nguyen, Nghiem T Diep, Tan N Pham, Tri Cao, Binh T Nguyen, Paul Swoboda, Nhat Ho, Shadi Albarqouni, Pengtao Xie, Daniel Sonntag, and Mathias Niepert. LVM- Med: Learning Large-Scale Self-Supervised Vi- sion Models for Medical Imaging via Second- order Grap...

  93. [102]

    Com- parison of objective image quality metrics to expert radiologists’ scoring of diagnostic quality of mr images.IEEE transactions on medical imaging, 39(4):1064–1072, 2019

    Allister Mason, James Rioux, Sharon E Clarke, Andreu Costa, Matthias Schmidt, Valerie Keough, Thien Huynh, and Steven Beyea. Com- parison of objective image quality metrics to expert radiologists’ scoring of diagnostic quality of mr images.IEEE transactions on medical imaging,...

  94. [103]

    Krumholz, Jure Leskovec, Eric J

    Michael Moor, Oishi Banerjee, Zahra Shak- eri Hossein Abad, Harlan M. Krumholz, Jure Leskovec, Eric J. Topol, and Pranav Rajpurkar. Foundation models for generalist medical artifi- cial intelligence.Nature 2023 616:7956, 616: 259–265, 4 2023. ISSN 1476-4687. doi: 10.103 8/s415...

  95. [104]

    The prisma 2020 statement: an updated guideline for reporting systematic reviews.bmj, 372, 2021

    Matthew J Page, Joanne E McKenzie, Patrick M Bossuyt, Isabelle Boutron, Tammy C Hoffmann, Cynthia D Mulrow, Larissa Shamseer, Jennifer M Tetzlaff, Elie A Akl, Sue E Brennan, et al. The prisma 2020 statement: an updated guideline for reporting systematic reviews.bmj, 372, 2021

  96. [105]

    O. et al. Pelka. Radiology objects in context (roco). InMICCAI Workshops, LNCS, 2018

  97. [106]

    Med-Flamingo: a Multimodal Med- ical Few-shot Learner, July 2023

    Michael Moor, Qian Huang, Shirley Wu, Michi- hiro Yasunaga, Cyril Zakka, Yash Dalmia, Ed- uardo Pontes Reis, Pranav Rajpurkar, and Jure Leskovec. Med-Flamingo: a Multimodal Med- ical Few-shot Learner, July 2023. URLh t tp : / / a r x i v . o r g / a b s / 2 3 0 7 . 1 5 1 89. a...

  98. [107]

    Michael et al. Moor. Med-flamingo: A mul- timodal medical few-shot learner. InMachine Learning for Health (ML4H). PMLR, 2023

  99. [108]

    Large ai models in health informatics: Applications, chal- lenges, and the future.IEEE Journal of Biomed- ical and Health Informatics, 2023

    Jianing Qiu, Jiexin Wang, Di Jin, Bin Li, Zhaolin Wu, Yasha Wang, Xiaoxiao Liang, Chen Qin, Yefeng Zhang, Tianming Liu, et al. Large ai models in health informatics: Applications, chal- lenges, and the future.IEEE Journal of Biomed- ical and Health Informatics, 2023

  100. [109]

    A.M. et al. Muslim. Brain mri dataset of multiple sclerosis.Data in Brief, 42:108139, 2022. 27

  101. [110]

    U-net: Convolutional networks for biomedical image segmentation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. InMed- ical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part...

  102. [111]

    V . et al. Oreiller. Head and neck tumor segmen- tation in pet/ct.Medical Image Analysis, 77: 102336, 2022

  103. [112]

    Ostrom, Haley Gittleman, Gabrielle Truitt, Alexander Boscia, Carol Kruchko, and Jill S

    Quinn T. Ostrom, Haley Gittleman, Gabrielle Truitt, Alexander Boscia, Carol Kruchko, and Jill S. Barnholtz-Sloan. Cbtrus statistical re- port: Primary brain and other central ner- vous system tumors diagnosed in the united states in 2016–2020.Neuro-Oncology, 25 (Supplement_4):...

  104. [113]

    Foundation models: A new paradigm for artificial intelligence.Business and Information Systems Engineering, 66:221–231, 4

    Johannes Schneider, Christian Meske, and Pauline Kuss. Foundation models: A new paradigm for artificial intelligence.Business and Information Systems Engineering, 66:221–231, 4

  105. [114]

    A Survey on Trustworthiness in Foundation Models for Medical Image Analysis (Towards), October 2024

    Congzhen Shi, Ryan Rezai, Jiaxi Yang, Qi Dou, and Xiaoxiao Li. A Survey on Trustworthiness in Foundation Models for Medical Image Analysis (Towards), October 2024. URLhttp://arxiv. org/abs/2407.15851. arXiv:2407.15851 [cs]

  106. [115]

    Daniele Perlo, Georgia Kanli, Selma Boud- issa, and Olivier Keunen. Multi-parametric mri to fmiso pet synthesis for hypoxia prediction in brain tumors.Lecture Notes in Computer Sci- ence (including subseries Lecture Notes in Ar- tificial Intelligence and Lecture Notes in Bioin...

  107. [116]

    URLhttps://link.springer.com/chap ter/10.1007/978-3-031-72744-3_12

  108. [117]

    MIU-VL: Medical Image Understanding with Pretrained Vision Language Models: A Compre- hensive Study, February 2023

    Ziyuan Qin, Huahui Yi, Qicheng Lao, and Kang Li. MIU-VL: Medical Image Understanding with Pretrained Vision Language Models: A Compre- hensive Study, February 2023. URLhttp://ar xiv.org/abs/2209.15517. arXiv:2209.15517 [cs]

  109. [118]

    Ri- vaz, and Yiming Xiao

    Taha Koleilat, Hojat Asgariandehkordi, H. Ri- vaz, and Yiming Xiao. MedCLIP-SAM: Bridg- ing Text and Image Towards Universal Medical Image Segmentation. 2024. doi: 10.48550/arXiv .2403.20253

  110. [119]

    Sarah Chen, and Quanzheng Li

    Yu Qiu, Benyou Wang, Hong Zhou, S. Sarah Chen, and Quanzheng Li. Pre-training in medical data: A survey.Machine Intelligence Research, 20(2):147–179, 2023. doi: 10.1007/s11633-022 -1369-5

  111. [120]

    MRAC: Pseudo CT Image Synthesis and Bone Segmentation From MR Im- ages Using Adversarial Networks With Residual Blocks for MR-Based Attenuation Correction of Brain PET Data

    Tao Li, Fisher Jonathan, Anaya Emily, Li Xin, and Levin Craig S. MRAC: Pseudo CT Image Synthesis and Bone Segmentation From MR Im- ages Using Adversarial Networks With Residual Blocks for MR-Based Attenuation Correction of Brain PET Data. 2021. doi: 10.1109/trpms.2020 .2989073

  112. [121]

    Seco de Herrera, et al

    Johannes Rückert, Louise Bloch, Raphael Brün- gel, Ahmad Idrissi-Yaghir, Henning Schäfer, Cynthia S Schmidt, Sven Koitka, Obioma Pelka, Asma Ben Abacha, Alba G. Seco de Herrera, et al. Rocov2: Radiology objects in context version 2, an updated multimodal image dataset. Scienti...

  113. [122]

    The bet protein inhibitor jq1 decreases hypoxia and im- proves the therapeutic benefit of anti-pd-1 in a high-risk neuroblastoma mouse model.Cells, 11: 2783, 9 2022

    Delphine Sauvage, Manon Bosseler, Elodie Viry, Georgia Kanli, Anais Oudin, Guy Berchem, Olivier Keunen, and Bassam Janji. The bet protein inhibitor jq1 decreases hypoxia and im- proves the therapeutic benefit of anti-pd-1 in a high-risk neuroblastoma mouse model.Cells, 11: 278...

  114. [123]

    Large language models in medicine.Na- ture Medicine, 29(8):1930–1940, 2023

    Arun James Thirunavukarasu, Refaat Hassan, Shatha Mahmood, Rajvir Sanghera, Karwan Barzangi, Mohammed El Mukashfi, and Sachin Shah. Large language models in medicine.Na- ture Medicine, 29(8):1930–1940, 2023. doi: 10.1038/s41591-023-02448-8

  115. [124]

    doi: 10.1007/S125 99-024-00851-0/FIGURES/2

    ISSN 18670202. doi: 10.1007/S125 99-024-00851-0/FIGURES/2. URLhttps: //link.springer.com/article/10.1007/ s12599-024-00851-0

  116. [125]

    Sara Mahdavi, Bradley Green, Ewa Domi- nowska, Blaise Aguera y Arcas, Joelle Barral, Dale Webster, Greg S

    Tao Tu, Shekoofeh Azizi, Danny Driess, Mike Schaekermann, Mohamed Amin, Pi-Chuan Chang, Andrew Carroll, Chuck Lau, Ryutaro Tanno, Ira Ktena, Basil Mustafa, Aakanksha Chowdhery, Yun Liu, Simon Kornblith, David Fleet, Philip Mansfield, Sushant Prakash, Re- nee Wong, Sunny Virman...

  117. [126]

    Medical vision lan- guage pretraining: A survey.arXiv preprint arXiv:2312.06224, 2023

    Prashant Shrestha, Fengyi Yang, Peng Xu, Yuyin Zhu, and Lei Zhou. Medical vision lan- guage pretraining: A survey.arXiv preprint arXiv:2312.06224, 2023. 28

  118. [127]

    S. et al. Subramanian. Medicat: A dataset of medical images, captions, and textual references. arXiv preprint arXiv:2010.06000, 2020

  119. [128]

    BME-X: A foundation model for en- hancing magnetic resonance images and down- stream segmentation, registration and diagnostic tasks

    Sun Yue, Wang Limei, Li Gang, Lin Weili, and Wang Li. BME-X: A foundation model for en- hancing magnetic resonance images and down- stream segmentation, registration and diagnostic tasks. 2024. doi: 10.1038/s41551-024-01283-7

  120. [129]

    Sarah Chen, Hong Zhou, and Quanzheng Li

    Dong-Qing Wang, S. Sarah Chen, Hong Zhou, and Quanzheng Li. Accelerating the integration of chatgpt and other large-scale ai models into 29 biomedical research and healthcare.MedComm– Future Medicine, 2(2):e43, 2023. doi: 10.1002/ mef2.43

  121. [130]

    BrainIAC: A foundation model for generalized brain MRI analysis., 2024

    Tak Divyanshu, Garomsa Biniam A, Chaun- zwa Tafadzwa L, Zapaishchykova Anna, Climent Pardo Juan Carlos, Ye Zezhong, Zielke John, Ravipati Yashwanth, Vajapeyam Sri, Mahootiha Maryam, Smith Ceilidh, Familiar Ariana M, Liu Kevin X, Prabhu Sanjay, Bandopadhayay Pratiti, Nabavizade...

  122. [131]

    SAM- Med3D: Towards General-purpose Segmentation Models for V olumetric Medical Images, Septem- ber 2024

    Haoyu Wang, Sizheng Guo, Jin Ye, Zhongying Deng, Junlong Cheng, Tianbin Li, Jianpin Chen, Yanzhou Su, Ziyan Huang, Yiqing Shen, Bin Fu, Shaoting Zhang, Junjun He, and Yu Qiao. SAM- Med3D: Towards General-purpose Segmentation Models for V olumetric Medical Images, Septem- ber 2...

  123. [132]

    Paderno, Le- ander Maerkisch, Paul F

    Tassilo Wald, Constantin Ulrich, Stanislav Lukyanenko, Andrei Goncharov, A. Paderno, Le- ander Maerkisch, Paul F. Jäger, and Klaus H. Maier-Hein. MAE-Seg Revisiting MAE pre- training for 3D medical image segmentation

  124. [133]

    doi: 10.48550/arXiv.2410.23132

  125. [134]

    KGPL: Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation, July

    Lin Teng, Zihao Zhao, Jiawei Huang, Zehong Cao, Runqi Meng, Feng Shi, and Dinggang Shen. KGPL: Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation, July

  126. [135]

    arXiv:2407.21328 [eess]

    URLhttp://arxiv.org/abs/2407 .21328. arXiv:2407.21328 [eess]

  127. [136]

    KL-CVR: Inte- grating Expert Knowledge with Vision-Language Model for Medical Image Retrieval

    Wei Xiaoyang, Vagena Zografoula, Kurtz Camille, and Cloppet Florence. KL-CVR: Inte- grating Expert Knowledge with Vision-Language Model for Medical Image Retrieval. 2024. doi: 10.1109/isbi56570.2024.10635576

  128. [137]

    SE- ADA: Domain-invariant feature learning in brain MR imaging for content-based image retrieval, 2025

    Tobari Shuya, Tomoshige Shuhei, Muraki Hay- ato, Oishi Kenichi, and Iyatomi Hitoshi. SE- ADA: Domain-invariant feature learning in brain MR imaging for content-based image retrieval, 2025

  129. [138]

    Wood David A, Townend Matthew, Guilhem Emily, Kafiabadi Sina, Hammam Ahmed, Wei Yiran, Al Busaidi Ayisha, Mazumder Asif, Sasieni Peter, Barker Gareth J, Ourselin Se- bastien, Cole James H, and Booth Thomas C. BrainAge: Optimising brain age estima- tion through transfer learnin...

  130. [139]

    Tom Van Sonsbeek, Mohammad Mahdi Der- akhshani, Ivona Najdenkoska, Cees G. M. Snoek, and Marcel Worring. OE-VQA: Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Models. In Hayit Greenspan, Anant Madabhushi, Parvin Mousavi, Septimiu Salcudean, Jam...

  131. [140]

    Feng, Lingting Zhu, and Lequan Yu

    W. Feng, Lingting Zhu, and Lequan Yu. Eff- SAM: Cheap Lunch for Medical Image Segmen- tation by Fine-tuning SAM on Few Exemplars, 2023

  132. [141]

    Pre-trained language models in biomedi- cal domain: A systematic survey.ACM Comput- ing Surveys, 56(3):1–52, 2023

    Benyou Wang, Qianqian Xie, Jiahuan Pei, Zhi- hong Chen, Prayag Tiwari, Jie Fu, and Haixun Wang. Pre-trained language models in biomedi- cal domain: A systematic survey.ACM Comput- ing Surveys, 56(3):1–52, 2023. doi: 10.1145/36 11651

  133. [142]

    V oCo: A Simple-yet-Effective V olume Con- trastive Learning Framework for 3D Medical Im- age Analysis, April 2024

    Linshan Wu, Jiaxin Zhuang, and Hao Chen. V oCo: A Simple-yet-Effective V olume Con- trastive Learning Framework for 3D Medical Im- age Analysis, April 2024. URLhttp://arxi 30 v.org/abs/2402.17300. arXiv:2402.17300 [eess]

  134. [143]

    MIS-FM: 3D Medical Image Segmentation us- ing Foundation Models Pretrained on a Large- Scale Unannotated Dataset, June 2023

    Guotai Wang, Jianghao Wu, Xiangde Luo, Xin- glong Liu, Kang Li, and Shaoting Zhang. MIS-FM: 3D Medical Image Segmentation us- ing Foundation Models Pretrained on a Large- Scale Unannotated Dataset, June 2023. URL h t tp : / / a r x i v . o r g / a b s / 2 3 0 6 . 1 6 9 25. arX...

  135. [144]

    Bai, Guohua Zhao, and Yen-Wei Chen

    Xiaoyu Shi, Shurong Chai, Yinhao Li, Jingliang Cheng, J. Bai, Guohua Zhao, and Yen-Wei Chen. MultiModalSAM: Cross-modality At- tention Adapter: A Glioma Segmentation Fine- tuning Method for SAM Using Multimodal Brain MR Images. 2023. doi: 10.48550/arXiv.2307.01 124

  136. [145]

    Y . Wang, X. Li, and J. Chen. Headache disorders: a persistent public health challenge for the young population.PMC, 2024. URLhttps://www.nc bi.nlm.nih.gov/pmc/articles/PMC11538 006/

  137. [146]

    TUMSyn: Towards General Text- guided Image Synthesis for Customized Multi- modal Brain MRI Generation, September 2024

    Yulin Wang, Honglin Xiong, Kaicong Sun, Shuwei Bai, Ling Dai, Zhongxiang Ding, Ji- ameng Liu, Qian Wang, Qian Liu, and Ding- gang Shen. TUMSyn: Towards General Text- guided Image Synthesis for Customized Multi- modal Brain MRI Generation, September 2024. URLhttp://arxiv.org/ab...

  138. [147]

    MINIM: Self-improving generative foun- dation model for synthetic medical image gen- eration and clinical applications

    Wang Jinzhuo, Wang Kai, Yu Yunfang, Lu Yux- ing, Xiao Wenchao, Sun Zhuo, Liu Fei, Zou Zixing, Gao Yuanxu, Yang Lei, Zhou Hong- Yu, Miao Hanpei, Zhao Wenting, Huang Lisha, Zeng Lingchao, Guo Rui, Chong Ieng, Deng Boyu, Cheng Linling, Chen Xiaoniao, Luo Jing, Zhu Meng-Hua, Bapti...

  139. [148]

    Totalsegmenta- tor: robust segmentation of 104 anatomic struc- tures in ct images.Radiology: Artificial Intelli- gence, 5(5):e230024, 2023

    Jakob Wasserthal, Hanns-Christian Breit, Man- fred T Meyer, Maurice Pradella, Daniel Hinck, Alexander W Sauter, Tobias Heye, Daniel T Boll, Joshy Cyriac, Shan Yang, et al. Totalsegmenta- tor: robust segmentation of 104 anatomic struc- tures in ct images.Radiology: Artificial I...

  140. [149]

    SSNet: Synergistic Segmentation of Brain MRI Scans Using nnUNetv2 and SAM- track

    Yongeun Jang, Kwang-Ju Kim, In-Su Jang, and Gwang Lee. SSNet: Synergistic Segmentation of Brain MRI Scans Using nnUNetv2 and SAM- track. 2024. doi: 10.1109/ICAIIC60209.2024.1 0463484

  141. [150]

    Wong, Marianne Rakic, John Guttag, and Adrian V

    Hallee E. Wong, Marianne Rakic, John Guttag, and Adrian V . Dalca. ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Image, July 2024. URLhttp://ar xiv.org/abs/2312.07381. arXiv:2312.07381 [cs]

  142. [151]

    G. et al. Zhang. A multimodal vision-text ai copi- lot for brain disease diagnosis.medRxiv, 2025. Preprint

  143. [152]

    doi: 10.1002/hbm.26625

  144. [153]

    RadFM: Towards General- ist Foundation Model for Radiology by Leverag- ing Web-scale 2D&3D Medical Data, November

    Chaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang, and Weidi Xie. RadFM: Towards General- ist Foundation Model for Radiology by Leverag- ing Web-scale 2D&3D Medical Data, November

  145. [154]

    URLhttp://arxiv.org/abs/2308.0

  146. [155]

    Lungren, Tristan Naumann, Sheng Wang, and Hoifung Poon

    Sheng Zhang, Yanbo Xu, Naoto Usuyama, Han- wen Xu, Jaspreet Bagga, Robert Tinn, Sam Pre- ston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Angela Crabtree, Brian Piening, Carlo Bifulco, Matthe...

  147. [156]

    MedSegDiff-V2: Diffusion based Medical Image Segmentation with Trans- former, December 2023

    Junde Wu, Wei Ji, Huazhu Fu, Min Xu, Yueming Jin, and Yanwu Xu. MedSegDiff-V2: Diffusion based Medical Image Segmentation with Trans- former, December 2023. URLhttp://arxi v.org/abs/2301.11798. arXiv:2301.11798 [eess]

  148. [157]

    Med-SA: Med- ical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation, Decem- ber 2023

    Junde Wu, Wei Ji, Yuanpei Liu, Huazhu Fu, Min Xu, Yanwu Xu, and Yueming Jin. Med-SA: Med- ical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation, Decem- ber 2023. URLhttp://arxiv.org/abs/2304 .12620. arXiv:2304.12620 [cs]

  149. [158]

    Matthew, Chuyang Ye, and Wenjia Bai

    Xinru Zhang, Ni Ou, Berke Doga Basaran, Marco Visentin, Mengyun Qiao, Renyang Gu, Cheng Ouyang, Yaou Liu, Paul M. Matthew, Chuyang Ye, and Wenjia Bai. MoME: A Founda- tion Model for Brain Lesion Segmentation with Mixture of Modality Experts, July 2024. URL 31 h t tp : / / a r ...

  150. [159]

    MMC-Adapt: Adapting Segment Anything Model for 3D Brain Tumor Segmentation With Missing Modalities

    Xiaoliang Lei, Xiaosheng Yu, Maocheng Bai, Jingsi Zhang, and Chengdong Wu. MMC-Adapt: Adapting Segment Anything Model for 3D Brain Tumor Segmentation With Missing Modalities

  151. [160]

    doi: 10.1002/ima.23177

  152. [161]

    Segment anything model for medical image seg- mentation: Current applications and future di- rections.Computers in Biology and Medicine, 171:108238, March 2024

    Yichi Zhang, Zhenrong Shen, and Rushi Jiao. Segment anything model for medical image seg- mentation: Current applications and future di- rections.Computers in Biology and Medicine, 171:108238, March 2024. ISSN 00104825. doi: 10.1016/j.compbiomed.2024.108238. URL https://linkin...

  153. [162]

    Bai, Guohua Zhao, and Yen-Wei Chen

    Xiaoyu Shi, Yinhao Li, Jingliang Cheng, J. Bai, Guohua Zhao, and Yen-Wei Chen. MedicalSAM: A Glioma Segmentation Fine-tuning Method for SAM Using Brain MR Images. 2024. doi: 10.1 109/ICCE59016.2024.10444252

  154. [163]

    X. et al. Yang. Global epidemiology of parkin- son’s disease 1990-2021.Movement Disorders,

  155. [164]

    URLhttps://www.ncbi.nlm.nih.gov /pmc/articles/PMC12035419/

  156. [165]

    J. et al. Ye. Sa-med2d-20m dataset.arXiv preprint arXiv:2311.11969, 2023

  157. [166]

    Yilmaz and B

    A. Yilmaz and B. Kocak. Bias in artificial intel- ligence for medical imaging: Fundamentals, de- tection, avoidance, mitigation, challenges, ethics, and prospects.Diagnostic and Interventional Ra- diology, 31(2):123–134, 2025. URLhttps: //www.dirjournal.org/articles/bias-i n-a...

  158. [167]

    AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection, March 2024

    Qihang Zhou, Guansong Pang, Yu Tian, Shibo He, and Jiming Chen. AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection, March 2024. URLh t tp : / / a r x i v . o r g / a b s / 2 3 1 0 . 1 8 9 61. arXiv:2310.18961 [cs]

  159. [168]

    Sarah Chen, Benyou Wang, and Quanzheng Li

    Mingze Yuan, Zhihong Liu, Peng Xu, Hong Zhou, S. Sarah Chen, Benyou Wang, and Quanzheng Li. Large language models illumi- nate a progressive pathway to artificial health- care assistant: A review.arXiv preprint arXiv:2311.01918, 2023

  160. [169]

    Gotway, and Jianming Liang

    Zongwei Zhou, Vatsal Sodha, Md Mah- fuzur Rahman Siddiquee, Ruibin Feng, Nima Tajbakhsh, Michael B. Gotway, and Jianming Liang. Models Genesis: Generic Autodidactic Models for 3D Med- ical Image Analysis, August 2019. URL h t tp : / / a r x i v . o r g / a b s / 1 9 0 8 . 0 6 ...

  161. [170]

    BiomedGPT: A general- ist vision–language foundation model for diverse biomedical tasks

    Kai Zhang, Rong Zhou, Eashan Adhikarla, Zhiling Yan, Yixin Liu, Jun Yu, Zhengliang Liu, Xun Chen, Brian D Davison, Hui Ren, Jing Huang, Chen Chen, Yuyin Zhou, Sunyang Fu, Wei Liu, Tianming Liu, Xiang Li, Yong Chen, Lifang He, James Zou, Quanzheng Li, Hongfang Liu, and Lichao S...

  162. [172]

    On the challenges and perspectives of foundation mod- els for medical image analysis.Medical Image Analysis, 91:102996, 2024

    Shaoting Zhang and Dimitris Metaxas. On the challenges and perspectives of foundation mod- els for medical image analysis.Medical Image Analysis, 91:102996, 2024. doi: 10.1016/j.medi a.2023.102996

  163. [174]

    X. et al. Zhang. Pmc-vqa: Visual instruction tun- ing for medical visual question answering.arXiv preprint, 2023

  164. [175]

    MedVInT : PMC-VQA: Visual In- struction Tuning for Medical Visual Question Answering, September 2024

    Xiaoman Zhang, Chaoyi Wu, Ziheng Zhao, Weixiong Lin, Ya Zhang, Yanfeng Wang, and Weidi Xie. MedVInT : PMC-VQA: Visual In- struction Tuning for Medical Visual Question Answering, September 2024. URLhttp://ar xiv.org/abs/2305.10415. arXiv:2305.10415 [cs]

  165. [177]

    Matthews, Yaou Liu, Chuyang Ye, and Wenjia Bai

    Xinru Zhang, Ni Ou, Berke Doga Basaran, Marco Visentin, Mengyun Qiao, Renyang Gu, Paul M. Matthews, Yaou Liu, Chuyang Ye, and Wenjia Bai. MoME+: A Foundation Model for Lesion Segmentation on Brain MRI with Mixture of Modality Experts.IEEE Transactions on Med- ical Imaging, pag...

  166. [178]

    UR-SAM: Enhanc- ing the Reliability of Segment Anything Model for Auto-Prompting Medical Image Segmenta- tion with Uncertainty Rectification, March 2024

    Yichi Zhang, Shiyao Hu, Sijie Ren, Chen Jiang, Yuan Cheng, and Yuan Qi. UR-SAM: Enhanc- ing the Reliability of Segment Anything Model for Auto-Prompting Medical Image Segmenta- tion with Uncertainty Rectification, March 2024. URLhttp://arxiv.org/abs/2311.10529. arXiv:2311.10529 [cs]

  167. [180]

    Sarah Chen, and Quanzheng Li

    Yu Zhang, Benyou Wang, Hong Zhou, S. Sarah Chen, and Quanzheng Li. Data-centric founda- tion models in computational healthcare.Nature Computational Science, 2024. doi: 10.1038/s4 3588-024-00595-7

  168. [181]

    CLIP in Medical Imaging: A Comprehen- sive Survey, August 2024

    Zihao Zhao, Yuxiao Liu, Han Wu, Mei Wang, Yonghao Li, Sheng Wang, Lin Teng, Disheng Liu, Zhiming Cui, Qian Wang, and Dinggang Shen. CLIP in Medical Imaging: A Comprehen- sive Survey, August 2024. URLhttp://arxi v.org/abs/2312.07353. arXiv:2312.07353 [cs]

  169. [182]

    MTT-Net: Multi-Scale Tokens-Aware Transformer Network for Multi-Region and Multi-Sequence MR-to- CT Synthesis in a Single Model

    Zhong Liming, Chen Zeli, Shu Hai, Zheng Kaiyi, Li Yin, Chen Weicui, Wu Yuankui, Ma Jian- hua, Feng Qianjin, and Yang Wei. MTT-Net: Multi-Scale Tokens-Aware Transformer Network for Multi-Region and Multi-Sequence MR-to- CT Synthesis in a Single Model. 2024. doi: 10.1109/tmi.202...

  170. [183]

    Sarah Chen, Peng Zhou, Jiang Liu, Yining Hua, Chengzhi Mao, Xi Wu, et al

    Hong Zhou, Bin Gu, Xu Zou, Yixin Li, S. Sarah Chen, Peng Zhou, Jiang Liu, Yining Hua, Chengzhi Mao, Xi Wu, et al. A survey of large language models in medicine: Progress, application, and challenge.arXiv preprint arXiv:2311.05112, 2023

  171. [184]

    Hong-Yu Zhou, Chixiang Lu, Chaoqi Chen, Sibei Yang, and Yizhou Yu. PCRLv2: A Uni- fied Visual Information Preservation Framework for Self-supervised Pre-training in Medical Im- age Analysis.IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 1–16,

  172. [185]

    doi: 10.1109/TPAMI.2023.3234002

    ISSN 0162-8828, 2160-9292, 1939-3539. doi: 10.1109/TPAMI.2023.3234002. URL https://ieeexplore.ieee.org/docume nt/10005161/

  173. [187]

    Schwab, Johannes Meiser, Chris- tian Jäger, Jakub Mieczkowski, Frits A

    Wenjing Zhou, Elena Martinez-Garcia, Katha- rina Sarnow, Georgia Kanli, Petr Nazarov, Stephanie G. Schwab, Johannes Meiser, Chris- tian Jäger, Jakub Mieczkowski, Frits A. Thorsen, Konrad Grützmann, Boris Mihaljevic, Bar- bara van Loon, Jubayer A. Hossain, Anna Golebiewska, Sim...

  174. [189]

    Medical SAM 2: Segment medical images as video via Segment Anything Model 2, December 2024

    Jiayuan Zhu, Abdullah Hamdi, Yunli Qi, Yuem- ing Jin, and Junde Wu. Medical SAM 2: Segment medical images as video via Segment Anything Model 2, December 2024. URLhttp://arxi 32 v.org/abs/2408.00874. arXiv:2408.00874 [cs]

  175. [190]

    CLIP-VQG: A Medical Domain Visual Question Generation Model via Large Language Model

    Zhu He, Togo Ren, Ogawa Takahiro, and Haseyama Miki. CLIP-VQG: A Medical Domain Visual Question Generation Model via Large Language Model. 2023. doi: 10.1109/icce-t aiwan58799.2023.10227045. 33

  176. [2023]

    doi: 10.1038/s41586-023-05881-4

  177. [2024]

    doi: 10.48550/arXiv.2405.14019

  178. [2025]

    gov/39837288/

    URLhttps://pubmed.ncbi.nlm.nih. gov/39837288/

  179. [2463]

    arXiv:2308.02463 [cs]

  180. [5408]

    arXiv:2403.05408 [eess]

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.