REVIEW 4 major objections 4 minor 148 references
From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology
T0 review · 4 major / 4 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read A hierarchical multi-resolution transformer for whole slide images outperforms single-resolution foundation models across cancer subtyping, tissue phenotyping, and WSI question answering.
desk verdict Multi-resolution hierarchical SSL for WSIs is a promising and well-ablated idea, but the reported margins rest on a protocol that needs verification before the SOTA claims can be taken at face value. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Consecutive Cross-Resolution Attention (CCRA): a fusion mechanism that exchanges information only between adjacent magnifications (10x<->20x and 20x<->40x) by averaging the [CLS] tokens of two resolutions, appending the average to the finer sequence, and using the averaged token as a query attending to that sequence. Because the query is a single vector, CCRA is linear in the number of tokens. It sits inside a three-stage hierarchical SSL stack—mViTP-C at the cell level, ViTR-P at the patch/region level, and ViTM-R at the WSI level—so that each higher level re-uses frozen lower-level multi-resolution embeddings. CCRA is what carries the paper's claim that cross-resolution fusion is both biol
What would settle it
Release the exact slide lists used for pre-training and the exact test splits for TCGA-RCC and CPTAC-NSCLC, then recompute the reported zero-shot and linear-probe scores after removing any slide that appears in both. If scores drop materially, the claimed generalization advantage is at least partly memorization; if they hold, the held-out claim is confirmed.
Extended reading notes
Core claim
The paper's central claim is that jointly modelling the intrinsic hierarchy and multi-resolution structure of WSIs produces the best whole-slide representations yet reported. MRPT decomposes each gigapixel slide into spatially aligned triplets at 10x, 20x, and 40x, then learns representations in three self-supervised stages: a cell-level transformer (mViTP-C) fuses consecutive resolutions through a Consecutive Cross-Resolution Attention (CCRA) mechanism, patch-level ViT (ViTR-P) aggregates those embeddings, and region-level ViT (ViTM-R) aggregates them into a WSI-level [CLS] token. CCRA exchanges information only between adjacent magnifications by averaging their class tokens and letting the
Load-bearing premise
The load-bearing premise is the assertion in the data-section note that no testing slide was used during pre-training for the TCGA-RCC and CPTAC-NSCLC evaluations; the paper offers no manifest, code, or reproducible split to confirm the test slides were disjoint from the 36K WSIs.
Editorial extensions
If this is right
- If the reported gains are real, single-resolution patch-level and WSI-level foundation models are leaving a substantial amount of diagnostic signal unused; multi-resolution hierarchical pre-training should become the default recipe for WSI representation learning.
- Multi-resolution hierarchical embeddings transfer strongly with linear probes and few-shot classifiers, so small labelled cohorts—rare subtypes, under-represented stains, new scanners—could get better performance without training large models.
- WSI-level visual question answering improves when the LLM sees hierarchical multi-resolution visual tokens rather than only patch-level features, suggesting that the next generation of pathology MLLMs should be built on multi-scale encoders.
- The consecutive-attention design keeps the added computation modest (about 1.1 TFLOPs per WSI in one reported configuration, comparable to single-resolution baselines), making multi-resolution WSI modelling practical on standard GPU workstations.
- MRPT's reported consistency across 10x/20x/40x inputs implies a single model can handle slides scanned at different magnifications without per-resolution retraining.
Reading between the lines
- Beyond the paper: the CCRA design presumes that the same anatomical region is spatially aligned across resolutions; a direct test would be to inject controlled misregistration into the multi-resolution triplets and measure how quickly the advantage over single-resolution encoders erodes.
- Beyond the paper: if the matched-data result in Table 3 generalizes, it predicts that smaller multi-resolution pre-training corpora can rival much larger single-resolution corpora—an experiment that would isolate whether the gains come from resolution diversity or raw data volume.
- Beyond the paper: the paper's consecutive-resolution constraint is a strong inductive bias; one could test it on whole-slide scans with only 5x/40x available (common in legacy archives) to see whether synthetic intermediate resolutions recover the benefit or whether the locality assumption fails without a real 20x scan.
- Beyond the paper: because MRPT-LLaVA couples a frozen MRPT encoder to a small LLM, a natural extension is to treat MRPT as a drop-in visual encoder for other instruction-tuned models and to measure whether the multi-resolution hierarchy is as beneficial for open-ended clinical questions as it is for closed-set benchmarks.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces MRPT, a hierarchical multi-resolution whole-slide-image (WSI) foundation model. It pre-trains three Transformer stages — cell-level mViTP-C with a Consecutive Cross-Resolution Attention (CCRA) mechanism, patch/region-level ViTR-P, and region/WSI-level ViTM-R — using DINO-style multi-resolution self-supervised learning on 30,000 TCGA and 6,000 CPTAC WSIs. A multimodal extension, MRPT-LLaVA, is built by aligning MRPT features with Qwen2-1.5B and instruction-tuning on WSI-Bench for VQA/report generation. The authors report state-of-the-art results across 34 datasets for patch- and WSI-level classification, VQA, captioning, and report generation. The central claim is that joint hierarchical multi-resolution SSL with consecutive cross-resolution attention produces the best WSI representations to date.
Significance. If the empirical claims hold, MRPT would be a substantial advance: it is one of the few attempts to jointly model hierarchical tissue structure and multi-resolution information, and the linear CCRA design is computationally inexpensive. The large-scale pre-training (624M patches, 2.4M regions, 36K WSIs) and the component-wise ablations are also valuable. However, the evaluation protocol currently prevents verification of the SOTA claims. The absence of slide-level split manifests for TCGA-RCC/CPTAC-NSCLC, the use of PANDA/BRAINS/UBC-OCEAN for both model selection and final reporting, and the mislabeled “zero-shot” VQA comparisons are load-bearing issues that must be fixed before the claims can be accepted.
major comments (4)
- [§17, Fig. 3c, Table 22] The patch-level VQA comparison is not zero-shot. The proposed mViTP-C-LLaVA and mViTR-P-LLaVA models undergo Stage 3 instruction tuning on QuiltInstruct (107,131 pairs; Section 17), while GPT-4V, LLaVA, Quilt-LLaVA, etc. are evaluated without such tuning. Reporting this as “Zero-shot VQA” in Fig. 3c and in the text inflates the apparent margin (e.g., 78.8% vs 60.1% on PathMMU Tiny). Please rename the protocol and compare against baselines that receive the same instruction tuning, or compare all models in true zero-shot mode. The same concern applies to WSI-Bench in Table 19: MRPT-LLaVA is fine-tuned on the WSI-Bench training set (Section 16.3) before being evaluated on its test set; this should be labeled as in-domain fine-tuning.
- [§4.2, Tables 2/4/5 and Supp. Tables 8/9; §4.3, Tables 15/16] Model selection and main results use the same benchmarks. The mViTP-C variant, number of resolutions, CCRA vs distant attention, K/Q values, and token fusion methods are all selected on PANDA, BRAINS, and UBC-OCEAN (Tables 2, 5, 8, 9). These three datasets then appear in the headline zero-shot and linear-probe results (Tables 15/16, Fig. 3d/e). This is selection on the test set; part of the reported gain is therefore model-selection bias. Please hold out a separate model-selection set (or use nested cross-validation) and report final numbers on data not used in any ablation.
- [§21, §23.1, Tables 15/16] Pre-training/evaluation overlap is unverified. The pre-training corpus includes 30,000 TCGA WSIs and 6,000 CPTAC WSIs, including kidney and LUAD/LUSC cases (Section 21). The main WSI classification results include TCGA-RCC and CPTAC-NSCLC (Tables 15/16). Section 23.1 asserts for TCGA-RCC that no testing slide was used, but it provides no slide-level manifest, TCGA barcode list, or split-generation code, and no analogous statement or manifest is given for CPTAC-NSCLC. Without these, a reader cannot exclude that the held-out test slides are in the pre-training set. This is load-bearing because the zero-shot and linear-probe gains on these two datasets (e.g., MRPT-LLaVA BA 0.961/0.972 vs TITAN 0.916/0.94 in Table 15) are central to the cancer-subtype claim. Please release exact slide IDs and splits for both datasets.
- [§4.2, Table 3] The “matched-data” experiment in Table 3 does not remove the pre-training overlap concern. MRPT is pre-trained on TCGA slides and then evaluated on TCGA test splits (TCGA-NSCLC, TCGA-RCC, TCGA-BRCA). Even if all methods use identical downstream train/test folds, the pre-training corpus may contain the test slides. The claim that gains “stem from hierarchical multi-resolution SSL” rather than from data overlap requires slide-level split verification, not just identical downstream folds.
minor comments (4)
- [Eq. (2)] The definition of S'_{r+1} uses S_r and an averaged [CLS] token, but the text says the averaged token is appended to the “finer sequence.” Please clarify which resolution is the concatenation target and align the notation.
- [Abstract, §4] The abstract and Section 4 say code and models are available “on link,” but no actual link or repository identifier is given. Please include an anonymized repository, model card, and the split manifests needed to reproduce the held-out settings.
- [Tables 2, 4, 5] Several tables report values as 0-1 proportions while the text reports percentages (e.g., “Experiment D averages 86.30%” vs Table 2’s 0.866). Please unify the notation.
- [Supplementary §12] The “Theoretical Insights” section presents manifold continuity and hierarchical compositionality as assumptions; they are not proven theorems. Please label them as motivating assumptions to avoid overclaiming theoretical grounding.
Circularity Check
No equation-level circularity: MRPT's encoders compose as stated and CCRA is validated by ablation, not assumed. Partial issue: the architecture and fusion hyperparameters are selected on the PANDA/BRAINS/UBC-OCEAN test splits, and the same splits reappear as main-result evidence (PANDA linear-probe BA 0.866 is identical in selection Table 2 and final Table 16), making part of the reported gain a
-
fitted input called prediction
[Section 4.2 (Tables 2, 5, 8, 9) vs. Section 4.3 item 6 / Fig. 3e / Table 16]
"All MRPT variants outperform HIPT [25], validating multi-resolution hierarchical representations. mViTP-C-B yields the strongest results among tiny/small/backbone options; thus we report MRPT with mViTP-C-B thereafter. ... Using MRPT's WSI-level features with a linear classifier, we compare against PRISM, TITAN, GigaPath, and CHIEF. MRPT averages 0.898 balanced accuracy vs. 0.845 for TITAN, underscoring the advantage of multi-resolution cues."
The reported model configuration (mViTP-C-B, ACT+CCRA+[CLS] Concat, K=1, Q=4, 3-stage SSL) is selected by maximizing balanced accuracy on PANDA, BRAINS, and UBC-OCEAN test splits (Tables 2/5/8/9; e.g., Table 2 row D mViTP-C-B PF+LP = 0.866 on PANDA). These same three datasets then appear in the main SOTA comparisons (Fig. 3e/Table 16), where the PANDA linear-probe BA is again 0.866. The headline gains on these three benchmarks are therefore partly the selection criterion itself, reported as prediction — a test-set model-selection pattern rather than a parameter fit. It affects only 3 of the 10 WSI-classification datasets; external benchmarks (Camelyon17, HunCRC, DHMC-RCC, BRACS, 13 patch-level sets) were not used in ablations, so the central multi-resolution-SSL claim retains independent s
full rationale
The paper's derivation chain is self-contained: Eq. (1) composes mViTP-C, ViTR-P, and ViTM-R without presupposing their outputs; the SSL objectives are standard DINO-style local-to-global alignments (Eq. 6); CCRA (Eqs. 2-4) is a newly defined mechanism whose benefit is established empirically (Tables 5, 8) rather than imported. No component is defined in terms of a downstream benchmark, so there is no self-definitional circularity and no Eq. X = Eq. Y by construction. Two same-group citations exist — [5] MR-PLIP (Alawode, Javed) and [58] CPLIP (Javed) — but they are used only for positioning ('MR-PLIP is the only multi-resolution patch-level model') and as comparison baselines; neither supplies a supporting theorem, uniqueness result, or ansatz, so per the hard rules they are not load-bearing and do not raise the score materially. The one concrete partial-circularity finding is benchmark reuse in model selection: Tables 2/4/5/8/9 choose backbone size, fusion strategy, and CCRA configuration by test accuracy on PANDA, BRAINS, and UBC-OCEAN, and Section 4.3 then presents SOTA-level numbers on those same datasets (PANDA 0.866 recurs from selection to final table). This is a genuine but limited selection-on-test component — 3 of 10 WSI-classification datasets and none of the patch-level or VQA suites. The paper's central claim of improved WSI representation quality is independently grounded in external datasets, so it does not reduce to a fit; the honest score is 3, reflecting the partial artifact without overstating it. Finally, the review rule requires flagging the unverifiable support passage in Section 23.1: 'Kindly note that we did not utilize any testing slide during the pre-training process of MRPT. All TCGA dataset results are reported under the test held-out setting.' Since pre-training uses 30K TCGA + 6K CPTAC WSIs (Section 21) and the key subtype results are TCGA-RCC and CPTAC-NSCLC, the absence of a slide-level manifest makes disjointness unverifiable — a correctness/data-integrity risk, explicitly excluded from the circularity score here but flagged for the correctness pass.
Assumptions & free parameters
free parameters (4)
- CCRA layers K =
1
- Hierarchical fusion blocks Q =
4
- mViTP-C branch embedding dimensions =
384 (10x), 768 (20x), 768 (40x)
- DINO local/global view budget per resolution =
8 local views, 2 global views
assumptions (4)
- domain assumption Co-registration of 10x, 20x, and 40x patches is exact: an 8x8 10x cell token, a 16x16 20x token, and a 32x32 40x token cover the same physical tissue area.
- ad hoc to paper Adjacent resolutions lie closer in feature space than distant ones (manifold locality), justifying consecutive-only cross-attention.
- domain assumption Evaluation slides from TCGA and CPTAC are disjoint from the pre-training WSIs.
- domain assumption DINO SSL objectives transfer to multi-resolution pathology inputs.
Cite this review
Pith. "Pith review of From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology." pith.science (2026). https://pith.science/paper/7IN2LPH5
@misc{pith2026260803508,
author = {Pith},
title = {Pith review of: From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology},
year = {2026},
howpublished = {\url{https://pith.science/paper/7IN2LPH5}},
note = {Machine review of arXiv:2608.03508}
}
read the original abstract
Vision Transformers (ViTs) and their hierarchical variants have achieved strong performance in Computational Pathology (CPath). However, most are pre-trained on single-resolution Whole Slide Images (WSIs), limiting their generalization across arbitrary resolutions. Gigapixel WSIs inherently contain diagnostic patterns at multiple scales, including cellular morphologies, tissue architectures, and global context, mirroring how expert pathologists examine WSIs. We introduce Multi-Resolution Pyramid Transformer (MRPT), a model that hierarchically aggregates multi-resolution information from cellular to tissue and WSI levels. MRPT employs a biologically meaningful Consecutive Cross-Resolution Attention (CCRA) mechanism to capture scale-independent interactions and enforces multi-resolution semantic consistency by aligning embeddings across resolutions, yielding robust and generalizable WSI representations. Pre-trained in a multi-resolution self-supervised manner on 624M patches, 2.4M regions, and 36K WSIs, MRPT learns rich coarse-to-fine histopathology features. Extensive experiments on 34 diverse datasets show that MRPT surpasses recent foundation models and Multimodal Large Language Models (MLLMs) in cancer subtype classification, tissue phenotyping, and Visual Question Answering (VQA) for WSI understanding.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
arXiv preprint arXiv:2412.08905 (2024) 26 16 B
Abdin, M., Aneja, J., Behl, H., Bubeck, S., Eldan, R., Gunasekar, S., Harrison, M., Hewett, R.J., Javaheripi, M., Kauffmann, P., et al.: Phi-4 technical report. arXiv preprint arXiv:2412.08905 (2024) 26 16 B. Alawode et al
arXiv 2024
-
[2]
The Journal of pathology249(3), 286–294 (2019) 1, 30
Abels, E., Pantanowitz, L., Aeffner, F., Zarella, M.D., Van der Laak, J., Bui, M.M., Vemuri, V.N., Parwani, A.V., Gibbs, J., Agosto-Arroyo, E., et al.: Compu- tational pathology definitions, best practices, and recommendations for regulatory guidance: a white paper from the digital pathology association. The Journal of pathology249(3), 286–294 (2019) 1, 30
2019
-
[3]
arXiv preprint arXiv:1412.69801412(2014) 11
Adam, K.D.B.J., et al.: A method for stochastic optimization. arXiv preprint arXiv:1412.69801412(2014) 11
arXiv 2014
-
[4]
Comput- erized Medical Imaging and Graphics95, 102027 (2022) 1
Ahmedt-Aristizabal, D., Armin, M.A., Denman, S., Fookes, C., Petersson, L.: A survey on graph-based deep learning for computational histopathology. Comput- erized Medical Imaging and Graphics95, 102027 (2022) 1
2022
-
[5]
In: Proceedings of the Computer Vision and Pattern Recognition Conference
Albastaki, S., Sohail, A., Ganapathi, I.I., Alawode, B., Khan, A., Javed, S., Werghi, N., Bennamoun, M., Mahmood, A.: Multi-resolution pathology-language pre-training model with text-guided visual representation. In: Proceedings of the Computer Vision and Pattern Recognition Conference. pp. 25907–25919 (2025) 1, 2, 4, 5, 12, 25, 30
2025
-
[6]
Journal of Pathology Informatics p
Ardon, O., Manzo, A., Spencer, J., Reuter, V.E., Hameed, M., Hanna, M.G.: Digital slide scanning at scale: Comparison of whole slide imaging devices in a clinical setting. Journal of Pathology Informatics p. 100446 (2025) 2
2025
-
[7]
PloS one14(4), e0210706 (2019) 11, 44
Arunachalam, H.B., Mishra, R., Daescu, O., Cederberg, K., Rakheja, D., Sen- gupta, A., Leonard, D., Hallac, R., Leavey, P.: Viable and necrotic tumor as- sessment from whole slide images of osteosarcoma using machine-learning and deep-learning models. PloS one14(4), e0210706 (2019) 11, 44
2019
-
[8]
arXiv preprint arXiv:2205.09723 (2022) 4, 12, 25
Azizi, S., Culp, L., Freyberg, J., Mustafa, B., Baur, S., Kornblith, S., Chen, T., MacWilliams, P., Mahdavi, S.S., Wulczyn, E., et al.: Robust and efficient medical imaging with self-supervision. arXiv preprint arXiv:2205.09723 (2022) 4, 12, 25
arXiv 2022
Show all 148 references
-
[9]
arXiv preprint arXiv:2308.12966 (2023) 12
Bai, J., Bai, S., Yang, S., Wang, S., Tan, S., Wang, P., Lin, J., Zhou, C., Zhou, J.: Qwen-vl: A versatile vision-language model for understanding, localization, text reading, and beyond. arXiv preprint arXiv:2308.12966 (2023) 12
2023 arXiv
-
[10]
Pathology International73(3), 127–134 (2023) 2, 30, 31
Baidoshvili, A., Khacheishvili, M., van der Laak, J.A., van Diest, P.J.: A whole- slide imaging based workflow reduces the reading time of pathologists. Pathology International73(3), 127–134 (2023) 2, 30, 31
2023
-
[11]
IEEE transactions on medical imaging38(2), 550–560 (2018) 11, 47
Bandi, P., Geessink, O., Manson, Q., Van Dijk, M., Balkenhol, M., Hermsen, M., Bejnordi, B.E., Lee, B., Paeng, K., Zhong, A., et al.: From detection of individual metastases to classification of lymph node status at the patient level: the came- lyon17 challenge. IEEE transacti...
2018
-
[12]
Bashashati, A., Farahani, H., Consortium, O., Karnezis, A., Akbari, A., Kim, S., Chow, A., Dane, S., Zhang, A., Asadi, M.: Ubc ovarian cancer subtype classification and outlier detection (ubc-ocean) (2023),https://kaggle.com/ competitions/UBC-OCEAN11, 47
2023
-
[13]
Informatics in Medicine Unlocked19, 100341 (2020) 11, 45
Bolhasani, H., Amjadi, E., Tabatabaeian, M., Jassbi, S.J.: A histopathological im- age dataset for grading breast invasive ductal carcinomas. Informatics in Medicine Unlocked19, 100341 (2020) 11, 45
2020
-
[14]
arXiv preprint arXiv:1912.12142v1 (2019),https://arxiv.org/abs/1912.12142 11, 44
Borkowski, A.A., Bui, M.M., Thomas, L.B., Wilson, C.P., DeLand, L.A., Mas- torides, S.M.: Lung and colon cancer histopathological image dataset (lc25000). arXiv preprint arXiv:1912.12142v1 (2019),https://arxiv.org/abs/1912.12142 11, 44
1912 arXiv
-
[15]
Database2022, baac093 (2022) 11, 46 Multi-Resolution Pyramid Transformer 17
Brancati, N., Anniciello, A.M., Pati, P., Riccio, D., Scognamiglio, G., Jaume, G., De Pietro, G., Di Bonito, M., Foncubierta, A., Botti, G., et al.: Bracs: A dataset for breast carcinoma subtyping in h&e histology images. Database2022, baac093 (2022) 11, 46 Multi-Resolution Py...
2022
-
[16]
bioRxiv pp
Brummer, O., Pölönen, P., Mustjoki, S., Brück, O.: Integrative analysis of his- tological textures and lymphocyte infiltration in renal cell carcinoma using deep learning. bioRxiv pp. 2022–08 (2022) 11, 44
2022
-
[17]
Nature Medicine28, 154–163 (2022).https://doi.org/10
Bulten, W., Kartasalo, K., Chen, P.H.C., Ström, P., Pinckaers, H., Nagpal, K., Cai, Y., Steiner, D.F., van Boven, H., Vink, R., Hulsbergen-van de Kaa, C., van der Laak, J., Amin, M.B., Evans, A.J., van der Kwast, T., Allan, R., Humphrey, P.A., Grönberg, H., Samaratunga, H., th...
2022
-
[18]
arXiv preprint arXiv:2403.17297 (2024) 26
Cai, Z., Cao, M., Chen, H., Chen, K., Chen, K., Chen, X., Chen, X., Chen, Z., Chen, Z., Chu, P., et al.: Internlm2 technical report. arXiv preprint arXiv:2403.17297 (2024) 26
2024 arXiv
-
[19]
Advances in neural information processing systems33, 9912–9924 (2020) 4
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., Joulin, A.: Unsuper- vised learning of visual features by contrasting cluster assignments. Advances in neural information processing systems33, 9912–9924 (2020) 4
2020
-
[20]
In: Proceedings of the IEEE/CVF international conference on computer vision
Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., Joulin, A.: Emerging properties in self-supervised vision transformers. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 9650–9660 (2021) 11, 33, 35
2021
-
[21]
Nature Biomedical Engineering6(12), 1420–1434 (2022) 2, 30
Chen, C., Lu, M.Y., Williamson, D.F., Chen, T.Y., Schaumberg, A.J., Mahmood, F.:Fastandscalablesearchofwhole-slideimagesviaself-superviseddeeplearning. Nature Biomedical Engineering6(12), 1420–1434 (2022) 2, 30
2022
-
[22]
In: In- ternational Conference on Medical Image Computing and Computer-Assisted In- tervention
Chen, P., Li, H., Zhu, C., Zheng, S., Shui, Z., Yang, L.: Wsicaption: Multiple instance generation of pathology reports for gigapixel whole-slide images. In: In- ternational Conference on Medical Image Computing and Computer-Assisted In- tervention. pp. 546–556. Springer (2024) 12
2024
-
[23]
Chen, P., Zhu, C., Zheng, S., Li, H., Yang, L.: Wsi-vqa: Interpreting whole slide imagesbygenerativevisualquestionanswering.In:EuropeanConferenceonCom- puter Vision. pp. 401–417. Springer (2025) 10, 36
2025
-
[24]
Chen, P., Zhu, C., Zheng, S., Li, H., Yang, L.: Wsi-vqa: Interpreting whole slide imagesbygenerativevisualquestionanswering.In:EuropeanConferenceonCom- puter Vision (ECCV) 2024. pp. 401–417 (2025).https://doi.org/10.1007/978- 3-031-72764-1_23,https://doi.org/10.1007/978-3-031-...
2024 doi
-
[25]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Chen, R.J., Chen, C., Li, Y., Chen, T.Y., Trister, A.D., Krishnan, R.G., Mah- mood, F.: Scaling vision transformers to gigapixel images via hierarchical self- supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 16144–...
2022
-
[26]
Nature Medicine30(3), 850–862 (2024) 2, 4, 8, 12, 15, 25, 38, 39, 40, 46
Chen, R.J., Ding, T., Lu, M.Y., Williamson, D.F., Jaume, G., Song, A.H., Chen, B., Zhang, A., Shao, D., Shaban, M., et al.: Towards a general-purpose foundation model for computational pathology. Nature Medicine30(3), 850–862 (2024) 2, 4, 8, 12, 15, 25, 38, 39, 40, 46
2024
-
[27]
In: Proceedings of the Computer Vision and Pattern Recognition Conference
Chen, Y., Wang, G., Ji, Y., Li, Y., Ye, J., Li, T., Hu, M., Yu, R., Qiao, Y., He, J.: Slidechat: A large vision-language assistant for whole-slide pathology image understanding. In: Proceedings of the Computer Vision and Pattern Recognition Conference. pp. 5134–5143 (2025) 3, ...
2025
-
[28]
Alawode et al
Chen, Y., Wang, G., Ji, Y., Li, Y., Ye, J., Li, T., Zhang, B., Pei, N., Yu, R., Qiao, Y., He, J.: Slidechat: A large vision-language assistant for whole-slide 18 B. Alawode et al. pathology image understanding. In: Proceedings of the IEEE/CVF Conference on Computer Vision and ...
2025
-
[29]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Chen, Y., Liu, H., Yin, H., Fan, B.: Building vision transformers with hierar- chy aware feature aggregation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 5908–5918 (2023) 28
2023
-
[30]
arXiv preprint arXiv:2205.08534 (2022) 28
Chen,Z.,Duan,Y.,Wang,W.,He,J.,Lu,T.,Dai,J.,Qiao,Y.:Visiontransformer adapter for dense predictions. arXiv preprint arXiv:2205.08534 (2022) 28
2022 arXiv
-
[31]
See https://vicuna
Chiang, W.L., Li, Z., Lin, Z., Sheng, Y., Wu, Z., Zhang, H., Zheng, L., Zhuang, S., Zhuang, Y., Gonzalez, J.E., et al.: Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality. See https://vicuna. lmsys. org (accessed 14 April 2023)2(3), 6 (2023) 26
2023
-
[32]
Labo- ratory Investigation101(4), 412–422 (2021) 1
Cui, M., Zhang, D.Y.: Artificial intelligence and computational pathology. Labo- ratory Investigation101(4), 412–422 (2021) 1
2021
-
[33]
Medical Image Analysis80, 102485 (2022) 11, 43
Da, Q., Huang, X., Li, Z., Zuo, Y., Zhang, C., Liu, J., Chen, W., Li, J., Xu, D., Hu, Z., et al.: Digestpath: A benchmark dataset with challenge review for the pathological detection and segmentation of digestive-system. Medical Image Analysis80, 102485 (2022) 11, 43
2022
-
[34]
arXiv preprint arXiv:2411.19666 (2024) 3, 5, 12, 25, 31, 38, 39
Ding, T., Wagner, S.J., Song, A.H., Chen, R.J., Lu, M.Y., Zhang, A., Vaidya, A.J., Jaume, G., Shaban, M., Kim, A., et al.: Multimodal whole slide foundation model for pathology. arXiv preprint arXiv:2411.19666 (2024) 3, 5, 12, 25, 31, 38, 39
2024 arXiv
-
[35]
arXiv preprint arXiv:2401.04079 (2024) 4, 12, 25
Dippel, J., Feulner, B., Winterhoff, T., Milbich, T., Tietz, S., Schallenberg, S., Dernbach, G., Kunft, A., Heinke, S., Eich, M.L., et al.: Rudolfv: a foundation model by pathologists for pathologists. arXiv preprint arXiv:2401.04079 (2024) 4, 12, 25
2024 arXiv
-
[36]
British journal of cancer124(4), 686–696 (2021) 1
Echle, A., Rindtorff, N.T., Brinker, T.J., Luedde, T., Pearson, A.T., Kather, J.N.: Deep learningin cancerpathology: anew generation ofclinical biomarkers. British journal of cancer124(4), 686–696 (2021) 1
2021
-
[37]
Edwards, N.J., Oberti, M., Thangudu, R.R., Cai, S., McGarvey, P.B., Jacob, S., Madhavan, S., Ketchum, K.A.: The cptac data portal: A resource for cancer proteomics research (2015).https://doi.org/10.1021/pr501254j,https:// pubs.acs.org/doi/abs/10.1021/pr501254j3, 10, 11, 42, 46
2015 doi
-
[38]
arXiv preprint arXiv:2409.09173 (2024) 12
Filiot, A., Jacob, P., Mac Kain, A., Saillard, C.: Phikon-v2, a large and public fea- ture extractor for biomarker prediction. arXiv preprint arXiv:2409.09173 (2024) 12
2024 arXiv
-
[39]
Journal of Pathology Informatics13, 100104 (2022) 2, 31, 36
Ghezloo, F., Wang, P.C., Kerr, K.F., Brunyé, T.T., Drew, T., Chang, O.H., Reisch, L.M., Shapiro, L.G., Elmore, J.G.: An analysis of pathologists’ view- ing processes as they diagnose whole slide digital images. Journal of Pathology Informatics13, 100104 (2022) 2, 31, 36
2022
-
[40]
arXiv preprint arXiv:2407.21783 (2024) 26
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., et al.: The llama 3 herd of models. arXiv preprint arXiv:2407.21783 (2024) 26
2024 arXiv
-
[41]
In: International Conference on Medical Image Computing and Computer- Assisted Intervention
Guo, Z., Ma, J., Xu, Y., Wang, Y., Wang, L., Chen, H.: Histgen: Histopathology report generation via local-global feature encoding and cross-modal context inter- action. In: International Conference on Medical Image Computing and Computer- Assisted Intervention. pp. 189–199. S...
2024
-
[42]
In: Proceedings of the Computer Vision and Pattern Recognition Conference
Guo, Z., Xiong, C., Ma, J., Sun, Q., Feng, L., Wang, J., Chen, H.: Focus: Knowledge-enhanced adaptive visual compression for few-shot whole slide image classification. In: Proceedings of the Computer Vision and Pattern Recognition Conference. pp. 15590–15600 (2025) 40
2025
-
[43]
In: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention
Guo, Z., Zhao, W., Wang, S., Yu, L.: Higt: Hierarchical interaction graph- transformer for whole slide image analysis. In: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention. pp. 755–764. Springer (2023) 3, 4
2023
-
[44]
arXiv preprint arXiv:2204.06455 (2022) 11, 43
Han, C., Pan, X., Yan, L., Lin, H., Li, B., Yao, S., Lv, S., Shi, Z., Mai, J., Lin, J., et al.: Wsss4luad: Grand challenge on weakly-supervised tissue semantic segmentation for lung adenocarcinoma. arXiv preprint arXiv:2204.06455 (2022) 11, 43
2022 arXiv
-
[45]
Advances in anatomic pathology27(4), 251–259 (2020) 2
Hanna, M.G., Parwani, A., Sirintrapun, S.J.: Whole slide imaging: technology and applications. Advances in anatomic pathology27(4), 251–259 (2020) 2
2020
-
[46]
Advances in anatomic pathology27(1), 20–26 (2020) 2
Harada, S., Morlote, D.: Molecular pathology of colorectal cancer. Advances in anatomic pathology27(1), 20–26 (2020) 2
2020
-
[47]
CoRR (2024) 12
He, S., Nie, Y., Chen, Z., Cai, Z., Wang, H., Yang, S., Chen, H.: Meddr: Diagnosis- guided bootstrapping for large-scale medical vision-language learning. CoRR (2024) 12
2024
-
[48]
arXiv preprint arXiv:2003.10286 (2020), https://arxiv.org/abs/2003.1028611, 45
He, X., Zhang, Y., Mou, L., Xing, E.P., Xie, P.: Pathvqa: 30000+ questions for medical visual question answering. arXiv preprint arXiv:2003.10286 (2020), https://arxiv.org/abs/2003.1028611, 45
2003 arXiv
-
[49]
Medical Image Analysis94, 103143 (2024) 4
Hörst, F., Rempe, M., Heine, L., Seibold, C., Keyl, J., Baldini, G., Ugurel, S., Siveke, J., Grünwald, B., Egger, J., et al.: Cellvit: Vision transformers for precise cell segmentation and classification. Medical Image Analysis94, 103143 (2024) 4
2024
-
[50]
Journal of Pathology Informatics p
Hosseini, M.S., Bejnordi, B.E., Trinh, V.Q.H., Chan, L., Hasan, D., Li, X., Yang, S., Kim, T., Zhang, H., Wu, T., et al.: Computational pathology: a survey review and the way forward. Journal of Pathology Informatics p. 100357 (2024) 1
2024
-
[51]
Nature medicine29(9), 2307–2316 (2023) 4, 12, 25
Huang, Z., Bianchi, F., Yuksekgonul, M., Montine, T.J., Zou, J.: A visual– language foundation model for pathology image analysis using medical twitter. Nature medicine29(9), 2307–2316 (2023) 4, 12, 25
2023
-
[52]
arXiv preprint arXiv:2410.21276 (2024) 12
Hurst, A., Lerer, A., Goucher, A.P., Perelman, A., Ramesh, A., Clark, A., Ostrow, A., Welihinda, A., Hayes, A., Radford, A., et al.: Gpt-4o system card. arXiv preprint arXiv:2410.21276 (2024) 12
2024 arXiv
-
[53]
Cell173(2), 283–285 (2018) 3, 10, 11, 36, 37, 42, 46
Hutter, C., Zenklusen, J.C.: The cancer genome atlas: creating lasting value be- yond its data. Cell173(2), 283–285 (2018) 3, 10, 11, 36, 37, 42, 46
2018
-
[54]
2018 (2018) 11, 44
ICIAR, B.: Grand challenge on breast cancer histology images. 2018 (2018) 11, 44
2018
-
[55]
Advances in neural information processing systems36(2024) 2, 4, 10, 12, 25, 37, 38, 41
Ikezogwo, W., Seyfioglu, S., Ghezloo, F., Geva, D., Sheikh Mohammed, F., Anand, P.K., Krishna, R., Shapiro, L.: Quilt-1m: One million image-text pairs for histopathology. Advances in neural information processing systems36(2024) 2, 4, 10, 12, 25, 37, 38, 41
2024
-
[56]
In: International conference on machine learning
Ilse, M., Tomczak, J., Welling, M.: Attention-based deep multiple instance learn- ing. In: International conference on machine learning. pp. 2127–2136. PMLR (2018) 13, 15, 39, 40
2018
-
[57]
International journal of surgical pathology32(3), 433–448 (2024) 2
Jain, E., Patel, A., Parwani, A.V., Shafi, S., Brar, Z., Sharma, S., Mohanty, S.K.: Whole slide imaging technology and its applications: Current and emerging per- spectives. International journal of surgical pathology32(3), 433–448 (2024) 2
2024
-
[58]
Alawode et al
Javed, S., Mahmood, A., Ganapathi, I.I., Dharejo, F.A., Werghi, N., Bennamoun, M.: Cplip: Zero-shot learning for histopathology with comprehensive vision- 20 B. Alawode et al. language alignment. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogni...
2024
-
[59]
In: Proceedings of the Computer Vision and Pattern Recognition Con- ference
Jiang, Y., Kwan, H.M., Peng, T., Gao, G., Zhang, F., Zhu, X., Sole, J., Bull, D.: Hiif: Hierarchical encoding based implicit image function for continuous super- resolution. In: Proceedings of the Computer Vision and Pattern Recognition Con- ference. pp. 2289–2299 (2025) 28
2025
-
[60]
IEEE Transactions on Medical Imaging (2024) 3, 4
Jin, C., Luo, L., Lin, H., Hou, J., Chen, H.: Hmil: Hierarchical multi-instance learning for fine-grained whole slide image classification. IEEE Transactions on Medical Imaging (2024) 3, 4
2024
-
[61]
In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition
Kang, M., Song, H., Park, S., Yoo, D., Pereira, S.: Benchmarking self-supervised learning on diverse pathology datasets. In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition. pp. 3344–3354 (2023) 4, 12
2023
-
[62]
Bmj374 (2021) 31
Kanth, P., Inadomi, J.M.: Screening and prevention of colorectal cancer. Bmj374 (2021) 31
2021
-
[63]
1214456,https://doi.org/10.5281/zenodo.121445611, 44
Kather, J.N., Halama, N., Marx, A.: 100,000 histological images of human col- orectal cancer and healthy tissue (2018).https://doi.org/10.5281/zenodo. 1214456,https://doi.org/10.5281/zenodo.121445611, 44
2018 doi
-
[64]
Frontiers in Oncology12, 1022967 (2022) 11, 44
Kriegsmann, K., Lobers, F., Zgorzelski, C., Kriegsmann, J., Janssen, C., Meliss, R.R., Muley, T., Sack, U., Steinbuss, G., Kriegsmann, M.: Deep learning for the detection of anatomical tissue structures and neoplasms of the skin on scanned histopathological tissue sections. Fr...
2022
-
[65]
Nature medicine27(5), 775–784 (2021) 1
Van der Laak, J., Litjens, G., Ciompi, F.: Deep learning in histopathology: the path to the clinic. Nature medicine27(5), 775–784 (2021) 1
2021
-
[66]
Gastroenterology158(2), 418–432 (2020) 31
Ladabaum, U., Dominitz, J.A., Kahi, C., Schoen, R.E.: Strategies for colorectal cancer screening. Gastroenterology158(2), 418–432 (2020) 31
2020
-
[67]
Advances in Neural Information Processing Systems36, 28541–28564 (2023) 12
Li, C., Wong, C., Zhang, S., Usuyama, N., Liu, H., Yang, J., Naumann, T., Poon, H., Gao, J.: Llava-med: Training a large language-and-vision assistant for biomedicine in one day. Advances in Neural Information Processing Systems36, 28541–28564 (2023) 12
2023
-
[68]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Li, J., Chen, Y., Chu, H., Sun, Q., Guan, T., Han, A., He, Y.: Dynamic graph representation with knowledge-aware attention for histopathology whole slide im- age analysis. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 11323–11332 (2024) 40
2024
-
[70]
arXiv preprint arXiv:2412.02141 (2024),https: //arxiv.org/abs/2412.0214111, 47
Liang, Y., Lyu, X., Ding, M., Chen, W., Zhang, J., Ren, Y., He, X., Wu, S., Yang, S., Wang, X., Xing, X., Shen, L.: Wsi-llava: A multimodal large language model for whole slide image. arXiv preprint arXiv:2412.02141 (2024),https: //arxiv.org/abs/2412.0214111, 47
2024 arXiv
-
[71]
JNCI: Journal of the National Cancer Institute116(10), 1612–1620 (2024) 31
Nascimento de Lima, P., Van Den Puttelaar, R., Knudsen, A.B., Hahn, A.I., Kuntz, K.M., Ozik, J., Collier, N., Alarid-Escudero, F., Zauber, A.G., Inadomi, J.M., et al.: Characteristics of a cost-effective blood test for colorectal cancer screening. JNCI: Journal of the National...
2024
-
[72]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Liu,H.,Li,C.,Li,Y.,Lee,Y.J.:Improvedbaselineswithvisualinstructiontuning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 26296–26306 (2024) 12 Multi-Resolution Pyramid Transformer 21
2024
-
[73]
Advances in neural information processing systems36, 34892–34916 (2023) 3
Liu, H., Li, C., Wu, Q., Lee, Y.J.: Visual instruction tuning. Advances in neural information processing systems36, 34892–34916 (2023) 3
2023
-
[74]
In: Proceedings of the IEEE/CVF international conference on computer vision
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin trans- former: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 10012–10022 (2021) 28
2021
-
[75]
arXiv preprint arXiv:1608.03983 (2016) 11
Loshchilov, I., Hutter, F.: Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 (2016) 11
2016 arXiv
-
[76]
Archives of pathology & laboratory medicine140(1), 41–50 (2016) 1
Louis, D.N., Feldman, M., Carter, A.B., Dighe, A.S., Pfeifer, J.D., Bry, L., Almeida, J.S., Saltz, J., Braun, J., Tomaszewski, J.E., et al.: Computational pathology: a path ahead. Archives of pathology & laboratory medicine140(1), 41–50 (2016) 1
2016
-
[77]
Nature Medicine30(3), 863–874 (2024) 2, 4, 12, 25, 38, 40, 41
Lu, M.Y., Chen, B., Williamson, D.F., Chen, R.J., Liang, I., Ding, T., Jaume, G., Odintsov, I., Le, L.P., Gerber, G., et al.: A visual-language foundation model for computational pathology. Nature Medicine30(3), 863–874 (2024) 2, 4, 12, 25, 38, 40, 41
2024
-
[78]
Nature pp
Lu, M.Y., Chen, B., Williamson, D.F., Chen, R.J., Zhao, M., Chow, A.K., Ike- mura, K., Kim, A., Pouli, D., Patel, A., et al.: A multimodal generative ai copilot for human pathology. Nature pp. 1–3 (2024) 5, 36
2024
-
[79]
In: Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition
Lu, M.Y., Chen, B., Zhang, A., Williamson, D.F., Chen, R.J., Ding, T., Le, L.P., Chuang, Y.S., Mahmood, F.: Visual language pretrained multiple instance zero- shot transfer for histopathology images. In: Proceedings of the IEEE/CVF con- ference on computer vision and pattern r...
2023
-
[80]
In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition Workshops
Lu, W., Graham, S., Bilal, M., Rajpoot, N., Minhas, F.: Capturing cellular topol- ogy in multi-gigapixel pathology images. In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition Workshops. pp. 260–261 (2020) 2
2020
-
[81]
geneva, switzerland: World health orga- nization, international agency for research on cancer, who press, 2015
McGuire, S.: World cancer report 2014. geneva, switzerland: World health orga- nization, international agency for research on cancer, who press, 2015. Advances in nutrition7(2), 418 (2016) 1
2014
-
[82]
Nature Communications16(1), 5493 (2025) 2, 30
Nan, T., Zheng, S., Qiao, S., Quan, H., Gao, X., Niu, J., Zheng, B., Guo, C., Zhang, Y., Wang, X., et al.: Deep learning quantifies pathologists’ visual patterns for whole slide image diagnosis. Nature Communications16(1), 5493 (2025) 2, 30
2025
-
[83]
Scientific Data9(1), 370 (2022) 11, 46
Pataki, B.Á., Olar, A., Ribli, D., Pesti, A., Kontsek, E., Gyöngyösi, B., Bilecz, Á., Kovács,T.,Kovács,K.A.,Kramer,Z.,etal.:Huncrc:annotatedpathologicalslides to enhance deep learning applications in colorectal cancer screening. Scientific Data9(1), 370 (2022) 11, 46
2022
-
[84]
Oral oncology45(4-5), 454–460 (2009) 1
Petersen, P.E.: Oral cancer prevention and control–the approach of the world health organization. Oral oncology45(4-5), 454–460 (2009) 1
2009
-
[85]
Advances in Neural Information Processing Systems36, 67551–67564 (2023) 40
Qu, L., Fu, K., Wang, M., Song, Z., et al.: The rise of ai language patholo- gists: Exploring two-level prompt learning for few-shot weakly-supervised whole slide image classification. Advances in Neural Information Processing Systems36, 67551–67564 (2023) 40
2023
-
[86]
Advances in Neural Information Processing Systems36 (2024) 1 22 B
Qu, L., Fu, K., Wang, M., Song, Z., et al.: The rise of ai language patholo- gists: Exploring two-level prompt learning for few-shot weakly-supervised whole slide image classification. Advances in Neural Information Processing Systems36 (2024) 1 22 B. Alawode et al
2024
-
[87]
In: International conference on machine learning
Radford,A.,Kim,J.W.,Hallacy,C.,Ramesh,A.,Goh,G.,Agarwal,S.,Sastry,G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International conference on machine learning. pp. 8748–8763. PMLR (2021) 4, 12, 36
2021
-
[88]
Medical Image Analysis68, 101890 (2021).https : / / doi
van Rijthoven, M., Balkenhol, M., Silin,a, K., van der Laak, J., Ciompi, F.: Hooknet: Multi-resolution convolutional neural networks for semantic segmenta- tion in histopathology whole-slide images. Medical Image Analysis68, 101890 (2021).https : / / doi . org / 10 . 1016 / j ...
2021
-
[89]
Scientific Data9(1), 55 (2022) 11, 46
Roetzer-Pejrimovsky, T., Moser, A.C., Atli, B., Vogel, C.C., Mercea, P.A., Pri- hoda, R., Gelpi, E., Haberler, C., Höftberger, R., Hainfellner, J.A., et al.: The digital brain tumour atlas, an open histopathology resource. Scientific Data9(1), 55 (2022) 11, 46
2022
-
[90]
Archives of pathology & laboratory medicine146(10), 1273–1280 (2022) 2, 31, 36
Schüffler, P.J., Stamelos, E., Ahmed, I., Yarlagadda, D.V.K., Ardon, O., Hanna, M.G., Reuter, V.E., Klimstra, D.S., Hameed, M.: Efficient visualization of whole slide images in web-based viewers for digital pathology. Archives of pathology & laboratory medicine146(10), 1273–12...
2022
-
[91]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Seyfioglu, M.S., Ikezogwo, W.O., Ghezloo, F., Krishna, R., Shapiro, L.: Quilt- llava: Visual instruction tuning by extracting localized narratives from open- source histopathology videos. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp...
2024
-
[92]
arXiv preprint arXiv:2405.10254 (2024) 12, 40
Shaikovski, G., Casson, A., Severson, K., Zimmermann, E., Wang, Y.K., Kunz, J.D., Retamero, J.A., Oakley, G., Klimstra, D., Kanan, C., et al.: Prism: A multi- modal generative foundation model for slide-level histopathology. arXiv preprint arXiv:2405.10254 (2024) 12, 40
2024 arXiv
-
[93]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Shi, J., Li, C., Gong, T., Zheng, Y., Fu, H.: Vila-mil: Dual-scale vision-language multiple instance learning for whole slide image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11248–11258 (2024) 40
2024
-
[94]
IEEE journal of biomedical and health informatics25(8), 3094–3104 (2021) 11, 43
Silva-Rodriguez, J., Colomer, A., Dolz, J., Naranjo, V.: Self-learning for weakly supervised gleason grading of local patterns. IEEE journal of biomedical and health informatics25(8), 3094–3104 (2021) 11, 43
2021
-
[95]
Na- ture Reviews Bioengineering1(12), 930–949 (2023) 1, 2
Song, A.H., Jaume, G., Williamson, D.F., Lu, M.Y., Vaidya, A., Miller, T.R., Mahmood, F.: Artificial intelligence for digital and computational pathology. Na- ture Reviews Bioengineering1(12), 930–949 (2023) 1, 2
2023
-
[96]
Medical image analysis67, 101813 (2021) 1, 2
Srinidhi, C.L., Ciga, O., Martel, A.L.: Deep neural network models for compu- tational histopathology: A survey. Medical image analysis67, 101813 (2021) 1, 2
2021
-
[97]
In: Proceedings of the Computer Vision and Pattern Recognition Conference
Sun, Y., Si, Y., Zhu, C., Gong, X., Zhang, K., Chen, P., Zhang, Y., Shui, Z., Lin, T., Yang, L.: Cpath-omni: A unified multimodal foundation model for patch and whole slide image analysis in computational pathology. In: Proceedings of the Computer Vision and Pattern Recognitio...
2025
-
[98]
Sun, Y., Wu, H., Zhu, C., Zheng, S., Chen, Q., Zhang, K., Yunlong, Z., Lan, X., Zheng, M., Li, J., Lyu, X., Lin, T., Yang, L.: Pathmmu: A massive multimodal expert-level benchmark for understanding and reasoning in pathology (2024), https://arxiv.org/abs/2401.1635511, 45
2024 arXiv
-
[99]
arXiv preprint arXiv:2407.00203 (2024) 12, 36 Multi-Resolution Pyramid Transformer 23
Sun, Y., Zhang, Y., Si, Y., Zhu, C., Shui, Z., Zhang, K., Li, J., Lyu, X., Lin, T., Yang, L.: Pathgen-1.6 m: 1.6 million pathology image-text pairs generation through multi-agent collaboration. arXiv preprint arXiv:2407.00203 (2024) 12, 36 Multi-Resolution Pyramid Transformer 23
2024 arXiv
-
[100]
In: Proceedings of the AAAI Conference on Artificial Intelligence
Sun, Y., Zhu, C., Zheng, S., Zhang, K., Sun, L., Shui, Z., Zhang, Y., Li, H., Yang, L.: Pathasst: A generative foundation ai assistant towards artificial general intelligence of pathology. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 38, pp. 5034–504...
2024
-
[101]
arXiv preprint arXiv:2312.11805 (2023) 12
Team, G., Anil, R., Borgeaud, S., Alayrac, J.B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A.M., Hauth, A., Millican, K., et al.: Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023) 12
2023 arXiv
-
[102]
Gas- trointestinal tumors7(3), 62–73 (2020) 2
Tepus, M., Yau, T.O.: Non-invasive colorectal cancer screening: an overview. Gas- trointestinal tumors7(3), 62–73 (2020) 2
2020
-
[103]
The Journal of Pathology265(2), 198– 210 (2025) 31
Trahearn, N., Sakr, C., Banerjee, A., Lee, S.H., Baker, A.M., Kocher, H.M., An- gerilli, V., Morano, F., Bergamo, F., Maddalena, G., et al.: Computational pathol- ogy applied to clinical colorectal cancer cohorts identifies immune and endothelial cell spatial patterns predicti...
2025
-
[104]
In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part II 11
Veeling, B.S., Linmans, J., Winkens, J., Cohen, T., Welling, M.: Rotation equiv- ariant cnns for digital pathology. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Pa...
2018
-
[105]
Nature Medicine pp
Vorontsov, E., Bozkurt, A., Casson, A., Shaikovski, G., Zelechowski, M., Severson, K., Zimmermann, E., Hall, J., Tenenholtz, N., Fusi, N., et al.: A foundation model for clinical-grade computational pathology and rare cancers detection. Nature Medicine pp. 1–12 (2024) 4, 12, 25, 40
2024
-
[106]
Medical image analysis81, 102559 (2022) 2, 12, 40
Wang,X.,Yang,S.,Zhang,J.,Wang,M.,Zhang,J.,Yang,W.,Huang,J.,Han,X.: Transformer-based unsupervised contrastive learning for histopathological image classification. Medical image analysis81, 102559 (2022) 2, 12, 40
2022
-
[107]
Nature pp
Wang, X., Zhao, J., Marostica, E., Yuan, W., Jin, J., Zhang, J., Li, R., Tang, H., Wang, K., Li, Y., et al.: A pathology foundation model for cancer diagnosis and prognosis prediction. Nature pp. 1–9 (2024) 4, 12, 25, 40
2024
-
[108]
arXiv preprint arXiv:1911.04623 (2019) 39
Wang, Y., Chao, W.L., Weinberger, K.Q., van der Maaten, L.: Simpleshot: Revisiting nearest-neighbor classification for few-shot learning. arXiv preprint arXiv:1911.04623 (2019) 39
1911 arXiv
-
[109]
In: Artificial Intelligence in Medicine: 19th International Conference on Artificial Intelligence in Medicine, AIME 2021, Virtual Event, June 15–18, 2021, Proceedings
Wei, J., Suriawinata, A., Ren, B., Liu, X., Lisovsky, M., Vaickus, L., Brown, C., Baker, M., Tomita, N., Torresani, L., et al.: A petri dish for histopathology image analysis. In: Artificial Intelligence in Medicine: 19th International Conference on Artificial Intelligence in ...
2021
-
[110]
Nature pp
Xu, H., Usuyama, N., Bagga, J., Zhang, S., Rao, R., Naumann, T., Wong, C., Gero, Z., González, J., Gu, Y., et al.: A whole-slide foundation model for digital pathology from real-world data. Nature pp. 1–8 (2024) 3, 4, 8, 12, 25, 40
2024
-
[111]
Technical Report arXiv:2407.10671, CoRR, arXiv (2024),https://arxiv.org/abs/2407.10671 10, 26, 36, 37
Yang, A., Yang, B., Hui, B., Zheng, B., Yu, B., Zhou, C., Li, C., Li, C., Liu, D., Huang, F., et al., G.D.: Qwen2 technical report. Technical Report arXiv:2407.10671, CoRR, arXiv (2024),https://arxiv.org/abs/2407.10671 10, 26, 36, 37
2024 arXiv
-
[112]
Archives of pathology & laboratory medicine143(2), 222–234 (2019) 2
Zarella, M.D., Bowman, D., Aeffner, F., Farahani, N., Xthona, A., Absar, S.F., Parwani, A., Bui, M., Hartman, D.J.: A practical guide to whole slide imaging: a white paper from the digital pathology association. Archives of pathology & laboratory medicine143(2), 222–234 (2019) 2
2019
-
[113]
The Journal of Pathology257(4), 383–390 (2022) 2, 30 24 B
Zarella,M.D.,RiveraAlvarez,K.:High-throughputwhole-slidescanningtoenable large-scale data repository building. The Journal of Pathology257(4), 383–390 (2022) 2, 30 24 B. Alawode et al
2022
-
[114]
Pain63(1), 65–76 (1995) 1
Zech, D.F., Grond, S., Lynch, J., Hertel, D., Lehmann, K.A.: Validation of world health organization guidelines for cancer pain relief: a 10-year prospective study. Pain63(1), 65–76 (1995) 1
1995
-
[115]
arXiv preprint arXiv:2305.10415 (2023),https://arxiv.org/abs/2305.1041511, 45
Zhang, X., Wu, C., Zhao, Z., Lin, W., Zhang, Y., Wang, Y., Xie, W.: Pmc-vqa: Visual instruction tuning for medical visual question answering. arXiv preprint arXiv:2305.10415 (2023),https://arxiv.org/abs/2305.1041511, 45
2023 arXiv
-
[116]
Nature Machine Intelligence1(5), 236–245 (2019) 30
Zhang, Z., Chen, P., McGough, M., Xing, F., Wang, C., Bui, M., Xie, Y., Sapkota, M., Cui, L., Dhillon, J., et al.: Pathologist-level interpretable whole-slide cancer diagnosis with deep learning. Nature Machine Intelligence1(5), 236–245 (2019) 30
2019
-
[117]
In: European Confer- ence on Computer Vision
Zhou, X., Zhang, X., Wu, C., Zhang, Y., Xie, W., Wang, Y.: Knowledge-enhanced visual-language pretraining for computational pathology. In: European Confer- ence on Computer Vision. pp. 345–362. Springer (2024) 12
2024
-
[118]
Zhu, M., Ren, B., Richards, R., Suriawinata, M., Tomita, N., Hassanpour, S.: Development and evaluation of a deep neural network for histologic classification of renal cell carcinoma on biopsy and surgical resection slides. Scientific reports 11(1), 7080 (2021) 11, 46 Multi-Re...
2021
-
[119]
[39,90]. Low-resolution representations capture global spatial context but lack discriminative fine detail, whereas high-resolution representations provide localized discriminatory power but are contextually ambiguous [10]. Theoreti- cal frameworks in hierarchical representati...
-
[120]
It encompasses three distinct classes: tumor, tumor- associated stroma, and normal
WSSS4LUAD (2 Classes):is a lung adenocarcinoma dataset containing tiles of200×500pixels [44]. It encompasses three distinct classes: tumor, tumor- associated stroma, and normal. We conducted a binary classification of tumor vs. normal. The training dataset comprises 7,063 imag...
-
[121]
It encompasses512×512pixels tiles extracted from 155 WSIs
SICAP (4 Classes):is a prostate cancer dataset tailored for Gleason pattern classification [94]. It encompasses512×512pixels tiles extracted from 155 WSIs. The official training split comprises 9,959 images sourced from 124 WSIs, while the testing split includes 2,122 images f...
-
[122]
Similar to PLIP, we performed tile-based zero-shot classification for Tumor Vs
DigestPath (2 Classes):is a colonoscopy dataset containing H&E 660 tis- sue images [33]. Similar to PLIP, we performed tile-based zero-shot classification for Tumor Vs. Normal on the testing split containing 18814 images
-
[123]
Alawode et al
RC100K (9 Classes):is a colorectal cancer dataset comprising H&E stained imagesencompassingninedistinctclassesincludingAdipose,background,debris, lymphocytes, mucus, smooth muscle, normal colon mucosa, cancer-associated 44 B. Alawode et al. stroma, and colorectal adenocarcinom...
-
[124]
The dataset consists of 52,713 H&E-stained images with300×300pixels captured at 40×
RenalCell (5 Classes):dataset contains histology patterns of clear-cell renal cell carcinoma [16]. The dataset consists of 52,713 H&E-stained images with300×300pixels captured at 40×. The dataset is annotated into five dis- tinct classes, including red blood cells, renal cance...
-
[125]
The tiles are annotated into two classes, including hyperplastic polyps and sessile serrated adenomas
MHIST (2 Classes):is a colorectal polyps dataset that contains 3,152 tis- sue patches of size224×224pixels extracted at 40×magnification level from 328 WSIs [109]. The tiles are annotated into two classes, including hyperplastic polyps and sessile serrated adenomas. For traini...
-
[126]
This dataset is collected from 400 WSIs, containing 327,680 H&E stained histology images with 96×96 pixel tiles
PatchCamelyon (2 Classes):is a breast cancer dataset containing normal and metastatic tumor tissues [104]. This dataset is collected from 400 WSIs, containing 327,680 H&E stained histology images with 96×96 pixel tiles. The samples are extracted from lymph node sections at 10×...
-
[127]
The dataset is collected from 40 hetero- geneous WSIs at 10×magnification level
Osteo (3 Classes):dataset focuses on osteosarcoma and contains 1,144 patches of size1024×1024pixels [7]. The dataset is collected from 40 hetero- geneous WSIs at 10×magnification level. The dataset contains three distinct classes, including tumor, non-tumor, and necrotic tumor...
-
[128]
The dataset is classified into four different tissue types, including normal, benign, in-situ carcinoma, and invasive carcinoma
BACH (4 Classes):is a breast cancer dataset containing 500 large tiles, each with2048×1536pixels captured at 40×magnification and sampled from 500 WSIs [54]. The dataset is classified into four different tissue types, including normal, benign, in-situ carcinoma, and invasive c...
-
[129]
The patches are captured at 10×magnification from patients with basal cell carcinoma, squamous cell carci- noma, naevi, and melanoma
SkinCancer (16 Classes):comprises 36,890 skin tissue patches extracted from 386 patients, each with395×395pixels [64]. The patches are captured at 10×magnification from patients with basal cell carcinoma, squamous cell carci- noma, naevi, and melanoma. The tiles are categorize...
-
[130]
This dataset contains two classes: benign colon tissue and colon adenocarcino- mas
LC25000Colon (2 Classes):is a colon cancer dataset containing H&E stained images each of size768×768pixels extracted from 500 patients [14]. This dataset contains two classes: benign colon tissue and colon adenocarcino- mas. The official training and testing splits are provide...
-
[131]
The dataset encompasses three classes, including lung adenocarcinoma, benign Multi-Resolution Pyramid Transformer 45 lung, and lung squamous cell carcinoma
LC25000Lung (3 Classes):is a lung cancer dataset comprising 25K H&E stained images corresponding to768×768pixels extracted from 750 patients [14]. The dataset encompasses three classes, including lung adenocarcinoma, benign Multi-Resolution Pyramid Transformer 45 lung, and lun...
-
[132]
This dataset comprises 922 samples, corresponding to2100×1574and1276×956pixels
Databiox (3 Classes):is an invasive ductal carcinoma dataset collected from pathological biopsy samples of 124 patients [13]. This dataset comprises 922 samples, corresponding to2100×1574and1276×956pixels. Each sample is captured at four different levels of magnification, incl...
-
[133]
It includes a total of 985 images and 1,283 QA pairs, with the questions categorized into 940 open-ended and 343 closed-ended types
Quilt-VQA:comprises 1,961 VQA pairs curated from naturally occurring question–answer interactions narrated within the QUILT videos [91]. It includes a total of 985 images and 1,283 QA pairs, with the questions categorized into 940 open-ended and 343 closed-ended types
-
[134]
The questions are divided into two categories: open-ended and closed-ended
PathVQA:contains 32,799 question–answer pairs derived from 4,998 pathol- ogy image–caption pairs collected from textbooks and digital libraries [48]. The questions are divided into two categories: open-ended and closed-ended. Open- ended questions include types such as what, w...
-
[135]
The dataset was constructed from image–caption pairs in PMC-OA articles and pre- sented in a multiple-choice format
PMC-VQA v2: consists of a test set containing 34,823 VQA pairs derived from non-compound images spanning various modalities and diseases [115]. The dataset was constructed from image–caption pairs in PMC-OA articles and pre- sented in a multiple-choice format. From this resour...
-
[136]
Questions were generated using GPT-4V and include expert-validated explana- tions, with seven pathologists reviewing the validation and test sets
PathMMU-VQA:dataset contains 33,428 multiple-choice VQA pairs de- rived from 24,067 pathology images spanning diverse organs and diseases [98]. Questions were generated using GPT-4V and include expert-validated explana- tions, with seven pathologists reviewing the validation a...
-
[137]
Each slide is assigned an ISUP score that defines prostate cancer grade (6-class grading task)
PANDA (6 classes)is the International Society of Urological Pathology (ISUP)gradingtaskderivedfromthePANDAchallenge[17].Itconsistsof10,616 prostate cancer core needle biopsies of the prostate. Each slide is assigned an ISUP score that defines prostate cancer grade (6-class gra...
-
[138]
HunCRC (4 Classes)is colorectal cancer screening dataset containing of 200 H&E diagnostic histopathology WSIs [83]. Similar to UNI [26], we employed a 4-way coarse-grained subtyping task using the categories of normal (10 slides), non-neoplastic lesion (38 slides), CRC (46 sli...
-
[139]
BRAINS [89] (30 classes)is a dataset consists of H&E histopathology WSIs of brain tissue selected from The Digital Brain Tumour Atlas an open histopathology resource. Similar to the CONCH [79], we used a subset of 2,319 WSIs out of 3,114 WSIs and defined a 30-way fine-grained ...
-
[140]
The dataset contains 3 classes, including benign, atypical, and malignant tumor labels
BRCA-BRACS (3 classes)is a BReast CAncer (BRCA) dataset contain- ing 547 breast carcinoma H&E WSIs from 187 patients sourced from the breast carcinoma subtyping task [15]. The dataset contains 3 classes, including benign, atypical, and malignant tumor labels. For training and ...
-
[141]
All TCGA dataset results are reported under the test held-out setting
TCGA-RCC (3 classes)This dataset contains 477 normal WSIs and 726 WSIs with three cancer subtypes, including Kidney Renal Papillary Cell Carci- noma (KIRP) (218 WSIs) [53], Kidney Renal Clear Cell Carcinoma (KIRC) (390 WSIs), and Kidney Chromophobe Renal Cell Carcinoma (KICH) ...
-
[142]
DHMC-RCC (5 classes)is a Renal Cell Carcinoma (RCC) subtyping dataset consisting of 563 RCC H&E diagnostic histopathology WSIs [118]. The dataset contains six cancer subtypes, including primary Clear Cell Renal Cell Carcinoma (CCRCC) (344 slides), Papillary Renal Cell Carcinom...
-
[143]
The Camelyon17 dataset contains 1000 WSIs with 5 slides per patient
CAMELYON17 (CAM17) (2 Classes)is a breast cancer dataset gener- ated from a sentinel lymph node section of the Breast from 200 patients [11]. The Camelyon17 dataset contains 1000 WSIs with 5 slides per patient. The WSI is labeled as metastasis vs. normal. The proposed model is...
-
[144]
It covers five subtypes: Clear Cell (CC), Endometrioid (EC), High-Grade Serous Carcinoma (HGSC), Low-Grade Serous Carcinoma (LGSC), and Mucinous Carcinoma (MC)
UBC-OCEAN (5 Classes)comprises 538 whole-slide images, preprocessed to 527 that meet foreground tissue criteria [12]. It covers five subtypes: Clear Cell (CC), Endometrioid (EC), High-Grade Serous Carcinoma (HGSC), Low-Grade Serous Carcinoma (LGSC), and Mucinous Carcinoma (MC)...
-
[145]
SlideBench-Caption: consists of 734 WSIs, each paired with human-written captionsdescribingtheslides[28].Itisorganizedintoatrainingsetof4,181WSI- caption pairs and a test set of 734 WSIs, enabling evaluation of vision-language modelsongeneratingaccurateandcoherentslidedescript...
-
[146]
SlideBench-VQA (BNCB): contains 7,247 VQA pairs collected from 1,058 patients, created to assess SlideChat’s ability to perform zero-shot generalization across seven different classification tasks [28]
-
[147]
Of these, 4,535 are close-ended and 4,137 are open-ended questions
WSI-VQA:dataset consists of 977 whole-slide images (WSIs) paired with 8,672 QA pairs, averaging about 8.9 QA pairs per WSI [24]. Of these, 4,535 are close-ended and 4,137 are open-ended questions
-
[148]
All TCGA dataset results are reported under the test held-out setting
WSI-Bench (Pathological Capabilities): consists of 179,569 VQA pairs in total, with the training set containing 175,450 pairs (122,133 open-ended and 53,317 closed-ended) across 9,642 WSIs, and the test set comprising 4,119 pairs (2,838 open-ended and 1,281 closed-ended) from ...
-
[149]
All TCGA dataset results are reported under the test held-out setting
WSI-Bench(Report): In addition to its pathological capabilities, WSI- Bench includes 208 report generation VQA pairs [70]. All TCGA dataset results are reported under the test held-out setting
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.