Pith. sign in

REVIEW 2 major objections 5 minor 1 cited by

Treating the patient case—not the single slide—as the unit of representation yields transferable whole-slide pathology embeddings from public data alone.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.5

2026-07-13 17:14 UTC pith:IMYWIFBD

load-bearing objection Solid public patient-level WSI recipe with real transfer gains; the case-transformer story is a bit ahead of the multi-slide data density. the 2 major comments →

arxiv 2603.27048 v3 pith:IMYWIFBD submitted 2026-03-27 cs.CV

MOOZY: A Patient-First Foundation Model for Computational Pathology

Yousef Kotp , Vincent Quoc-Huy Trinh , Christopher Pal , Mahdi S. Hosseini This is my paper
classification cs.CV
keywords computational pathologywhole-slide imagesfoundation modelsself-supervised learningslide encoderpatient-level representationmulti-task learningcase transformer
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Computational pathology needs foundation models that transfer across organs, endpoints, and cohorts, but most current systems encode slides in isolation, fuse multi-slide cases with simple averaging, and often depend on private data or costly paired reports. This paper argues that the right unit of representation is the patient case, and that cross-slide dependencies should be modeled explicitly during pretraining rather than patched in later. MOOZY first learns a vision-only slide encoder by masked self-distillation on tens of thousands of public feature grids, then steers those features with a case transformer under multi-task supervision over hundreds of classification and survival tasks drawn only from public datasets. On held-out clinical probes the resulting case embeddings match or beat larger slide-centric models while using far fewer parameters. A sympathetic reader cares because the recipe is open, reproducible, and closer to how multi-slide cases are actually read in the clinic.

Core claim

Open patient-level pretraining—vision-only masked self-distillation of a slide encoder followed by multi-task semantic alignment through an explicit case transformer—produces transferable case embeddings that improve macro-averaged frozen-probe metrics over strong slide-centric baselines while remaining parameter-efficient and free of private slides or paired-report supervision.

What carries the argument

The two-stage MOOZY framework, centered on the case transformer: a lightweight aggregator that prepends a learnable [CASE] token to all slide embeddings from one patient and models inter-slide dependencies, yielding a single patient-centric embedding used for multi-task classification and survival heads in Stage 2.

Load-bearing premise

The argument assumes public multi-slide cases supply enough genuine cross-slide diagnostic signal for the case transformer to learn transferable dependencies, even though many cases are single-slide and the average slide-to-patient ratio is only about 1.33.

What would settle it

On a held-out multi-slide cohort where the clinical label truly requires joint reading of several slides, freeze the same Stage-2 slide encoder and compare the full case transformer against mean pooling of its slide embeddings; if the performance gap disappears or reverses, the claim that explicit inter-slide modeling is doing the work fails.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • Competitive pathology foundation embeddings can be trained without proprietary slides or paired clinical reports.
  • Model capacity is better spent on slide- and case-level aggregation than on ever-larger patch encoders.
  • Explicit inter-slide modeling improves case-level tasks beyond naive early or late multi-slide fusion.
  • Large-scale public multi-task supervision (classification plus multiple survival endpoints) can ground general-purpose case embeddings.
  • Parameter-efficient patient-first models become a practical alternative to billion-parameter slide encoders for transfer settings.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Gains should be largest on cohorts built for multifocal staging, heterogeneity, or prognosis, where cross-slide signal is dense rather than incidental.
  • The same patient-centric embedding could support case-level retrieval, slide-report co-training, or genomic fusion without redesigning the core unit of representation.
  • If public slide-to-patient ratios stay near one, further progress may depend as much on richer multi-slide public cohorts as on architecture.
  • Sparse multi-task clinical supervision may regularize embedding geometry even when individual task labels are incomplete or weakly related.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. MOOZY is a two-stage, fully public-data pathology foundation model that treats the patient case as the core representation unit. Stage 1 pretrains a compact ViT slide encoder on 77,134 public feature grids via masked self-distillation; Stage 2 fine-tunes it with a lightweight case transformer under multi-task supervision on 333 classification and survival tasks from 56 public datasets. The model is evaluated with five-fold patient-grouped frozen MLP probes on eight held-out tasks against five slide encoders and five MIL families, plus ablations of Stage 1, Stage 2, and the case aggregator. The central claim is that open patient-level pretraining with explicit inter-slide modeling yields transferable case embeddings that improve macro-averaged metrics over strong slide-centric baselines while remaining parameter-efficient (85.77M).

Significance. If the gains hold under broader multi-slide evaluation, the work is a useful practical contribution: it shows that competitive WSI foundation embeddings can be obtained from public data alone without proprietary slides, paired reports, or billion-parameter tile encoders, and it releases a full recipe and code. The two-stage decoupling of vision SSL from multi-task semantic alignment, the large harmonized public task suite, and the parameter-efficiency comparison are concrete strengths. The patient-first framing is timely for clinical workflows that routinely use multiple slides per case, even if the depth of learned cross-slide reasoning remains to be stress-tested.

major comments (2)
  1. The load-bearing claim that the case transformer learns transferable inter-slide dependencies is only weakly supported by the training distribution. Sec. 4 reports a mean slide-to-patient ratio of ~1.33, many singleton cases (datasets without patient IDs treated as S_i=1), and sparse multi-task labels. Applying the aggregator to single-slide cases keeps the embedding space patient-centric but does not create multi-slide interactions. Table 3 shows a ~3–4% absolute F1 lift from mean pooling (0.771) to the full case transformer (0.801); this could be extra capacity or multi-task regularization rather than genuine slide-to-slide reasoning. The Conclusion itself notes that benefits of deeper multi-slide reasoning remain to be quantified on tasks designed for it. Please either (i) report the fraction of multi-slide cases (S_i≥2) in Stage 2 and in each held-out task, with a stratified ablation
  2. Abstract vs. body inconsistency on evaluation scale. The abstract claims “sixteen held-out tasks” and gains vs. PRISM of +4.19% / +7.93% / +6.95%, while Sec. 5 and Table 1 report eight held-out tasks with different macro deltas vs. PRISM (+8.83% F1, +10.70% balanced accuracy, +9.78% AUC in the abstract of the body text). Align the abstract, main results, and any supplementary tables so the held-out set size and the reported deltas are identical and reproducible.
minor comments (5)
  1. Fig. 1 caption and panel (a) use eight tasks; ensure the abstract’s “sixteen” is either corrected or explained as an expanded set with a clear pointer to the table that contains all sixteen.
  2. Table 1: Treatment Response has high variance (±0.14–0.17); a short note on sample size and why conclusions are limited would help readers.
  3. Clarify in Sec. 4 how many of the 41,089 supervised cases are true multi-slide cases versus singleton slides treated as cases.
  4. Notation: the abstract uses “macro weighted F1” while tables use “weighted F1”; make the aggregation (macro over tasks of weighted-per-task metrics) explicit once.
  5. Minor typos: “alginment” in Appendix F heading; “siZe” in the MOOZY expansion is stylized but may confuse indexing.

Circularity Check

0 steps flagged

No circularity: empirical foundation-model paper with held-out probes and ablations; no quantity is defined from its own target.

full rationale

MOOZY is a two-stage representation-learning paper (masked self-distillation on public slide grids, then multi-task case-level alignment). Held-out tasks are excluded from both stages; evaluation is frozen-feature MLP/linear probes with patient-level folds; ablations compare Stage-1 only, Stage-2 only, mean pooling vs case transformer, and external slide encoders/MILs. Performance numbers are measured, not derived from fitted constants re-presented as predictions. Self-citations (AtlasPatch, DINOv2-style recipes, prior MIL/slide encoders) are ordinary methodological references, not uniqueness theorems or closed-loop premises that force the result. The skeptic concern about sparse multi-slide signal (mean slide-to-patient ratio ~1.33) is a validity/assumption issue about what the case transformer actually learns, not circularity: the paper does not define inter-slide dependency in terms of the held-out metrics, nor fit a parameter on those metrics and call it a prediction. No self-definitional step, fitted-input-as-prediction, load-bearing self-citation uniqueness claim, or renaming of a known result as a first-principles derivation appears in the derivation chain.

Axiom & Free-Parameter Ledger

4 free parameters · 4 axioms · 1 invented entities

The central claim rests on standard deep-learning practice plus a small set of modeling choices that define the patient-first unit. No new physical entities are postulated; free parameters are ordinary architecture and optimization hyperparameters; the main domain assumptions are that public multi-task labels and modest multi-slide ratios are sufficient to learn transferable case structure.

free parameters (4)
  • Slide-encoder depth/width (D=6, d=768, 12 heads, 4 registers)
    Chosen architecture capacity for Stage-1 SSL; not derived from data but fixed before multi-task alignment.
  • Case-transformer depth (D_case=3)
    Hand-chosen capacity for inter-slide aggregation; ablation shows it helps but the exact depth is free.
  • Stage-1/Stage-2 learning rates, EMA schedule, mask-ratio range, crop sizes, label-smoothing ε=0.03, survival bin bounds
    Standard optimization and loss hyperparameters that control the final embeddings; reported but not uniquely determined by theory.
  • Token cap K_max and stratified sampling rule in Stage 2
    Hardware-driven approximation that can alter which tissue regions enter the case embedding.
axioms (4)
  • domain assumption Frozen public patch features (ViT-S DINOv2, 21.67M) already capture sufficient local morphology for slide- and case-level learning.
    Stage 1 never updates the patch encoder; all later gains are attributed to slide/case aggregation on top of this fixed front-end (Sec. 4).
  • domain assumption Multi-task average loss over sparse active labels yields clinically meaningful case embeddings rather than task-specific memorization.
    Stage-2 objective (Eq. 9) treats every labeled task equally; transfer is measured only after discarding task heads.
  • domain assumption Mean-pooling of independent slide embeddings is a fair baseline for multi-slide fusion.
    Used for all non-MOOZY encoders on case-level tasks (Sec. 5); if stronger fusion baselines exist, the reported margin shrinks.
  • standard math Five-fold patient-grouped frozen MLP probes estimate true transferability of the foundation embeddings.
    Standard evaluation protocol in the field; assumed to rank models correctly for the central claim.
invented entities (1)
  • Case transformer / patient-case embedding unit no independent evidence
    purpose: Replace early/late multi-slide fusion with an explicit learnable aggregator over all slides of one patient, producing a single case embedding used for all downstream probes.
    The architectural novelty of the paper; independent evidence is the ablation gain of the aggregator versus mean pooling on case-level held-out tasks, not an external physical measurement.

pith-pipeline@v1.1.0-grok45 · 53354 in / 3102 out tokens · 42479 ms · 2026-07-13T17:14:48.134248+00:00 · methodology

0 comments
read the original abstract

Computational pathology needs whole-slide image (WSI) foundation models that transfer across diverse clinical tasks, yet current approaches remain largely slide-centric, often depend on private data and expensive paired-report supervision, and do not explicitly model relationships among multiple slides from the same patient. We present MOOZY, a patient-first pathology foundation model in which the patient case, not the individual slide, is the core unit of representation. MOOZY explicitly models dependencies across all slides from the same patient via a case transformer during pretraining, combining multi-stage self-supervision with scaled low-cost task supervision. In Stage 1, we pretrain a vision-only slide encoder on 77,134 public slide feature grids using masked self-distillation. In Stage 2, we align these representations with clinical semantics using a case transformer and multi-task supervision over 333 tasks from 56 public datasets, including 205 classification and 128 survival tasks across four endpoints. Across sixteen held-out tasks, MOOZY improves macro weighted F1, balanced accuracy, and macro weighted ROC-AUC relative to PRISM by +4.19\%, +7.93\%, and +6.95\%, respectively. MOOZY is also parameter efficient with 85.77M parameters, 14$\times$ smaller than GigaPath. These results suggest that patient-level pretraining yields transferable embeddings, providing a path toward scalable patient-first histopathology foundation models.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. CRISP -- Clustering-Based Redundancy-Reduced Instance Sampling for Pathology Case Representation and Retrieval

    cs.CV 2026-05 unverdicted novelty 6.0

    CRISP is a clustering-based sampling framework that builds case-level representations from multiple whole-slide images for improved pathology retrieval, matching or exceeding single-slide selection on two breast cance...

Reference graph

Works this paper leans on

105 extracted references · 13 canonical work pages · cited by 1 Pith paper

  1. [1]

    arXiv preprint arXiv:2602.03998 (2026)

    Alagha, A., Leclerc, C., Kotp, Y., Metwally, O., Moras, C., Rentopoulos, P., Rostami, G., Nguyen, B.N., Baig, J., Khellaf, A., Trinh, V.Q.H., Mizouni, R., Otrok, H., Bentahar, J., Hosseini, M.S.: Atlaspatch: An efficient and scalable tool for whole slide image preprocessing in computational pathology. arXiv preprint arXiv:2602.03998 (2026)

    arXiv 2026

  2. [2]

    IEEE Transactions on Medical Imaging38(2), 550–560 (2019).https://doi.org/10.1109/TMI.2018.2867350

    Bandi, P., Geessink, O., Manson, Q., Van Dijk, M., Balkenhol, M., Hermsen, M., Bejnordi, B.E., Lee, B., Paeng, K., Zhong, A., et al.: From detection of indi- vidual metastases to classification of lymph node status at the patient level: the CAMELYON17 challenge. IEEE Transactions on Medical Imaging38(2), 550–560 (2019).https://doi.org/10.1109/TMI.2018.2867350

    doi:10.1109/tmi.2018.2867350 2019

  3. [3]

    Jama318(22), 2199–2210 (2017)

    Bejnordi, B.E., Veta, M., Van Diest, P.J., Van Ginneken, B., Karssemeijer, N., Litjens, G., Van Der Laak, J.A., Hermsen, M., Manson, Q.F., Balkenhol, M., et al.: Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. Jama318(22), 2199–2210 (2017)

    2017

  4. [4]

    arXiv preprint arXiv:2512.21331 (2025)

    Belagali, V., Kapse, S., Marza, P., Das, S., Li, Z., Boutaj, S., Pati, P., Yellapra- gada, S., Nandi, T.N., Madduri, R.K., Saltz, J., Prasanna, P., Christodoulidis, S., Vakalopoulou, M., Samaras, D.: Ticon: A slide-level tile contextualizer for histopathology representation learning. arXiv preprint arXiv:2512.21331 (2025)

    arXiv 2025

  5. [5]

    Journal of Clinical Oncology42(30), 3550–3560 (oct 2024).https://doi.org/10.1200/ JCO.23.02641,https://doi.org/10.1200/JCO.23.02641

    Bergstrom, E.N., Abbasi, A., Díaz-Gay, M., Galland, L., Ladoire, S., Lippman, S.M., Alexandrov, L.B.: Deep learning artificial intelligence predicts homologous recombination deficiency and platinum response from histologic slides. Journal of Clinical Oncology42(30), 3550–3560 (oct 2024).https://doi.org/10.1200/ JCO.23.02641,https://doi.org/10.1200/JCO.23.02641

    work page doi:10.1200/jco.23.02641 2024

  6. [6]

    co / bioptimus / H - optimus-1

    Bioptimus: H-optimus-1 (2025),https : / / huggingface . co / bioptimus / H - optimus-1

    2025

  7. [7]

    Database2022(jan 2022).https://doi.org/10.1093/database/baac093, https://doi.org/10.1093/database/baac093

    Brancati, N., Anniciello, A.M., Pati, P., Riccio, D., Scognamiglio, G., Jaume, G., De Pietro, G., Di Bonito, M., Foncubierta, A., Botti, G., Gabrani, M., Feroce, F., Frucci, M.: Bracs: A dataset for breast carcinoma subtyping in h&e histology im- ages. Database2022(jan 2022).https://doi.org/10.1093/database/baac093, https://doi.org/10.1093/database/baac093

    work page doi:10.1093/database/baac093 2022

  8. [8]

    Advances in neural information processing systems33, 1877–1901 (2020)

    Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Nee- lakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few- shot learners. Advances in neural information processing systems33, 1877–1901 (2020)

    1901

  9. [9]

    Nature medicine28(1), 154–163 (2022).https://doi.org/10.1038/s41591-021-01620- 2

    Bulten, W., Kartasalo, K., Chen, P.H.C., Ström, P., Pinckaers, H., Nagpal, K., Cai, Y., Steiner, D.F., Van Boven, H., Vink, R., et al.: Artificial intelligence for diagnosis and gleason grading of prostate cancer: the panda challenge. Nature medicine28(1), 154–163 (2022).https://doi.org/10.1038/s41591-021-01620- 2

    work page doi:10.1038/s41591-021-01620- 2022

  10. [10]

    Nature medicine25(8), 1301–1309 (2019)

    Campanella, G., Hanna, M.G., Geneslaw, L., Miraflor, A., Werneck Krauss Silva, V., Busam, K.J., Brogi, E., Reuter, V.E., Klimstra, D.S., Fuchs, T.J.: Clinical- grade computational pathology using weakly supervised deep learning on whole slide images. Nature medicine25(8), 1301–1309 (2019)

    2019

  11. [11]

    Advances in neural information processing systems33, 9912–9924 (2020)

    Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., Joulin, A.: Unsuper- vised learning of visual features by contrasting cluster assignments. Advances in neural information processing systems33, 9912–9924 (2020)

    2020

  12. [12]

    In: Proceedings MOOZY: A Patient-First Foundation Model for Computational Pathology 17 of the IEEE/CVF international conference on computer vision

    Caron, M., Touvron, H., Misra, I., Jégou, H., Mairal, J., Bojanowski, P., Joulin, A.: Emerging properties in self-supervised vision transformers. In: Proceedings MOOZY: A Patient-First Foundation Model for Computational Pathology 17 of the IEEE/CVF international conference on computer vision. pp. 9650–9660 (2021)

    2021

  13. [13]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    Chen, R.J., Chen, C., Li, Y., Chen, T.Y., Trister, A.D., Krishnan, R.G., Mah- mood, F.: Scaling vision transformers to gigapixel images via hierarchical self- supervised learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 16144–16155 (2022)

    2022

  14. [14]

    Nature medicine30(3), 850–862 (2024)

    Chen, R.J., Ding, T., Lu, M.Y., Williamson, D.F., Jaume, G., Song, A.H., Chen, B., Zhang, A., Shao, D., Shaban, M., et al.: Towards a general-purpose foundation model for computational pathology. Nature medicine30(3), 850–862 (2024)

    2024

  15. [15]

    In: International conference on machine learning

    Chen, T., Kornblith, S., Norouzi, M., Hinton, G.: A simple framework for con- trastive learning of visual representations. In: International conference on machine learning. pp. 1597–1607. PmLR (2020)

    2020

  16. [16]

    In: Proceed- ings of the IEEE/CVF conference on computer vision and pattern recognition

    Chen, X., He, K.: Exploring simple siamese representation learning. In: Proceed- ings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 15750–15758 (2021)

    2021

  17. [17]

    Nature medicine25(10), 1519–1525 (2019)

    Courtiol,P.,Maussion,C.,Moarii,M.,Pronier,E.,Pilcer,S.,Sefta,M.,Manceron, P.,Toldo,S.,Zaslavskiy,M.,LeStang,N.,etal.:Deeplearning-basedclassification of mesothelioma improves prediction of patient outcome. Nature medicine25(10), 1519–1525 (2019)

    2019

  18. [18]

    In: The Twelfth International Conference on Learning Representations (2024),https://openreview.net/forum?id=2dnO3LLiJ1

    Darcet, T., Oquab, M., Mairal, J., Bojanowski, P.: Vision transformers need registers. In: The Twelfth International Conference on Learning Representations (2024),https://openreview.net/forum?id=2dnO3LLiJ1

    2024

  19. [19]

    arXiv preprint arXiv:2307.02486 (2023)

    Ding, J., Ma, S., Dong, L., Zhang, X., Huang, S., Wang, W., Zheng, N., Wei, F.: Longnet: Scaling transformers to 1,000,000,000 tokens. arXiv preprint arXiv:2307.02486 (2023)

    Pith/arXiv arXiv 2023

  20. [20]

    arXiv preprint arXiv:2411.19666 (2024)

    Ding, T., Wagner, S.J., Song, A.H., Chen, R.J., Lu, M.Y., Zhang, A., Vaidya, A.J., Jaume, G., Shaban, M., Kim, A., et al.: Multimodal whole slide foundation model for pathology. arXiv preprint arXiv:2411.19666 (2024)

    Pith/arXiv arXiv 2024

  21. [21]

    Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., Houlsby, N.: Animageisworth16x16words:Transformersforimagerecognitionatscale.arXiv preprint arXiv:2010.11929 (2020)

    Pith/arXiv arXiv 2010

  22. [22]

    Journal of Proteome Research14(6), 2707–2713 (2015)

    Edwards, N.J., Oberti, M., Thangudu, R.R., Cai, S., McGarvey, P.B., Jacob, S., Madhavan, S., Ketchum, K.A.: The CPTAC data portal: a resource for cancer proteomics research. Journal of Proteome Research14(6), 2707–2713 (2015)

    2015

  23. [23]

    arXiv preprint arXiv:2501.16239 (2025)

    Filiot, A., Dop, N., Tchita, O., Riou, A., Dubois, R., Peeters, T., Valter, D., Scalbert, M., Saillard, C., Robin, G., Olivier, A.: Distilling foundation models for robust and efficient models in digital pathology. arXiv preprint arXiv:2501.16239 (2025)

    Pith/arXiv arXiv 2025

  24. [24]

    medRxiv (2023)

    Filiot, A., Ghermi, R., Olivier, A., Jacob, P., Fidon, L., Camara, A., Mac Kain, A., Saillard, C., Schiratti, J.B.: Scaling self-supervised learning for histopathology with masked image modeling. medRxiv (2023)

    2023

  25. [25]

    arXiv preprint arXiv:2409.09173 (2024)

    Filiot, A., Jacob, P., Mac Kain, A., Saillard, C.: Phikon-v2, a large and pub- lic feature extractor for biomarker prediction. arXiv preprint arXiv:2409.09173 (2024)

    Pith/arXiv arXiv 2024

  26. [26]

    npj Breast Cancer8(1), 28 (mar 2022).https: 18 Kotp et al

    Galland, L., Ballot, E., Mananet, H., Boidot, R., Lecuelle, J., Albuisson, J., Arnould, L., Desmoulins, I., Mayeur, D., Kaderbhai, C., Ilie, S., Hennequin, A., Bergeron, A., Derangère, V., Ghiringhelli, F., Truntzer, C., Ladoire, S.: Efficacy of platinum-based chemotherapy in metastatic breast cancer and hrd biomark- ers: utility of exome sequencing. npj ...

    work page doi:10.1038/s41523-022-00395-0 2022

  27. [27]

    Advances in neural information processing systems33, 21271–21284 (2020)

    Grill, J.B., Strub, F., Altché, F., Tallec, C., Richemond, P., Buchatskaya, E., Doersch, C., Avila Pires, B., Guo, Z., Gheshlaghi Azar, M., et al.: Bootstrap your own latent-a new approach to self-supervised learning. Advances in neural information processing systems33, 21271–21284 (2020)

    2020

  28. [28]

    Nature Genetics45(6), 580–585 (2013)

    GTEx Consortium: The Genotype-Tissue Expression (GTEx) project. Nature Genetics45(6), 580–585 (2013)

    2013

  29. [29]

    arXiv preprint arXiv:2312.00752 (2023)

    Gu, A., Dao, T.: Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.00752 (2023)

    Pith/arXiv arXiv 2023

  30. [30]

    He, K., Chen, X., Xie, S., Li, Y., Dollár, P., Girshick, R.: Masked autoencoders are scalablevisionlearners.In:ProceedingsoftheIEEE/CVFconferenceoncomputer vision and pattern recognition. pp. 16000–16009 (2022)

    2022

  31. [31]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.: Momentum contrast for unsuper- vised visual representation learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 9729–9738 (2020)

    2020

  32. [32]

    arXiv preprint arXiv:1606.08415 (2016)

    Hendrycks, D., Gimpel, K.: Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 (2016)

    Pith/arXiv arXiv 2016

  33. [33]

    arXiv preprint arXiv:2203.15556 (2022)

    Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D.d.L., Hendricks, L.A., Welbl, J., Clark, A., et al.: Training compute- optimal large language models. arXiv preprint arXiv:2203.15556 (2022)

    Pith/arXiv arXiv 2022

  34. [34]

    Journal of Pathology Informatics15, 100357 (2024)

    Hosseini, M.S., Bejnordi, B.E., Trinh, V.Q.H., Chan, L., Hasan, D., Li, X., Yang, S., Kim, T., Zhang, H., Wu, T., et al.: Computational pathology: a survey review and the way forward. Journal of Pathology Informatics15, 100357 (2024)

    2024

  35. [35]

    arXiv preprint arXiv:2402.06188 (2024)

    Hou, X., Jiang, C., Kondepudi, A., Lyu, Y., Chowdury, A., Lee, H., Hollon, T.C.: A self-supervised framework for learning whole slide representations. arXiv preprint arXiv:2402.06188 (2024)

    Pith/arXiv arXiv 2024

  36. [36]

    Medical Image Analysis97, 103289 (2024)

    Hua, S., Yan, F., Shen, T., Ma, L., Zhang, X.: Pathoduet: Foundation models for pathological slide analysis of h&e and ihc stains. Medical Image Analysis97, 103289 (2024)

    2024

  37. [37]

    Huang, G., Sun, Y., Liu, Z., Sedra, D., Weinberger, K.Q.: Deep Networks with Stochastic Depth, pp. 646–661. Springer International Publishing (2016).https: //doi.org/10.1007/978- 3- 319- 46493- 0_39,http://dx.doi.org/10.1007/ 978-3-319-46493-0_39

    doi:10.1007/978- 2016

  38. [38]

    In: International conference on machine learning

    Ilse, M., Tomczak, J., Welling, M.: Attention-based deep multiple instance learn- ing. In: International conference on machine learning. pp. 2127–2136. PMLR (2018)

    2018

  39. [39]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2024)

    Jaume, G., Oldenburg, L., Vaidya, A., Chen, R.J., Williamson, D.F., Peeters, T., Song, A.H., Mahmood, F.: Transcriptomics-guided slide representation learning in computational pathology. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2024)

    2024

  40. [40]

    Song, A., J

    Jaume, G., Vaidya, A., Zhang, A., H. Song, A., J. Chen, R., Sahai, S., Mo, D., Madrigal, E., Phi Le, L., Mahmood, F.: Multistain pretraining for slide represen- tation learning in pathology. In: European Conference on Computer Vision. pp. 19–37. Springer (2024)

    2024

  41. [41]

    In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition

    Kang, M., Song, H., Park, S., Yoo, D., Pereira, S.: Benchmarking self-supervised learning on diverse pathology datasets. In: Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition. pp. 3344–3354 (2023)

    2023

  42. [42]

    arXiv preprint arXiv:2001.08361 (2020) MOOZY: A Patient-First Foundation Model for Computational Pathology 19

    Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., Amodei, D.: Scaling laws for neural language mod- els. arXiv preprint arXiv:2001.08361 (2020) MOOZY: A Patient-First Foundation Model for Computational Pathology 19

    Pith/arXiv arXiv 2001

  43. [43]

    Karasikov, M., van Doorn, J., Känzig, N., Cesur, M.E., Horlings, H.M., Berke, R., Tang, F., Otálora, S.: Training state-of-the-art pathology foundation models with orders of magnitude less data (2025),https://arxiv.org/abs/2504.05186

    Pith/arXiv arXiv 2025

  44. [44]

    Nature cancer1(8), 789–799 (2020)

    Kather, J.N., Heij, L.R., Grabsch, H.I., Loeffler, C., Echle, A., Muti, H.S., Krause, J., Niehues, J.M., Sommer, K.A., Bankhead, P., et al.: Pan-cancer image-based detection of clinically actionable genetic alterations. Nature cancer1(8), 789–799 (2020)

    2020

  45. [45]

    In: Proceedings of the IEEE/CVF international conference on computer vision

    Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., Lo, W.Y., et al.: Segment anything. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 4015–4026 (2023)

    2023

  46. [46]

    Problemy Peredachi Informatsii23(2), 9–16 (1987)

    Kozachenko, L.F., Leonenko, N.N.: Sample estimate of the entropy of a random vector. Problemy Peredachi Informatsii23(2), 9–16 (1987)

    1987

  47. [47]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops

    Lazard, T., Lerousseau, M., Decencière, E., Walter, T.: Giga-ssl: Self-supervised learning for gigapixel images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. pp. 4812–4822 (2023)

    2023

  48. [48]

    5281/zenodo.15081614

    Lee, Y., Oh, H.R., Bychlov, A., Fukuoka, J., Kaushal, R.K., Sahay, A., Yadav, R., Sarioglu, S., Balci, S., Türkmen, İ., Tolkach, Y., Harder, C., Choi, J.H., Ahn, S.: Report generation of pathology using pan-asia giga-pixel wsis (2025) (2025).https://doi.org/10.5281/zenodo.15081614,https://doi.org/10. 5281/zenodo.15081614

    work page doi:10.5281/zenodo.15081614 2025

  49. [49]

    In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2025)

    Lenz, T., Neidlinger, P., Ligero, M., Wölflein, G., van Treeck, M., Kather, J.N.: Unsupervised foundation model-agnostic slide-level representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2025)

    2025

  50. [50]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recog- nition

    Li, B., Li, Y., Eliceiri, K.W.: Dual-stream multiple instance learning network for whole slide image classification with self-supervised contrastive learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recog- nition. pp. 14318–14328 (2021)

    2021

  51. [51]

    In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

    Li, J., Chen, Y., Chu, H., Sun, Q., Guan, T., Han, A., He, Y.: Dynamic graph representation with knowledge-aware attention for histopathology whole slide im- age analysis. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 11323–11332 (2024)

    2024

  52. [52]

    Loshchilov,I.,Hutter,F.:Decoupledweightdecayregularization.In:International Conference on Learning Representations (2019)

    2019

  53. [53]

    arXiv preprint arXiv:2312.07814 (2023)

    Lu, M.Y., Chen, B., Williamson, D.F., Chen, R.J., Ikamura, K., Gerber, G., Liang, I., Le, L.P., Ding, T., Parwani, A.V., et al.: A foundational multimodal vision language ai assistant for human pathology. arXiv preprint arXiv:2312.07814 (2023)

    Pith/arXiv arXiv 2023

  54. [54]

    Nature medicine30(3), 863–874 (2024)

    Lu, M.Y., Chen, B., Williamson, D.F., Chen, R.J., Liang, I., Ding, T., Jaume, G., Odintsov, I., Le, L.P., Gerber, G., et al.: A visual-language foundation model for computational pathology. Nature medicine30(3), 863–874 (2024)

    2024

  55. [55]

    Nature biomedical engineering5(6), 555–570 (2021)

    Lu, M.Y., Williamson, D.F., Chen, T.Y., Chen, R.J., Barbieri, M., Mahmood, F.: Data-efficient and weakly supervised computational pathology on whole-slide images. Nature biomedical engineering5(6), 555–570 (2021)

    2021

  56. [56]

    Journal of Machine Learning Research9(86), 2579–2605 (2008)

    van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. Journal of Machine Learning Research9(86), 2579–2605 (2008)

    2008

  57. [57]

    arXiv preprint arXiv:1802.03426 (2018)

    McInnes, L., Healy, J., Melville, J.: UMAP: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018). https://doi.org/10.48550/arXiv.1802.03426 20 Kotp et al

    Pith/arXiv arXiv doi:10.48550/arxiv.1802.03426 2018

  58. [58]

    National Cancer Institute: The cancer genome atlas program (tcga).https: / / www . cancer . gov / about - nci / organization / ccg / research / structural - genomics/tcga, accessed: 2025-10-19

    2025

  59. [59]

    arXiv preprint arXiv:2406.05074 (2024)

    Nechaev, D., Pchelnikov, A., Ivanova, E.: Hibou: A family of foundational vision transformers for pathology. arXiv preprint arXiv:2406.05074 (2024)

    Pith/arXiv arXiv 2024

  60. [60]

    npj Precision Oncology8(1), 56 (2024).https://doi.org/10.1038/s41698- 024-00539-4,https://doi.org/10.1038/s41698-024-00539-4

    Neto, P.C., Montezuma, D., Oliveira, S.P., Oliveira, D., Fraga, J., Monteiro, A., Monteiro, J., Ribeiro, L., Gonçalves, S., Reinhard, S., et al.: An interpretable machine learning system for colorectal cancer diagnosis from pathology slides. npj Precision Oncology8(1), 56 (2024).https://doi.org/10.1038/s41698- 024-00539-4,https://doi.org/10.1038/s41698-02...

    work page doi:10.1038/s41698- 2024

  61. [61]

    Cancers14(10), 2489 (2022).https://doi.org/10.3390/cancers14102489,https://doi.org/10

    Neto, P.C., Oliveira, S.P., Montezuma, D., Fraga, J., Monteiro, A., Ribeiro, L., Gonçalves, S., Pinto, I.M., Cardoso, J.S.: imil4path: A semi-supervised in- terpretable approach for colorectal whole-slide images. Cancers14(10), 2489 (2022).https://doi.org/10.3390/cancers14102489,https://doi.org/10. 3390/cancers14102489

    work page doi:10.3390/cancers14102489 2022

  62. [62]

    arXiv preprint arXiv:2507.05742 (2025)

    Nicke, T., Schacherer, D., Schäfer, J.R., Artysh, N., Prasse, A., Homeyer, A., Schenk, A., Höfener, H., Lotz, J.: Tissue concepts v2: A supervised foundation model for whole slide images. arXiv preprint arXiv:2507.05742 (2025)

    arXiv 2025

  63. [63]

    Computers in Biology and Medicine186, 109621 (2025)

    Nicke, T., Schaefer, J.R., Hoefener, H., Feuerhake, F., Merhof, D., Kiessling, F., Lotz, J.: Tissue concepts: Supervised foundation models in computational pathol- ogy. Computers in Biology and Medicine186, 109621 (2025)

    2025

  64. [64]

    Scientific Re- ports13(1), 3970 (mar 2023).https://doi.org/10.1038/s41598-023-30497-z

    Oliveira, S.P., Montezuma, D., Moreira, A., Oliveira, D., Neto, P.C., Monteiro, A., Monteiro, J., Ribeiro, L., Gonçalves, S., Pinto, I.M., Cardoso, J.S.: A cad system for automatic dysplasia grading on h&e cervical whole-slide images. Scientific Re- ports13(1), 3970 (mar 2023).https://doi.org/10.1038/s41598-023-30497-z

    work page doi:10.1038/s41598-023-30497-z 2023

  65. [65]

    Scientific Reports11(1), 1–15 (2021).https://doi.org/10.1038/s41598-021-93746-z,https://doi

    Oliveira, S.P., Neto, P.C., Fraga, J., Montezuma, D., Monteiro, A., Monteiro, J., Ribeiro, L., Gonçalves, S., Pinto, I.M., Cardoso, J.S.: Cad systems for colorectal cancer from wsi are still not ready for clinical acceptance. Scientific Reports11(1), 1–15 (2021).https://doi.org/10.1038/s41598-021-93746-z,https://doi. org/10.1038/s41598-021-93746-z

    work page doi:10.1038/s41598-021-93746-z 2021

  66. [66]

    arXiv preprint arXiv:2304.07193 (2023)

    Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez,P.,Haziza,D.,Massa,F.,El-Nouby,A.,etal.:Dinov2:Learningrobust visual features without supervision. arXiv preprint arXiv:2304.07193 (2023)

    Pith/arXiv arXiv 2023

  67. [67]

    Cytometry Part A91(11), 1078–1087 (oct 2017).https://doi.org/10.1002/cyto.a.23244, https://doi.org/10.1002/cyto.a.23244

    Peikari, M., Salama, S., Nofech-Mozes, S., Martel, A.L.: Automatic cellular- ity assessment from post-treated breast surgical specimens. Cytometry Part A91(11), 1078–1087 (oct 2017).https://doi.org/10.1002/cyto.a.23244, https://doi.org/10.1002/cyto.a.23244

    work page doi:10.1002/cyto.a.23244 2017

  68. [68]

    In: International Conference on Learning Representations (2022)

    Press, O., Smith, N.A., Lewis, M.: Train short, test long: Attention with linear bi- ases enables input length extrapolation. In: International Conference on Learning Representations (2022)

    2022

  69. [69]

    plus.c.5983795.v1,https://doi.org/10.25452/figshare.plus.c.5983795

    Rajaram, S., Acosta, P., Panwar, V., Jarmale, V., Christie, A., Jasti, J., Margulis, V., Rakheja, D., Cheville, J., Leibovich, B.C., Parker, A., Brugarolas, J., Kapur, P.: Prediction of driver mutation heterogeneity in renal cancer from histopathol- ogy slides using deep learning (2022).https://doi.org/10.25452/figshare. plus.c.5983795.v1,https://doi.org/...

    doi:10.25452/figshare 2022

  70. [70]

    arXiv preprint arXiv:2408.00714 (2024) MOOZY: A Patient-First Foundation Model for Computational Pathology 21

    Ravi, N., Gabeur, V., Hu, Y.T., Hu, R., Ryali, C., Ma, T., Khedr, H., Rädle, R., Rolland, C., Gustafson, L., et al.: Sam 2: Segment anything in images and videos. arXiv preprint arXiv:2408.00714 (2024) MOOZY: A Patient-First Foundation Model for Computational Pathology 21

    Pith/arXiv arXiv 2024

  71. [71]

    Scientific Data9(1), 55 (2022).https://doi.org/10.1038/s41597- 022-01157-0,https://doi.org/10.1038/s41597-022-01157-0

    Roetzer-Pejrimovsky, T., Moser, A.C., Atli, B., Vogel, C.C., Mercea, P.A., Pri- hoda, R., Gelpi, E., Haberler, C., Höftberger, R., Hainfellner, J.A., Baumann, B., Langs, G., Woehrer, A.: The digital brain tumour atlas, an open histopathology resource. Scientific Data9(1), 55 (2022).https://doi.org/10.1038/s41597- 022-01157-0,https://doi.org/10.1038/s41597...

    doi:10.1038/s41597- 2022

  72. [72]

    Roetzer-Pejrimovsky, T., Moser, A.C., Atli, B., Vogel, C.C., Mercea, P.A., Pri- hoda, R., Gelpi, E., Haberler, C., Höftberger, R., Hainfellner, J.A., Baumann, B., Langs, G., Woehrer, A.: The digital brain tumour atlas, an open histopathol- ogy resource [data set] (2022).https://doi.org/10.25493/WQ48-ZGX,https: //doi.org/10.25493/WQ48-ZGX

    work page doi:10.25493/wq48-zgx 2022

  73. [73]

    In: International Conference on Learning Representations (2019)

    Sablayrolles, A., Douze, M., Schmid, C., Jégou, H.: Spreading vectors for similar- ity search. In: International Conference on Learning Representations (2019)

    2019

  74. [74]

    Saillard, C., Jenatton, R., Llinares-López, F., Mariet, Z., Cahané, D., Durand, E., Vert, J.P.: H-optimus-0 (2024),https://github.com/bioptimus/releases/ tree/main/models/h-optimus/v0

    2024

  75. [75]

    Sammut, S.J.: Multi-omic machine learning predictor of breast cancer therapy re- sponse (2022).https://doi.org/10.5281/zenodo.6337925,https://doi.org/ 10.5281/zenodo.6337925

    work page doi:10.5281/zenodo.6337925 2022

  76. [76]

    arXiv preprint arXiv:2405.10254 (2024)

    Shaikovski, G., Casson, A., Severson, K., Zimmermann, E., Wang, Y.K., Kunz, J.D., Retamero, J.A., Oakley, G., Klimstra, D., Kanan, C., et al.: Prism: A multi- modal generative foundation model for slide-level histopathology. arXiv preprint arXiv:2405.10254 (2024)

    Pith/arXiv arXiv 2024

  77. [77]

    Proceedings of Machine Learning Research, vol

    Shao, D., Chen, R.J., Song, A.H., Runevic, J., Lu, M.Y., Ding, T., Mahmood, F.: Do multiple instance learning models transfer? In: Proceedings of the 42nd International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 267, pp. 54219–54238. PMLR (2025),https://proceedings.mlr. press/v267/shao25a.html

    2025

  78. [78]

    Advances in neural information processing systems34, 2136–2147 (2021)

    Shao, Z., Bian, H., Chen, Y., Wang, Y., Zhang, J., Ji, X., et al.: Transmil: Trans- former based correlated multiple instance learning for whole slide image classifi- cation. Advances in neural information processing systems34, 2136–2147 (2021)

    2021

  79. [79]

    arXiv preprint arXiv:2508.10104 (2025)

    Siméoni, O., Vo, H.V., Seitzer, M., Baldassarre, F., Oquab, M., Jose, C., Khali- dov, V., Szafraniec, M., Yi, S., Ramamonjisoa, M., et al.: Dinov3. arXiv preprint arXiv:2508.10104 (2025)

    Pith/arXiv arXiv 2025

  80. [80]

    The Lancet395(10221), 350–360 (2020)

    Skrede, O.J., De Raedt, S., Kleppe, A., Hveem, T.S., Liestøl, K., Maddison, J., Askautrud, H.A., Pradhan, M., Nesheim, J.A., Albregtsen, F., et al.: Deep learn- ing for prediction of colorectal cancer outcome: a discovery and validation study. The Lancet395(10221), 350–360 (2020)

    2020

Showing first 80 references.