A Foundation Model for Spatial Proteomics
read the original abstract
Foundation models have begun to transform image analysis by acting as pretrained generalist backbones that can be adapted to many tasks even when post-training data are limited, yet their impact on spatial proteomics, imaging that maps proteins at single-cell resolution, remains limited. Here, we introduce KRONOS, a foundation model built for spatial proteomics. KRONOS was trained in a self-supervised manner on over 47 million image patches covering 175 protein markers, 16 tissue types, and 8 fluorescence-based imaging platforms. We introduce key architectural adaptations to address the high-dimensional, multi-channel, and heterogeneous nature of multiplex imaging. We demonstrate that KRONOS learns biologically meaningful representations across multiple scales, ranging from cellular and microenvironment to tissue levels, enabling it to address diverse downstream tasks, including cell phenotyping, region classification, and patient stratification. Evaluated across 11 independent cohorts, KRONOS achieves state-of-the-art performance across cell phenotyping, treatment response prediction, and retrieval tasks, and is highly data-efficient. KRONOS also introduces the paradigm of segmentation-free patch-level processing for efficient and scalable spatial proteomics analysis, allowing cross-institutional comparisons, and as an image reverse search engine for spatial patterns. Together, these results position KRONOS as a flexible and scalable tool for spatial proteomics. The model is publicly accessible at https://github.com/mahmoodlab/KRONOS.
This paper has not been read by Pith yet.
Forward citations
Cited by 4 Pith papers
-
SVC-Probe: A Framework for Evaluating Perturbation Generalization in Spatial Foundation-Model Embeddings
SVC-Probe shows that 98.6% accuracy distinguishing drug conditions in embeddings does not imply reliable cross-drug perturbation prediction, dropping to 0.30 cosine similarity in leave-one-drug-out tests.
-
Linking spatial biology and clinical histology via Haiku
Haiku aligns mIF spatial proteomics, H&E histology, and clinical metadata via contrastive learning to enable retrieval, improved survival prediction, zero-shot biomarker inference, and counterfactual exploration in cancer.
-
Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation
GLMP generates robust pathology embeddings by routing histology images through an intermediate textual representation produced by general-purpose MLLMs to mitigate batch effects.
-
Building artificial intelligence virtual tissue (AIVT) for tissue state representation, feature prediction, and dynamic simulation
Proposes the AIVT conceptual framework for unified AI-driven tissue state representation, molecular/morphological prediction, and spatiotemporal simulation from spatial multimodal data.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.