REVIEW 3 major objections 5 minor 33 references
HyperPath: Knowledge-Guided Hyperbolic Semantic Hierarchy Modeling for WSI Analysis
T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read HyperPath models whole-slide images as patch-region-slide hierarchies in hyperbolic space, guided by textual class knowledge, to improve cancer classification.
desk verdict Useful engineering adaptation of hyperbolic embeddings to WSI classification, but the headline claim that hyperbolic geometry drives the gains is undercut by a missing Euclidean control. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the Lorentz model of hyperbolic space $H^k_\rho$, a manifold whose exponential volume growth gives hierarchy an intrinsic notion of distance. Visual and textual features from CONCH are mapped into this space; an attention aggregator builds region and slide features from patches; the Angular Modality Alignment Loss $\mathcal{L}_{\mathrm{AMA}}$ measures similarity through exterior angles $\theta(u,v)$ and angular distance $\varphi(u,v)$; the Semantic Hierarchy Consistency Loss $\mathcal{L}_{\mathrm{SHC}}$ uses hyperbolic entailment cones, cones of points that a concept semantically entails, with half-aperture $\phi(u)=\sin^{-1}(2\alpha/(\sqrt{\rho}\|u_s\|_E))$, to enforce entailment and contradiction structure; and slide classification uses geodesic distance $d_G(u,v)=\sqrt{1/\rho}\,\cosh^{-1}(-\rho\langle u,v\rangle_H)$ between slide and class embeddings, replacing the linear classifier.
What would settle it
Run HyperPath on the four TCGA tasks with the Angular Modality Alignment Loss replaced by an equivalent Euclidean cosine alignment loss, keeping the same hierarchical aggregation, text guidance, and entailment loss; if the Euclidean variant matches or exceeds HyperPath's AUC and F1, hyperbolic geometry per se is not what causes the gains. Alternatively, compare the CONCH cosine-similarity pseudo-labels with pathologist- or supervised-model-derived patch and region labels; low agreement would make the alignment signal suspect.
Extended reading notes
Core claim
The central discovery claimed is that the natural patch-region-slide organization of a whole slide image is better represented as a hyperbolic semantic hierarchy than as a Euclidean bag of patches. In the Lorentz model, broad class concepts sit near the origin with wide entailment cones, while slide, region, and patch features radiate outward at increasing specificity; HyperPath argues this geometry is the right inductive bias for tissue structure. To make it work, the paper contributes an Angular Modality Alignment Loss based on exterior angles, which avoids the scale mismatch between general textual embeddings and specific visual embeddings, and a Semantic Hierarchy Consistency Loss that pushes entailed features inside cones and contradictory features outside. Classification then reduces to comparing the slide embedding with each class embedding by geodesic distance. The paper supports the claim with experiments on four TCGA tasks and ablations showing that both losses are needed together.
Load-bearing premise
The load-bearing premise is that the top-$K$ patch and region pseudo-labels chosen by cosine similarity between raw CONCH visual features and class text features are accurate enough to train the cross-modal alignment loss; if those pseudo-labels are noisy, the misalignment propagates into the slide representation used for classification.
Editorial extensions
If this is right
- The standard MIL pipeline can drop the learned linear classification head: prediction becomes a nearest-class lookup by geodesic distance in hyperbolic space.
- Patch, region, and slide features become semantically layered by specificity, so the model offers an interpretable account of which tissue scale supports a slide-level diagnosis.
- Because angular alignment does not depend on matching geodesic scales, the approach should transfer to other gigapixel or hierarchical biomedical images where class concepts can be written as text prompts.
- Text-guided hyperbolic embeddings could improve out-of-domain robustness in computational pathology, since the reported out-of-domain gains exceed the in-domain gains on most tasks.
- The two losses are complementary rather than individually sufficient: ablation results show alignment alone helps, hierarchy consistency alone hurts, and the combination gives the best result.
Reading between the lines
- The top-$K$ pseudo-label selection by raw CONCH cosine similarity is the fragile point; an obvious untested extension is iterative self-training with uncertainty-aware pseudo-labels, which could reduce propagated misalignment.
- The large F1 improvements on HER2 and EGFR tasks relative to AUC suggest the geometry mainly counters majority-class bias; a per-class calibration and confusion-matrix analysis would test that directly.
- The same hyperbolic hierarchy machinery could be applied to survival prediction or tumor microenvironment characterization, where scale and tissue organization also matter, but the paper does not evaluate those tasks.
- Since hierarchy consistency alone degrades performance, one testable hypothesis is that angular alignment normalizes feature distributions before entailment constraints become useful; scheduling the two losses in sequence may be simpler and stronger than weighting them jointly.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes HyperPath, a method for whole-slide image classification that maps CONCH visual and textual features into a Lorentz hyperbolic space, hierarchically aggregates patch and region features, aligns modalities with an angular modality alignment loss (LAMA) and a semantic hierarchy consistency loss (LSHC), and classifies via geodesic distance to class prototypes. Experiments on four TCGA tasks compare HyperPath against Euclidean MIL baselines and report AUC and F1 scores; an ablation isolates the effects of LAMA and LSHC, and the source code is made available.
Significance. If the central claim were established, HyperPath would be a useful contribution: it is among the few hyperbolic approaches to WSI analysis, it builds on standard pathology foundation-model features, it evaluates on four clinically relevant TCGA tasks, and it releases code. The ablation and the hyperbolic-embedding visualization are informative. However, the experiments do not yet separate the benefit of hyperbolic geometry from the benefit of text-guided alignment, and the statement of "significant gains across all tasks" is contradicted by several cells in Table 1. The core geometric claim therefore needs additional evidence before the paper can be accepted.
major comments (3)
- [§3.2, Table 1] The claim that HyperPath "achieves significant gains in both AUC and F1 Score across all tasks" is not supported by the reported numbers. On LUAD EGFR, HyperPath's OOD AUC is 0.637±0.044, slightly below HIT's 0.638±0.037, and on BRCA HER2 IND, HyperPath's AUC is 0.732±0.157 versus HIT's 0.740±0.144. The text should either restrict the claim to the settings where it holds or report paired statistical tests (e.g., bootstrap or DeLong) that justify the word "significant."
- [§3.2, Table 2] The ablation does not isolate the geometric benefit. The no-loss version of HyperPath underperforms ABMIL on BRCA OOD AUC (0.864 versus 0.898), while adding LAMA alone recovers most of the gain (0.925, and 0.933 with the full loss). LSHC alone collapses performance to 0.539 on the same metric. Because LAMA is a cross-modal angular alignment loss that could be implemented with Euclidean cosine similarity, and all baselines are Euclidean methods without textual alignment, the current experiments do not establish that hyperbolic geometry is the source of the improvement. Please add an Euclidean counterpart trained with the same adapters, prompts, and alignment losses.
- [§2.3] The alignment loss LAMA is applied to patch- and region-level pseudo-labels selected by cosine similarity between raw CONCH visual features and class semantic features. The paper does not report the value of the top-K threshold, the accuracy of these pseudo-labels, or a sensitivity analysis. If the pseudo-labels are noisy, misalignment is propagated into the region and slide representations used for geodesic classification, so the validity of this selection step is load-bearing for the method's performance.
minor comments (5)
- [§3.2] The sentence reporting improvement ranges "1.9%–9.2%" and "2.6%–8.8%" excludes HIT as an "outlier," but HIT is a competitive baseline on BRCA HER2 and LUAD EGFR. Please justify this exclusion and reconcile the ranges with the actual table entries.
- [§2.3, Eq. (3)] The negative sampling strategy is not specified. Please state how the negative hyperbolic embeddings v^- are selected (other classes, other hierarchical levels, or batch negatives) and whether the sum in the denominator includes one or many negatives.
- [§2.4, Eq. (4)] The half-aperture constant alpha and the margin beta are set to 0.1 and 0.8 without sensitivity analysis; please add a short ablation or a reference justifying these choices.
- [§2.2, Eq. (1)] The shapes in the aggregation equation are not fully defined: the superscript T on f^I_{h',m} and the orientation of the resulting vector are unclear. Please clarify the dimensions so that the formula can be checked.
- [Fig. 3] The caption does not explain the color scheme or markers, and in grayscale the distinct categories are difficult to separate. Please add a legend and describe the axes.
Circularity Check
No significant circularity: the slide-level classification and the auxiliary alignment/hierarchy losses are trained from slide labels or frozen CONCH pseudo-labels, so the central claim does not reduce to its inputs.
full rationale
The derivation chain is supervised rather than self-referential. CONCH provides frozen visual and textual features; trainable adapters map them to the Lorentz model; a hierarchical attention aggregator produces region and slide embeddings; LAMA aligns adapted visual features to class-semantic features using top-K patch/region pseudo-labels selected by cosine similarity in the raw CONCH space; LSHC enforces entailment/contradiction margins; and LCLS trains class-specific geodesic prototypes with the true slide labels. None of these equations defines an output in terms of the claimed prediction: the pseudo-labels are computed from the fixed CONCH features before adaptation, and the geodesic softmax is a standard supervised prototype classifier whose class centers are trained with the same labels. The self-citations in the paper ([8], [9], [10]) are contextual references for hierarchical methods and foundation-model success, not load-bearing derivations, and no uniqueness theorem or ansatz is imported from the authors' own prior work to force a choice. The ablation table shows that most of the gain comes from LAMA rather than from hyperbolic geometry, which is a legitimate attribution/control concern about what causes the improvement, but it is not circularity: the reported prediction is not a fitted input renamed as a result. The method is benchmarked against external baselines on four TCGA tasks, so the central empirical claim has independent content.
Assumptions & free parameters
free parameters (5)
- Temperature tau =
0.05
- Entailment cone aperture constant alpha =
0.1
- Margin beta =
0.8
- Loss weights lambda_a and lambda_s =
lambda_a=1, lambda_s=10
- Top-K pseudo-label selection threshold =
unspecified
assumptions (4)
- standard math The Lorentz model inner product and tangent space mapping provide valid tools for hyperbolic geometry.
- domain assumption Entailment cones from Ganea et al. can model the partial-order semantic hierarchy of pathology concepts.
- domain assumption CONCH features encode sufficient visual and textual semantics for cross-modal alignment and hierarchy learning.
- domain assumption Patch and region pseudo-labels inferred by cosine similarity to class semantic features are reliable enough for training.
Cite this review
Pith. "Pith review of HyperPath: Knowledge-Guided Hyperbolic Semantic Hierarchy Modeling for WSI Analysis." pith.science (2026). https://pith.science/paper/MMGACLSQ
@misc{pith2026250616398,
author = {Pith},
title = {Pith review of: HyperPath: Knowledge-Guided Hyperbolic Semantic Hierarchy Modeling for WSI Analysis},
year = {2026},
howpublished = {\url{https://pith.science/paper/MMGACLSQ}},
note = {Machine review of arXiv:2506.16398}
}
read the original abstract
Pathology is essential for cancer diagnosis, with multiple instance learning (MIL) widely used for whole slide image (WSI) analysis. WSIs exhibit a natural hierarchy -- patches, regions, and slides -- with distinct semantic associations. While some methods attempt to leverage this hierarchy for improved representation, they predominantly rely on Euclidean embeddings, which struggle to fully capture semantic hierarchies. To address this limitation, we propose HyperPath, a novel method that integrates knowledge from textual descriptions to guide the modeling of semantic hierarchies of WSIs in hyperbolic space, thereby enhancing WSI classification. Our approach adapts both visual and textual features extracted by pathology vision-language foundation models to the hyperbolic space. We design an Angular Modality Alignment Loss to ensure robust cross-modal alignment, while a Semantic Hierarchy Consistency Loss further refines feature hierarchies through entailment and contradiction relationships and thus enhance semantic coherence. The classification is performed with geodesic distance, which measures the similarity between entities in the hyperbolic semantic hierarchy. This eliminates the need for linear classifiers and enables a geometry-aware approach to WSI analysis. Extensive experiments show that our method achieves superior performance across tasks compared to existing methods, highlighting the potential of hyperbolic embeddings for WSI analysis.
Figures
Reference graph
Works this paper leans on
-
[1]
In: International Conference on Machine Learning
Chami, I., Gu, A., Nguyen, D.P., Ré, C.: Horopca: Hyperbolic dimensionality re- duction via horospherical projections. In: International Conference on Machine Learning. pp. 1419–1429. PMLR (2021)
work page 2021
-
[2]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Chen, R.J., Chen, C., Li, Y., Chen, T.Y., Trister, A.D., Krishnan, R.G., Mahmood, F.: Scaling vision transformers to gigapixel images via hierarchical self-supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 16144–16155 (2022)
2022
-
[3]
Nature Medicine30(3), 850–862 (2024)
Chen, R.J., Ding, T., Lu, M.Y., Williamson, D.F., Jaume, G., Song, A.H., Chen, B., Zhang, A., Shao, D., Shaban, M., et al.: Towards a general-purpose foundation model for computational pathology. Nature Medicine30(3), 850–862 (2024)
2024
-
[4]
Annual Review of Pathology: Mechanisms of Disease6(1), 49–69 (2011)
da Cunha Santos, G., Shepherd, F.A., Tsao, M.S.: Egfr mutations and lung cancer. Annual Review of Pathology: Mechanisms of Disease6(1), 49–69 (2011)
work page 2011
-
[5]
In: International Conference on Machine Learning
Desai, K., Nickel, M., Rajpurohit, T., Johnson, J., Vedantam, S.R.: Hyperbolic image-text representations. In: International Conference on Machine Learning. pp. 7694–7731. PMLR (2023)
2023
-
[6]
In: International conference on machine learning
Ganea, O., Bécigneul, G., Hofmann, T.: Hyperbolic entailment cones for learn- ing hierarchical embeddings. In: International conference on machine learning. pp. 1646–1655. PMLR (2018)
2018
-
[7]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Guo, Y., Guo, H., Yu, S.X.: Co-sne: Dimensionality reduction and visualization for hyperbolic data. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 21–30 (2022)
work page 2022
-
[8]
In: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention
Guo, Z., Zhao, W., Wang, S., Yu, L.: Higt: Hierarchical interaction graph- transformer for whole slide image analysis. In: International Conference on Medi- cal Image Computing and Computer-Assisted Intervention. pp. 755–764. Springer (2023) 10 P. Huang et al
work page 2023
Show all 33 references
-
[9]
Advances in Neural Information Processing Systems37, 79963–79995 (2025)
Huang, Y., Zhao, W., Chen, Y., Fu, Y., Yu, L.: Free lunch in pathology foundation model: Task-specific model adaptation with concept-guided feature enhancement. Advances in Neural Information Processing Systems37, 79963–79995 (2025)
2025
-
[10]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Huang, Y., Zhao, W., Wang, S., Fu, Y., Jiang, Y., Yu, L.: Conslide: Asynchronous hierarchical interaction transformer with breakup-reorganize rehearsal for contin- ual whole slide image analysis. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. ...
2023
-
[11]
In: International conference on machine learning
Ilse,M.,Tomczak,J.,Welling,M.:Attention-baseddeepmultipleinstancelearning. In: International conference on machine learning. pp. 2127–2136. PMLR (2018)
2018
-
[12]
Khrulkov, V., Mirvakhabova, L., Ustinova, E., Oseledets, I., Lempitsky, V.: Hyper- bolicimageembeddings.In:ProceedingsoftheIEEE/CVFconferenceoncomputer vision and pattern recognition. pp. 6418–6428 (2020)
2020
-
[13]
arXiv preprint arXiv:1412.6980 (2014)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
2014 arXiv
-
[14]
Arti- ficial Intelligence Review55(6), 4809–4878 (2022)
Li, X., Li, C., Rahaman, M.M., Sun, H., Li, X., Wu, J., Yao, Y., Grzegorzek, M.: A comprehensive review of computer-aided whole-slide image analysis: from datasets to feature extraction, segmentation, classification and detection approaches. Arti- ficial Intelligence Review55(...
2022
-
[15]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Liu, S., Chen, J., Pan, L., Ngo, C.W., Chua, T.S., Jiang, Y.G.: Hyperbolic visual embedding learning for zero-shot recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 9273–9281 (2020)
2020
-
[16]
In: Proceedings of the Computer Vision and Pattern Recognition Conference
Liu, Y., He, Z., Han, K.: Hyperbolic category discovery. In: Proceedings of the Computer Vision and Pattern Recognition Conference. pp. 9891–9900 (2025)
2025
-
[17]
The Lancet389(10087), 2415– 2429 (2017)
Loibl, S., Gianni, L.: Her2-positive breast cancer. The Lancet389(10087), 2415– 2429 (2017)
2017
-
[18]
Nature Medicine30(3), 863–874 (2024)
Lu, M.Y., Chen, B., Williamson, D.F., Chen, R.J., Liang, I., Ding, T., Jaume, G., Odintsov, I., Le, L.P., Gerber, G., et al.: A visual-language foundation model for computational pathology. Nature Medicine30(3), 863–874 (2024)
2024
-
[19]
Nature biomedical engineering5(6), 555–570 (2021)
Lu, M.Y., Williamson, D.F., Chen, T.Y., Chen, R.J., Barbieri, M., Mahmood, F.: Data-efficient and weakly supervised computational pathology on whole-slide images. Nature biomedical engineering5(6), 555–570 (2021)
2021
-
[20]
Ad- vances in neural information processing systems10 (1997)
Maron, O., Lozano-Pérez, T.: A framework for multiple-instance learning. Ad- vances in neural information processing systems10 (1997)
1997
-
[21]
arXiv preprint arXiv:1807.03748 (2018)
Oord, A.v.d., Li, Y., Vinyals, O.: Representation learning with contrastive predic- tive coding. arXiv preprint arXiv:1807.03748 (2018)
2018 arXiv
-
[22]
arXiv preprint arXiv:2410.06912 (2024)
Pal, A., van Spengler, M., di Melendugno, G.M.D., Flaborea, A., Galasso, F., Mettes, P.: Compositional entailment learning for hyperbolic vision-language mod- els. arXiv preprint arXiv:2410.06912 (2024)
2024 arXiv
-
[23]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Ramasinghe, S., Shevchenko, V., Avraham, G., Thalaiyasingam, A.: Accept the modality gap: An exploration in the hyperbolic space. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 27263– 27272 (2024)
2024
-
[24]
Advances in neural information processing systems34, 2136–2147 (2021)
Shao, Z., Bian, H., Chen, Y., Wang, Y., Zhang, J., Ji, X., et al.: Transmil: Trans- former based correlated multiple instance learning for whole slide image classifica- tion. Advances in neural information processing systems34, 2136–2147 (2021)
2021
-
[25]
Advances in Neural Information Processing Systems 37, 91220–91259 (2025)
Sinha, A., Zeng, S., Yamada, M., Zhao, H.: Learning structured representations with hyperbolic embeddings. Advances in Neural Information Processing Systems 37, 91220–91259 (2025)
2025
-
[26]
Srivastava, S., Wu, K.: Vision-language understanding in hyper- bolic space (2024), https://www.amazon.science/publications/ vision-language-understanding-in-hyperbolic-space HyperPath 11
2024
-
[27]
arXiv preprint arXiv:2309.07778 (2023)
Vorontsov, E., Bozkurt, A., Casson, A., Shaikovski, G., Zelechowski, M., Liu, S., Severson, K., Zimmermann, E., Hall, J., Tenenholtz, N., et al.: Virchow: A million- slide digital pathology foundation model. arXiv preprint arXiv:2309.07778 (2023)
2023 arXiv
-
[28]
Nature634(8035), 970–978 (2024)
Wang, X., Zhao, J., Marostica, E., Yuan, W., Jin, J., Zhang, J., Li, R., Tang, H., Wang, K., Li, Y., et al.: A pathology foundation model for cancer diagnosis and prognosis prediction. Nature634(8035), 970–978 (2024)
2024
-
[29]
arXiv preprint arXiv:2411.17490 (2024)
Wang, Z., Ramasinghe, S., Xu, C., Monteil, J., Bazzani, L., Ajanthan, T.: Learning visual hierarchies with hyperbolic embeddings. arXiv preprint arXiv:2411.17490 (2024)
2024
-
[30]
Nature genetics45(10), 1113–1120 (2013)
Weinstein,J.N.,Collisson,E.A.,Mills,G.B.,Shaw,K.R.,Ozenberger,B.A.,Ellrott, K., Shmulevich, I., Sander, C., Stuart, J.M.: The cancer genome atlas pan-cancer analysis project. Nature genetics45(10), 1113–1120 (2013)
2013
-
[31]
In: International Conference on Machine Learning
Yang, M., Zhou, M., Ying, R., Chen, Y., King, I.: Hyperbolic representation learn- ing: Revisiting and advancing. In: International Conference on Machine Learning. pp. 39639–39659. PMLR (2023)
2023
-
[32]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Zhang, H., Meng, Y., Zhao, Y., Qiao, Y., Yang, X., Coupland, S.E., Zheng, Y.: Dtfd-mil: Double-tier feature distillation multiple instance learning for histopathol- ogy whole slide image classification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern ...
2022
-
[33]
In: European Conference on Computer Vision
Zhang, Y., Li, H., Sun, Y., Zheng, S., Zhu, C., Yang, L.: Attention-challenging mul- tiple instance learning for whole slide image classification. In: European Conference on Computer Vision. pp. 125–143. Springer (2024)
2024
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.