REVIEW 3 major objections 5 minor
Hierarchical Classification via Cascading Feature Elimination: Application to Human Phenotype Ontology-Aligned Facial Phenotyping (FaceMesh2HPO)
T0 review · 3 major / 5 minor · reviewed 2026-07-11 · grok-4.5
Pith's one-line read Cascading 3D face-mesh models can classify clinical facial traits along the Human Phenotype Ontology rather than naming syndromes.
desk verdict Solid hierarchical HPO phenotyper on MediaPipe meshes; parent nodes work, rare leaves do not, and the authors already document both. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Cascading feature elimination along the HPO tree: each PointNet classifier is trained on its subtree, Integrated Gradients ranks mesh points, a threshold prunes the mask, and the reduced mask is handed to child terms so that deeper models see only the landmarks that mattered higher up.
What would settle it
Train and evaluate the same cascade on true 3D facial scans of the same patients and check whether leaf-term AUROCs rise substantially above chance and whether detection prevalence no longer drifts so far from the balanced training prior.
Extended reading notes
Core claim
Geometric 3D face meshes combined with a hierarchical PointNet cascade that eliminates unimportant landmarks term by term can produce clinically meaningful, ontology-aligned facial phenotype predictions, with mean AUROC around 0.75 and systematically higher accuracy near the root than at rare leaves.
Load-bearing premise
That 478-point meshes extracted from ordinary 2D clinical photographs, together with incomplete clinician annotations and soft-labeled control faces, still carry enough reliable geometric signal to train the hierarchy.
Editorial extensions
If this is right
- Diagnostic tools can output reusable HPO trait lists instead of a single syndrome name, supporting differential diagnosis and tools that already consume HPO terms.
- Parent and compression nodes already give usable signal and transfer better to unseen disorders than leaf models, so coarser ontology levels are the practical entry point for clinical use.
- Point-importance maps and expert region masks make the decision regions inspectable, giving a path to clinician-auditable geometric explanations.
- The same cascade can be extended as more curated HPO annotations become available without redesigning the architecture.
Reading between the lines
- If mesh detectors systematically miss dysmorphic landmarks, the cascade will keep under-performing on the very traits clinicians care about most; refining the front-end mesh extractor may matter more than further architecture tweaks.
- Soft labels and 50/50 rebalancing mask the true prevalence of rare traits, so any clinical deployment will need explicit calibration and prevalence-aware decision thresholds before the reported F1 numbers can be trusted at the bedside.
- The large performance gap between parent and leaf terms suggests the method may be most valuable as a pre-filter that proposes intermediate HPO terms for human review rather than as an end-to-end leaf-term annotator.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. FaceMesh2HPO frames facial dysmorphism analysis as hierarchical HPO-term classification rather than syndrome-level prediction. From 2D clinical photographs the authors extract MediaPipe 478-point approximate-3D meshes, combine them with clinician-curated positive/negative HPO labels for 10 disorders (107 terms after parent expansion) plus soft-labeled UTKFace controls, and train a cascade of dynamically sized PointNets organized along a simplified HPO tree. After each node is trained, Integrated Gradients point importance is thresholded and the surviving mask is passed to child nodes (cascading feature elimination); optional expert region masks override the cascade for selected anatomical terms. A 72-configuration ablation selects 3D meshes + facial outline + age/sex/ethnicity metadata, threshold 0.01 and soft-label 0.05, yielding mean AUROC 0.750 ± 0.042; parent/compression nodes routinely exceed 0.85 while many rare leaves remain near chance. An independent multi-expert test set of seen and unseen disorders shows heterogeneous F1 transfer, stronger at coarser ontology levels. A local web tool is released for clinical use.
Significance. The work supplies a clinically aligned alternative to black-box syndrome classifiers: ontology-linked phenotype scores that can feed tools such as LIRICAL and remain informative for unseen disorders. Strengths include a large multi-clinician annotation effort (124 annotators), systematic ablation, stratified 5-fold CV that respects patient identity, explicit parent-versus-leaf and seen-versus-unseen reporting, and a privacy-preserving local web application. If the hierarchical mesh approach continues to improve with better landmark detectors and more diverse data, it could become a practical component of next-generation phenotyping pipelines. The contribution is incremental rather than transformative, but the empirical documentation of performance bounds is solid and useful for the community.
major comments (3)
- [§5.2 Results / Table 4 / Fig. 5] §5.2 / Table 4 / Fig. 5: leaf-term sample sizes frequently fall below 200 (e.g., Microphthalmia N=66, Blepharophimosis N=152) and the paper itself shows that AUROC ≥ 0.75 for leaves requires ≥ 988 samples. The central claim of “clinically meaningful classification” therefore holds mainly for parent/compression nodes; the manuscript should either restrict the primary claim to those levels or supply a quantitative decision rule (minimum N / minimum AUROC) for when a leaf model is considered usable.
- [§6 Discussion / citation [34]] §6 Discussion and the authors’ own citation [34]: MediaPipe meshes are known to under-represent traits such as Big Nose and Big Lips on dysmorphic faces. Because the entire cascade depends on these 478 points, the Discussion should quantify how often landmark failure occurs on the GMDB-HPO cohort (or at least report a failure-rate proxy) and discuss whether expert region masks can fully compensate. Without that evidence the geometric premise remains only partially validated.
- [§4.4 Training Strategy / Table 4] §4.4 / Table 4 detection-prevalence column: training forces a 50/50 class balance while detection prevalence ranges from ~0.23 to ~0.74. Soft labels of 0.05 mitigate but do not eliminate the resulting miscalibration. For clinical deployment the authors should report calibration metrics (Brier, ECE) per node on the external test set and, if necessary, apply the same beta/temperature calibration already used in the web tool to the offline evaluation tables.
minor comments (5)
- [§3.1 / Table 1] Table 1 and §3.1: two HPO terms (HP:0410030, HP:0004493) were dropped for insufficient data; state the exact sample-size cutoff used.
- [Fig. 2 / §4] Fig. 2 caption and §4: clarify that the displayed point-importance colors are Integrated Gradients aggregated across folds, not single-fold attributions.
- [Appendix Table A1] Appendix Table A1: several IRA values are reported as 1.00 ± 0.00; note whether these terms were annotated by only one rater or truly unanimous.
- [§4.3 Model-Architecture] §4.3: the dynamic width schedule (p = 6/5/4/3) is sensible but the zero-padding rule for <2 points should be stated more explicitly to aid re-implementation.
- [Tables / Fig. 6] Minor typos: “norphology” (Table C3), “unseed” (Fig. 6 caption), and inconsistent spelling of “softlabel/soft label”.
Circularity Check
No circularity: purely empirical hierarchical supervised learning whose reported AUROCs are measured against held-out folds and an external multi-expert set, not forced by construction or self-citation.
full rationale
FaceMesh2HPO trains a tree of PointNet classifiers on MediaPipe 478-point meshes extracted from 2D images, with cascading Integrated-Gradients point elimination along a simplified HPO hierarchy, soft-labeled UTKFace negatives, and optional demographic metadata. Every numerical claim (mean AUROC 0.750 ± 0.042, per-node ranges ≈0.55–0.89, parent-vs-leaf gaps, sample-size correlations, external F1 differences) is obtained by 5-fold stratified cross-validation or by evaluation on an independent multi-expert test set; none is algebraically identical to a fitted constant or to a definition. Ablations (Table 3 / B2) and per-term tables (C3, D4–D22) further document that performance varies with data support and ontology depth rather than being guaranteed by the architecture. Self-citations (GestaltMatcher, Hellmann et al. on MediaPipe fidelity) supply background data and acknowledged limitations; they do not underwrite the reported metrics. The derivation chain is therefore self-contained empirical machine learning with no circular reduction.
Assumptions & free parameters
free parameters (4)
- feature-importance elimination threshold =
0.01
- soft-label value for negatives =
0.05
- PointNet width parameter p =
6/5/4/3 by point count
- learning-rate / early-stopping patience =
0.0001 / 5
assumptions (4)
- ad hoc to paper HPO cross-links can be cut so that the remaining structure is a pure tree with Abnormality of the face as root.
- domain assumption MediaPipe's 478-point mesh extracted from 2D clinical photographs is a sufficiently faithful geometric representation of dysmorphic facial morphology.
- domain assumption Clinician annotations (present/absent/uncertain) plus soft-labeled UTKFace controls constitute usable ground truth for hierarchical binary classifiers.
- domain assumption Integrated Gradients point-importance scores accumulated across folds yield a stable mask for cascading elimination.
invented entities (2)
-
Cascading feature-elimination hierarchy of PointNets aligned to HPO
-
FaceMesh2HPO end-to-end pipeline and local web tool
Cite this review
Pith. "Pith review of Hierarchical Classification via Cascading Feature Elimination: Application to Human Phenotype Ontology-Aligned Facial Phenotyping (FaceMesh2HPO)." pith.science (2026). https://pith.science/paper/KWRNGQ6H
@misc{pith2026260705585,
author = {Pith},
title = {Pith review of: Hierarchical Classification via Cascading Feature Elimination: Application to Human Phenotype Ontology-Aligned Facial Phenotyping (FaceMesh2HPO)},
year = {2026},
howpublished = {\url{https://pith.science/paper/KWRNGQ6H}},
note = {Machine review of arXiv:2607.05585}
}
read the original abstract
FaceMesh2HPO is a framework for classifying facial phenotypic descriptors aligned with the Human Phenotype Ontology (HPO) to support clinical diagnosis. Using annotations from 124 clinicians across 10 disorders (107 HPO terms) combined with non-syndromic controls, we generated 3D facial meshes (478 landmarks) from 2D images and trained a hierarchical PointNet-based pipeline with cascading classification and feature elimination. The best models, incorporating 3D meshes, facial outline, and demographic metadata, achieved AUROCs between ~0.55 and ~0.89, with higher performance at parent nodes than leaf terms. External validation showed variable generalizability across disorders. Results demonstrate that hierarchical modeling of 3D facial geometry enables interpretable, ontology-linked phenotype classification, though performance on rare leaf terms remains limited. Improved data diversity and feature selection strategies are needed to enhance robustness and clinical utility.
Reviewed July 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.