REVIEW 2 major objections 6 minor 13 references
Alternate states and intermingledness in complex high-dimensional systems
T0 review · 2 major / 6 minor · reviewed 2026-07-13 · grok-4.5
Pith's one-line read A featurize-and-group workflow decides which alternate states exist in high-dimensional simulations and which observables best separate them.
desk verdict Usable open workflow that recovers expert multistability on three climate ensembles and ranks which observables actually separate the states; soft spot is the ad-hoc Q objective, not the recovery results. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Intermingledness: for each group and each one-dimensional diagnostic, the ratio of mean intra-group pairwise distance to mean inter-group pairwise distance; values near 1 mean the groups cannot be told apart along that diagnostic.
What would settle it
On a held-out ensemble whose attractors are already known by exhaustive long control runs, re-run the full optimization with the same candidate features and check whether the recovered partition and the top-ranked diagnostics match the known classification.
Extended reading notes
Core claim
Finite high-dimensional simulation ensembles can be partitioned into objectively distinguishable alternate states by projecting trajectories onto diagnostic features, clustering those features with iterative advanced DBSCAN, and ranking candidate feature subspaces by a grouping-quality score that rewards more states, fewer dimensions, and fewer outliers; the same partition yields an intermingledness matrix that quantifies, per diagnostic, how similar or mixed the states and their basins are.
Load-bearing premise
The ad-hoc grouping-quality score that multiplies silhouette mean by powers of the number of states, features, and outliers is assumed to select the scientifically correct feature subspaces; if that score mis-ranks, the claimed optimal observables change.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a computational workflow for identifying and analysing alternate states in finite, high-dimensional simulation ensembles. Building on a featurize-and-group approach with an iterative advanced DBSCAN (IA-DBSCAN), it optimizes over feature subspaces using an empirically defined grouping quality Q (Eq. 1) to decide whether clearly distinguishable alternate states exist and which observables best separate them. It further introduces intermingledness, a per-group, per-dimension ratio of pairwise-averaged intra- to inter-group distances, to quantify similarity of attractor features and of basins of attraction. The method is demonstrated on three climate ensembles (Veros AMOC multistability, MAOOAM midlatitude flow with continuation in emissivity, and ExoPlaSim exoplanet habitability classes), recovers expert-known groupings where available, and is released with open-source code.
Significance. If the workflow performs as claimed, it fills a genuine methodological gap: objective, transferable analysis of multistability and alternate operating regimes in sparse, high-dimensional climate and complex-system data where traditional dense basin methods and simple clustering fail. Recovering expert attractor counts on Veros and MAOOAM, reproducing a known destabilization under continuation, and providing open code and an intermingledness implementation in DynamicalSystems.jl are concrete strengths. The indicator and feature-ranking outputs could usefully guide monitoring, early-warning design, and model intercomparison (e.g. TipMIP, habitability MIPs). The contribution is primarily methodological rather than a uniqueness theorem; its value rests on practical reliability and reproducibility, which the manuscript largely supports.
major comments (2)
- Eq. (1) and Appendix B: Grouping quality Q is acknowledged as empirically derived with no theoretical foundation, and silhouette mean S is shown to be nearly independent of cluster count A and feature count F. Fig. 7 further shows that weight choices can change the recovered number of attractors (e.g. 4 vs 5 when iteration is off). Because the central claim is that the workflow algorithmically decides which alternate states exist and which observables are optimal, the manuscript needs clearer default weight recommendations, a short protocol for sensitivity checks practitioners must run, and explicit discussion of failure modes when Q mis-ranks feature sets. Without that, the claimed objectivity of the recovered states remains partly practitioner-dependent.
- Sections 3.1–3.3 and 4.2: Validation is performed only on ensembles already known (or pre-labeled) to contain alternate states. The workflow’s claim to decide whether alternate states are “clearly distinguishable, if any” therefore lacks a demonstrated null or false-positive case (e.g. a monostable ensemble or pure noise features). A brief controlled test or synthetic monostable example would substantially strengthen confidence that the pipeline does not invent structure when none exists, which is load-bearing for applications where the answer is unknown a priori.
minor comments (6)
- Notation for Q in Eq. (1) uses A, F, O without fully consistent symbols in the surrounding text (sometimes n_outliers, etc.); unify symbols and define n_min explicitly in the main text, not only in Appendix B.
- Figure 1 step labels and spine highlighting are helpful but dense; a short legend or caption sentence listing what each panel’s axes represent would improve readability for non-specialists.
- Section 2.2: The list of possible features is good, but the paper only uses late-time mean/std. A one-sentence justification why more complex features (entropy, spectral) were unnecessary for these three datasets would help transferability claims.
- Appendix C: Boundary intermingledness is interesting but under-used in the main applications. Either apply it once to Veros/MAOOAM basins or move the full comparison to a shorter note so the main text stays focused.
- Typos and style: “posses” → “possess” (abstract); “intermingledess” in §6; occasional missing articles; “MOAOOAM” in Fig. 4 caption should be MAOOAM.
- Data availability: MAOOAM trajectories “available upon request” weakens reproducibility relative to Veros and ExoPlaSim; if possible, deposit a reduced feature table or a subset of trajectories.
Circularity Check
No significant circularity: the workflow is an empirical clustering pipeline validated against independent expert classifications; Q and intermingledness are new constructs, not tautological restatements of their inputs.
-
self citation load bearing
[§2.3 Feature grouping; also Intro and §2.7]
"In Ref. [DLW23] we have substantially improved the algorithm into the version we called ADBSCAN (A for Advanced) where the parameter ε is optimized to yield a clustering of optimal quality. ... In this work we further augmented the algorithm to IA-DBSCAN (I for Iterative)..."
The core clustering engine (ADBSCAN) is taken from the authors' prior paper DLW23. This is ordinary methods reuse, not a circular derivation: the present paper adds iteration, the new quality metric Q, feature-subspace search, and intermingledness, then validates on independent ensembles. The self-citation does not force the recovered attractors or the intermingledness values; those are outputs of applying the pipeline to new data. Flagged only as minor self-citation of the base algorithm.
full rationale
The paper's central claim is a computational workflow (featurize → IA-DBSCAN → optimize grouping quality Q → intermingledness) that recovers alternate states from finite high-dimensional ensembles. Validation is external: on three climate datasets the recovered groups match prior expert hand-classifications (Veros AMOC attractors, MAOOAM LFV attractors, SAMOSA habitability classes). The base clustering algorithm is imported from DLW23/DW22 (self-citations by overlapping authors), but those citations supply a reusable density-based procedure, not a uniqueness theorem that forces the climate results; the new pieces (iterative re-application, the ad-hoc Q of Eq. 1, and the intermingledness ratio) are defined and applied here. Appendix B explicitly states that Q has no theoretical foundation and is empirically motivated; sensitivity to its weights is shown, so Q is not presented as a first-principles derivation. Intermingledness is a ratio of pairwise intra- to inter-group distances and is not claimed to equal any fitted parameter. Continuation matching likewise uses a simple centroid-distance rule. No equation reduces a claimed prediction to a fitted input by construction, and no uniqueness result is smuggled in to forbid alternatives. The single minor self-citation of the base algorithm is not load-bearing for the climate recoveries or for the definition of intermingledness. Score 1 reflects that ordinary self-citation of prior methods work without circular reduction of the paper's own claims.
Assumptions & free parameters
free parameters (4)
- Grouping-quality weights w_A, w_F, w_O
- Feature-subspace size d and combinatorial subsample
- Minimum points per group n_min and outlier handling
- Choice of feature functionals (late-time mean/std, fraction of series kept)
assumptions (4)
- ad hoc to paper If alternate states are uniquely distinguishable, there exists at least one feature on which they form separable clusters; absence of such a feature means the dataset has no clearly distinguishable alternate states.
- domain assumption Density-based clustering (ADBSCAN/IA-DBSCAN) with silhouette-optimized radius can recover the correct number of groups without a preset k in sparse feature space.
- ad hoc to paper Pairwise-averaged intra/inter group distance ratios on 1-D projections meaningfully quantify separation of attractors and basins for heterotypic diagnostics.
- domain assumption Late-time statistics of projected diagnostic variables are sufficient proxies for high-dimensional attractors when full re-simulation is impossible.
invented entities (3)
-
Intermingledness I_i (and boundary intermingledness)
-
Grouping quality Q
-
IA-DBSCAN (iterative advanced DBSCAN)
Cite this review
Pith. "Pith review of Alternate states and intermingledness in complex high-dimensional systems." pith.science (2026). https://pith.science/paper/UPKN6IJI
@misc{pith2026260409661,
author = {Pith},
title = {Pith review of: Alternate states and intermingledness in complex high-dimensional systems},
year = {2026},
howpublished = {\url{https://pith.science/paper/UPKN6IJI}},
note = {Machine review of arXiv:2604.09661}
}
read the original abstract
Many natural systems posses, and can transition between, multiple alternative states. For example, a climate ``tipping element'' is a climate component that can transition to an alternative steady state due to an external perturbation such as global warming. Despite the potential impact, existence of alternate states in realistic, complex simulations (e.g. climate models) remain poorly understood. Arguably a reason for this is the lack of applicable methodology that explicitly targets finite yet high-dimensional datasets. In this work we utilize recent progress in computational nonlinear dynamics to formulate a workflow that analyses potentially multi-state simulation data and decides algorithmically what are the alternate states contained within, if any are clearly distinguishable. The framework undergoes an optimization routine that showcases which observables in the data best differentiate the alternate states, and which ones do not differentiate at all, which could be used to guide monitoring and early-warning for multistable components in climate or ecosystems. Finally, once the alternate states have been found, we define an indicator called ``intermingledness''. It quantifies differences and similarities between alternate states, as well as for their basins of attraction (if applicable), across various diagnostic variables. We analyse and present results using three diverse climate datasets: Atlantic ocean circulation, atmospheric midlatitude flow, and habitability of exoplanets. The method is not exclusive to climatic data, but applicable to a variety of cases, including complex networks such as power grids or biological networks. We also provide easy-to-use open source code for applying the workflow to new data.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
Stabilizing feed- backs allow for multiple states of the Greenland Ice Sheet in a fully coupled Earth System – Ice Sheet Model
[AKM26] Malena Andernach, Marie-Luise Kapsch, and Uwe Mikolajewicz. “Stabilizing feed- backs allow for multiple states of the Greenland Ice Sheet in a fully coupled Earth System – Ice Sheet Model”. In:The Cryosphere20.2 (Feb. 2026), pp. 1047–1069.����: 1994-0424.���:�����������������������.���:�������������������������� ���������������. [And11] Theodore W...
2026
-
[2]
Two decades of climate tipping points research: Progress and outlook
[Arm24] David I. Armstrong McKay. “Two decades of climate tipping points research: Progress and outlook”. In:Dialogues on Climate Change1.1 (Dec. 2024), pp. 30–38.����: 2976- 8659, 2976-8659.���:�������������������������. [BKV19] M. Brunetti, J. Kasparian, and C. V´ erard. “Co-existing climate attractors in a cou- pled aquaplanet”. In:Climate Dynamics53.9...
arXiv 2024
-
[3]
Estimating fractal dimensions: A comparative review and open source implementations
[Dat+23] George Datseris et al. “Estimating fractal dimensions: A comparative review and open source implementations”. In:Chaos: An Interdisciplinary Journal of Nonlinear Science33.10 (Oct. 2023).����: 1089-7682.���:�����������������.���:����� ������������������������������. [Dat18] George Datseris. “DynamicalSystems.jl: A Julia software library for chaos...
2023
-
[4]
The Modular Arbitrary- Order Ocean-Atmosphere Model: MAOOAM v1.0
���:�����������������������. (Visited on 05/27/2025). [DDV16] Lesley De Cruz, Jonathan Demaeyer, and St´ ephane Vannitsem. “The Modular Arbitrary- Order Ocean-Atmosphere Model: MAOOAM v1.0”. In:Geoscientific Model Develop- ment9.8 (Aug. 2016), pp. 2793–2808.����: 1991-9603.���:������������������� ����. (Visited on 04/07/2025). [Dei+23] Russell Deitrick et...
2025
-
[5]
ComplexityMeasures.jl: Scalable soft- ware to unify and accelerate entropy and complexity timeseries analysis
[DH25] George Datseris and Kristian Agasøster Haaga. “ComplexityMeasures.jl: Scalable soft- ware to unify and accelerate entropy and complexity timeseries analysis”. In:PLOS ONE20.6 JUNE (2025), pp. 1–21.����: 19326203.���:��������������������� �������.���:��������������������������������������������. [DLW23] George Datseris, Kalel Luiz Rossi, and Alexand...
2025
-
[6]
Alternative signaling pathways: when, where and why?
[GZ05] Yunchen Gong and Zhaolei Zhang. “Alternative signaling pathways: when, where and why?” en. In:FEBS Lett.579.24 (Oct. 2005), pp. 5265–5274. [Ham+23] Ois´ ın Hamilton et al. “Multistability in a coupled ocean–atmosphere reduced-order model: Nonlinear temperature equations”. In:Quarterly Journal of the Royal Meteo- rological Society149.757 (Sept. 2023...
2005
-
[7]
Demarcating circulation regimes of synchronously rotating terrestrial planets within the habitable zone
18 [Haq+18] Jacob Haqq-Misra et al. “Demarcating circulation regimes of synchronously rotating terrestrial planets within the habitable zone”. In:The Astrophysical Journal852.2 (2018), p
2018
-
[8]
The Sparse Atmospheric Model Sampling Analysis (SAMOSA) Intercomparison: Motivations and Protocol Version 1.0: A CUISINES Model Intercom- parison Project
[Haq+22] Jacob Haqq-Misra et al. “The Sparse Atmospheric Model Sampling Analysis (SAMOSA) Intercomparison: Motivations and Protocol Version 1.0: A CUISINES Model Intercom- parison Project”. In:The Planetary Science Journal3.11 (Nov. 2022), p. 260.����: 2632-3338.���:������������������.���:������������������������������ ������. [Har+24] Carsten Hartmann et...
2022
Show all 13 references
-
[9]
The snowball Earth transition in a climate model with drifting parameters: Splitting of the snapshot attractor
[KHH19] B´ alint Kasz´ as, T´ ımea Haszpra, and M´ aty´ as Herein. “The snowball Earth transition in a climate model with drifting parameters: Splitting of the snapshot attractor”. en. In:Chaos29.11 (Nov. 2019), p. 113102. [Kim+18] Heetae Kim et al. “Multistability and variati...
2019
-
[10]
Risk of tipping the overturning circula- tion due to increasing rates of ice melt
[LD21] Johannes Lohmann and Peter D. Ditlevsen. “Risk of tipping the overturning circula- tion due to increasing rates of ice melt”. In:Proceedings of the National Academy of Sciences of the United States of America118.9 (2021), pp. 1–6.����: 10916490.���: ��������������������...
2021
-
[11]
Robustness of Competing Climatic States
[Rag+22] Charline Ragon et al. “Robustness of Competing Climatic States”. In:Journal of Climate35.9 (2022), pp. 2769–2784.����: 0894-8755.���:������������� �� ��� ������. [Rah95] S. Rahmstorf. “Multiple Convection Patterns and Thermohaline Flow in an Idealized OGCM”. In:J. Cli...
2022
-
[12]
Multistability and Rare Spon- taneous Transitions in Barotropic beta-Plane Turbulence
[SRB21] Eric Simonnet, Joran Rolland, and Freddy Bouchet. “Multistability and Rare Spon- taneous Transitions in Barotropic beta-Plane Turbulence”. In:Journal of the Atmo- spheric Sciences78 (6 June 2021), pp. 1889–1911.����: 0022-4928.���:������������ �����������. [TD26] J. Th...
2021
-
[13]
Atmospheric regimes and trends on exoplanets and brown dwarfs
[Zha20] Xi Zhang. “Atmospheric regimes and trends on exoplanets and brown dwarfs”. In: Research in Astronomy and Astrophysics20.7 (2020), p
2020
Reviewed July 13, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.