pith. sign in

arxiv: 2606.24691 · v1 · pith:Q3SVAEQQnew · submitted 2026-06-23 · 📊 stat.CO · stat.ME

Learning Nonlinear Dynamics: Improving the Estimation Efficiency and Reliability of Gaussian Process State-Space Models

Pith reviewed 2026-06-25 21:44 UTC · model grok-4.3

classification 📊 stat.CO stat.ME
keywords Gaussian processstate-space modelsnonlinear dynamicsGibbs samplerBayesian inferencesimulation-based calibrationconfirmatory factor analysisidentifiability
0
0 comments X

The pith

Modifications to a Gibbs sampler and use of confirmatory factor analysis make Gaussian process state-space models easier to estimate for nonlinear dynamics.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper aims to make Bayesian estimation of approximate Gaussian process state-space models more practical for learning nonlinear latent dynamics from indirect observations. It proposes two modifications to an existing Gibbs sampler that improve sampling efficiency and convergence. It also incorporates a confirmatory factor analysis measurement model to address identifiability issues and allow specific measurement structures. A simulation-based calibration validates that the sampler converges reliably and yields well-calibrated posteriors across many simulated datasets. Software is provided, and empirical examples show application and interpretation.

Core claim

The central claim is that two modifications to an existing Gibbs sampler for approximate Gaussian process state-space models considerably improve its sampling efficiency and convergence, while a confirmatory factor analysis measurement model reduces identifiability issues. The sampler was validated using simulation-based calibration, showing reliable convergence across many simulated data sets and well-calibrated posterior inferences. A systematically validated software implementation is provided to facilitate use in empirical research.

What carries the argument

Modified Gibbs sampler for Gaussian process state-space models with confirmatory factor analysis measurement model.

If this is right

  • The sampler converges reliably across many simulated data sets.
  • It produces well-calibrated posterior inferences.
  • The approach allows researchers to impose a specific measurement structure on the model.
  • Empirical examples demonstrate how the model can be applied and interpreted.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • These sampler changes might extend to other types of state-space models beyond Gaussian processes.
  • The confirmatory factor analysis component could help in domains where measurement models are important, such as psychology.
  • Providing open software lowers the barrier for applied researchers to use these models.

Load-bearing premise

The two modifications to the Gibbs sampler preserve the target posterior distribution while only improving mixing and computational speed.

What would settle it

Running the original and modified samplers on identical simulated data and finding that the posteriors differ in a way that cannot be explained by sampling error.

read the original abstract

Understanding dynamic systems is a central goal in many scientific disciplines. State-space models provide a general framework for studying latent dynamic systems based on indirect observations. However, classical state-space methods require researchers to specify the parametric form of the system dynamics in advance, which can be challenging when the underlying processes are nonlinear and only partially explained by theory. Gaussian process state-space models address this by learning the system dynamics directly from data. However, estimating these models exactly can become computationally infeasible for moderately long time-series. In this paper, we therefore aim to improve the Bayesian estimation of approximate Gaussian process state-space models to make these models more accessible and facilitate the statistical learning of nonlinear dynamic systems in empirical research. To this end, we first propose two modifications to an existing Gibbs sampler for these models that considerably improve its sampling efficiency and convergence. Second, we use a confirmatory factor analysis measurement model, which reduces identifiability issues and allows researchers to impose a specific measurement structure on the model. Third, we provide a systematically validated software implementation of the model and sampler for applied use in empirical research. To validate the sampler, we conducted a simulation-based calibration which showed that the sampler converged reliably across many simulated data sets and produces well-calibrated posterior inferences. We further illustrate how the model can be applied and interpreted using two empirical examples. Together, these contributions provide a practical and validated workflow for learning nonlinear latent dynamics with Gaussian process state-space models.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 3 minor

Summary. The manuscript claims that two modifications to an existing Gibbs sampler for approximate Gaussian process state-space models (GPSSMs) considerably improve sampling efficiency and convergence while preserving correctness; that a confirmatory factor analysis (CFA) measurement model reduces identifiability issues and permits imposition of specific measurement structures; that a systematically validated software implementation is provided; and that simulation-based calibration (SBC) across many simulated datasets confirms reliable convergence and well-calibrated posterior inferences. The approach is illustrated with two empirical examples.

Significance. If the sampler modifications preserve the target distribution and the SBC results hold, the work supplies a practical, validated workflow for Bayesian learning of nonlinear latent dynamics from indirect observations. This addresses a key computational barrier for moderately long time series and identifiability problems that have limited applied use of GPSSMs. Explicit credit is due for the SBC validation across many datasets and the provision of reproducible software, both of which directly support reliability claims.

minor comments (3)
  1. [Abstract] Abstract: the phrase 'considerably improve its sampling efficiency and convergence' would be strengthened by a brief quantitative statement (e.g., median ESS ratio or Gelman-Rubin statistic reduction) even if space is limited.
  2. [Sampler modifications section] The manuscript should explicitly state, in the sampler section, that the two modifications leave the target posterior invariant (or provide the short invariance argument), as this underpins the reliability claim validated by SBC.
  3. [Empirical examples] Figure captions for the empirical examples should include the exact hyperparameter settings and data preprocessing steps used, to aid reproducibility.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for the positive and constructive review, which accurately summarizes the manuscript's contributions and correctly identifies the value of the SBC validation and reproducible software. The recommendation for minor revision is noted; however, no specific major comments were provided in the report.

Circularity Check

0 steps flagged

No significant circularity

full rationale

The paper proposes two modifications to an existing Gibbs sampler for approximate GP state-space models, adopts a CFA measurement model to address identifiability, and validates the resulting sampler via simulation-based calibration across many simulated datasets that confirm convergence and calibration. No equations, predictions, or central claims reduce by construction to fitted inputs or self-citations; the validation pipeline is external (SBC) and the modifications are presented as improvements whose correctness is checked rather than assumed by definition. The derivation chain is therefore self-contained against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Abstract provides no explicit free parameters, axioms, or invented entities; the work rests on standard assumptions of Gaussian process state-space models and approximate Bayesian inference.

pith-pipeline@v0.9.1-grok · 5806 in / 1148 out tokens · 15924 ms · 2026-06-25T21:44:08.159658+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

300 extracted references · 247 canonical work pages · 6 internal anchors

  1. [1]

    2025 , url =

    R: A Language and Environment for Statistical Computing , author =. 2025 , url =

  2. [2]

    2023 , journal =

    Simulation-based calibration checking for Bayesian computation: The choice of test quantities shapes sensitivity , author =. 2023 , journal =

  3. [3]

    Journal of Statistical Software , year =

    Dirk Eddelbuettel and Romain Fran. Journal of Statistical Software , year =

  4. [4]

    Aarts, Emmeke and Haslbeck, Jonas M. B. , year = 2024, month = nov, doi =. Modelling

  5. [5]

    Abarbanel, H. D. I. , year = 2022, publisher =. The. doi:10.1017/9781009024846 , abstract =

  6. [6]

    and Worden, Keith , year = 2017, month = aug, journal =

    Abdessalem, Anis Ben and Dervilis, Nikolaos and Wagg, David J. and Worden, Keith , year = 2017, month = aug, journal =. Automatic. doi:10.3389/fbuil.2017.00052 , urldate =

  7. [7]

    Aczel, Balazs and Szaszi, Barnabas and Sarafoglou, Alexandra and Kekecs, Zoltan and Kucharsk. A. Nature Human Behaviour , volume =. doi:10.1038/s41562-019-0772-6 , urldate =

  8. [8]

    Measurement

    Adolf, Janne and Schuurman, No. Measurement. Frontiers in Psychology , volume =

  9. [9]

    Biometrics , author =

    Albert, Jeffrey M. and Nelson, Suchitra , year = 2011, month = sep, journal =. Generalized. doi:10.1111/j.1541-0420.2010.01547.x , urldate =

  10. [10]

    Alogna, V. K. and Attaya, M. K. and Aucoin, P. and Bahn. Registered. Perspectives on Psychological Science , volume =. doi:10.1177/1745691614545653 , urldate =

  11. [11]

    PLoS ONE , volume =

    Public. PLoS ONE , volume =. doi:10.1371/journal.pone.0024357 , urldate =

  12. [12]

    Nature Methods , volume =

    The Curse(s) of Dimensionality , author =. Nature Methods , volume =. doi:10.1038/s41592-018-0019-x , urldate =

  13. [13]

    Kernels for Vector-Valued Functions: a Review

    Alvarez, Mauricio A. and Rosasco, Lorenzo and Lawrence, Neil D. , year = 2012, month = apr, number =. Kernels for. doi:10.48550/arXiv.1106.6251 , urldate =

  14. [14]

    Proceedings of the

    Latent. Proceedings of the

  15. [15]

    , year = 2017, month = may, journal =

    Aminikhanghahi, Samaneh and Cook, Diane J. , year = 2017, month = may, journal =. A. doi:10.1007/s10115-016-0987-z , urldate =

  16. [16]

    and Bahn

    Anderson, Christopher J. and Bahn. Response to. Science , volume =. doi:10.1126/science.aad9163 , urldate =

  17. [17]

    Particle

    Andrieu, Christophe and Doucet, Arnaud and Holenstein, Roman , year = 2010, month = jun, journal =. Particle. doi:10.1111/j.1467-9868.2009.00736.x , urldate =

  18. [18]

    Journal of Forecasting , volume =

    Functional. Journal of Forecasting , volume =. doi:10.1002/for.1169 , urldate =

  19. [19]

    Efficient

    Ansley, Craig F and Kohn, Robert , year = 2023, abstract =. Efficient

  20. [20]

    and Kohn, Robert , year = 1985, month = dec, journal =

    Ansley, Craig F. and Kohn, Robert , year = 1985, month = dec, journal =. Estimation,. doi:10.1214/aos/1176349739 , urldate =

  21. [21]

    and Buonocore, Michael H

    Antognini, Joseph F. and Buonocore, Michael H. and Disbrow, Elizabeth A. and Carstens, Earl , year = 1997, month = nov, journal =. Isoflurane Anesthesia Blunts Cerebral Responses to Noxious and Innocuous Stimuli: A. doi:10.1016/S0024-3205(97)00960-0 , urldate =

  22. [22]

    and Bieling, Peter J

    Antony, Martin M. and Bieling, Peter J. and Cox, Brian J. and Enns, Murray W. and Swinson, Richard P. , year = 1998, month = jun, journal =. Psychometric. doi:10.1037/1040-3590.10.2.176 , urldate =

  23. [23]

    , year = 2020, month = oct, journal =

    Ariens, Sigert and Ceulemans, Eva and Adolf, Janne K. , year = 2020, month = oct, journal =. Time. doi:10.1016/j.jpsychores.2020.110191 , urldate =

  24. [24]

    Arminger, Gerhard and Muth. A. Psychometrika , volume =. doi:10.1007/BF02294856 , urldate =

  25. [25]

    and Deserno, Marie K

    Armour, Cherie and Fried, Eiko I. and Deserno, Marie K. and Tsai, Jack and Pietrzak, Robert H. , year = 2017, month = jan, journal =. A. doi:10.1016/j.janxdis.2016.11.008 , urldate =

  26. [26]

    Bayesian

    Asparouhov, Tihomir and Muthen, Bengt , year = 2023, month = feb, file =. Bayesian

  27. [27]

    and Muth

    Asparouhov, Tihomir and Hamaker, Ellen L. and Muth. Dynamic. Structural Equation Modeling: A Multidisciplinary Journal , volume =. doi:10.1080/10705511.2017.1406803 , urldate =

  28. [28]

    Aue, Alexander and Norinho, Diogo Dubart and H. On the. Journal of the American Statistical Association , volume =. doi:10.1080/01621459.2014.909317 , urldate =

  29. [29]

    Ecological Monographs , volume =

    A. Ecological Monographs , volume =. doi:10.1002/ecm.1470 , urldate =

  30. [30]

    Literature

    Avery, Matthew , urldate =. Literature

  31. [31]

    Bak, Maarten and Drukker, Marjan and Hasmi, Laila and. An. PLOS ONE , volume =. doi:10.1371/journal.pone.0162811 , urldate =

  32. [32]

    , year = 2023, month = dec, journal =

    Baral, Suryadyuti and Curran, Patrick J. , year = 2023, month = dec, journal =. Dynamic. doi:10.33697/ajur.2023.096 , urldate =

  33. [33]

    Situated

    Barsalou, Lawrence W , year = 2016, month = dec, journal =. Situated. doi:10.1016/j.copsyc.2016.04.009 , urldate =

  34. [34]

    Bartolucci, Francesco and Pennoni, Fulvia and Vittadini, Giorgio , year = 2016, journal =. Causal

  35. [35]

    Approximate

    Batz, Philipp and Ruttor, Andreas and Opper, Manfred , year = 2018, month = aug, journal =. Approximate. doi:10.1103/PhysRevE.98.022109 , urldate =

  36. [36]

    and Preacher, Kristopher J

    Bauer, Daniel J. and Preacher, Kristopher J. and Gil, Karen M. , year = 2006, journal =. Conceptualizing and. doi:10.1037/1082-989X.11.2.142 , urldate =

  37. [37]

    , year = 2018, month = aug, journal =

    Bauldry, Shawn and Bollen, Kenneth A. , year = 2018, month = aug, journal =. Nonlinear. doi:10.1177/0081175018789441 , urldate =

  38. [38]

    and Forgeard, Marie J

    Beard, Courtney and Millner, Alex J. and Forgeard, Marie J. C. and Fried, Eiko I. and Hsu, Kean J. and Treadway, Michael and Leonard, Chelsea V. and Kertz, Sarah and Bj. Network. Psychological medicine , volume =. doi:10.1017/S0033291716002300 , urldate =

  39. [39]

    Betancourt, Michael , year = 2020, month = sep, urldate =. Robust

  40. [40]

    , year = 1994, month = jul, edition =

    Bierens, Herman J. , year = 1994, month = jul, edition =. Topics in. doi:10.1017/CBO9780511599279 , urldate =

  41. [41]

    Billings, S. A. and Lee, K. L. , year = 2004, month = mar, journal =. A. doi:10.1142/S021812740400965X , urldate =

  42. [42]

    Bishop, D. V. M. , year = 2016, month = apr, journal =. Open. doi:10.1098/rsos.160109 , urldate =

  43. [43]

    Blanca, Mar. Non-. Psicothema , number =. doi:10.7334/psicothema2016.383 , urldate =

  44. [44]

    Blight, B. J. N. and Ott, L. , year = 1975, journal =. A. doi:10.1093/biomet/62.1.79 , urldate =

  45. [45]

    Bodin, Erik and Campbell, Neill D. F. and Ek, Carl Henrik , year = 2017, month = sep, number =. Latent

  46. [46]

    , editor =

    Boker, Steven M. , editor =. Dynamical. doi:10.1037/13621-016 , urldate =

  47. [47]

    Intensive

    Bolger, Niall and Laurenceau, Jean-Philippe , year = 2013, series =. Intensive

  48. [48]

    and Curran, Patrick J

    Bollen, Kenneth A. and Curran, Patrick J. , year = 2004, month = feb, journal =. Autoregressive. doi:10.1177/0049124103260222 , urldate =

  49. [49]

    , year = 2012, month = may, journal =

    Bones, Arina K. , year = 2012, month = may, journal =. We. doi:10.1177/1745691612441216 , urldate =

  50. [50]

    Foundations of

    Bongers, Stephan and Forr. Foundations of. The Annals of Statistics , volume =. doi:10.1214/21-AOS2064 , urldate =

  51. [51]

    Bonsall, M. B. and. Nonlinear. Proceedings of the Royal Society B: Biological Sciences , volume =. doi:10.1098/rspb.2011.1246 , urldate =

  52. [52]

    Borsboom, Denny and Cramer, Ang. Network. Annual Review of Clinical Psychology , volume =. doi:10.1146/annurev-clinpsy-050212-185608 , urldate =

  53. [53]

    and Rhemtulla, Mijke and Epskamp, Sacha and Fried, Eiko I

    Borsboom, Denny and Deserno, Marie K. and Rhemtulla, Mijke and Epskamp, Sacha and Fried, Eiko I. and McNally, Richard J. and Robinaugh, Donald J. and Perugini, Marco and Dalege, Jonas and Costantini, Giulio and Isvoranu, Adela-Maria and Wysocki, Anna C. and. Network. Nature Reviews Methods Primers , volume =. doi:10.1038/s43586-021-00055-w , urldate =

  54. [54]

    Psychometric

    Borsboom, Denny , year = 2008, month = sep, journal =. Psychometric. doi:10.1002/jclp.20503 , urldate =

  55. [55]

    Borsboom, Denny and Van Der Maas, Han L. J. and Dalege, Jonas and Kievit, Rogier A. and Haig, Brian D. , year = 2021, month = jul, journal =. Theory. doi:10.1177/1745691620969647 , urldate =

  56. [56]

    and Schreuder, Marieke J

    Bos, Fionneke M. and Schreuder, Marieke J. and George, Sandip V. and Doornbos, Bennard and Bruggeman, Richard and. Anticipating. International Journal of Bipolar Disorders , volume =. doi:10.1186/s40345-022-00258-4 , urldate =

  57. [57]

    and Snippe, Evelien and

    Bos, Fionneke M. and Snippe, Evelien and. Can. Psychotherapy and Psychosomatics , volume =. doi:10.1159/000453583 , urldate =

  58. [58]

    and Wanders, Rob B

    Bos, Elisabeth H. and Wanders, Rob B. K. , year = 2016, month = apr, journal =. Group-. doi:10.1001/jamapsychiatry.2015.3103 , urldate =

  59. [59]

    Bosq, Denis , editor =. Linear. doi:10.1007/978-1-4612-1154-9 , urldate =

  60. [60]

    Adaptively

    Botha, Imke and Kohn, Robert and South, Leah and Drovandi, Christopher , year = 2023, publisher =. Adaptively. doi:10.48550/ARXIV.2307.11553 , urldate =

  61. [61]

    Automatically

    Botha, Imke and Kohn, Robert and South, Leah and Drovandi, Christopher , year = 2022, month = oct, number =. Automatically. doi:10.48550/arXiv.2201.11354 , urldate =

  62. [62]

    Bottegal, Giulio and Pillonetto, Gianluigi , year = 2017, month = jun, number =. The

  63. [63]

    Box, George E. P. and Jenkins, Gwilym M. , year = 1970, publisher =. Time

  64. [64]

    and Xu, Fei , year = 2009, month = apr, journal =

    Boyd, John P. and Xu, Fei , year = 2009, month = apr, journal =. Divergence (. doi:10.1016/j.amc.2008.12.087 , urldate =

  65. [65]

    Braude, Stephen E , year = 2002, publisher =

  66. [66]

    and Pe, Madeline L

    Bringmann, Laura F. and Pe, Madeline L. and Vissers, Nathalie and Ceulemans, Eva and Borsboom, Denny and Vanpaemel, Wolf and Tuerlinckx, Francis and Kuppens, Peter , year = 2016, month = aug, journal =. Assessing. doi:10.1177/1073191116645909 , urldate =

  67. [67]

    and Hamaker, Ellen L

    Bringmann, Laura F. and Hamaker, Ellen L. and Vigo, Daniel E. and Aubert, Andr. Changing. Psychological Methods , volume =. doi:10.1037/met0000085 , urldate =

  68. [68]

    and Eronen, Markus I

    Bringmann, Laura F. and Eronen, Markus I. , year = 2018, month = jul, journal =. Don't. doi:10.1037/rev0000108 , urldate =

  69. [69]

    and Ferrer, Emilio and Hamaker, Ellen L

    Bringmann, Laura F. and Ferrer, Emilio and Hamaker, Ellen L. and Borsboom, Denny and Tuerlinckx, Francis , year = 2015, month = nov, journal =. Modeling. doi:10.1080/00273171.2015.1120182 , urldate =

  70. [70]

    and Vissers, Nathalie and Wichers, Marieke and Geschwind, Nicole and Kuppens, Peter and Peeters, Frenk and Borsboom, Denny and Tuerlinckx, Francis , editor =

    Bringmann, Laura F. and Vissers, Nathalie and Wichers, Marieke and Geschwind, Nicole and Kuppens, Peter and Peeters, Frenk and Borsboom, Denny and Tuerlinckx, Francis , editor =. A. PLoS ONE , volume =. doi:10.1371/journal.pone.0060188 , urldate =

  71. [71]

    , year = 2015, series =

    Brown, Timothy A. , year = 2015, series =. Confirmatory

  72. [72]

    and Chorpita, Bruce F

    Brown, Timothy A. and Chorpita, Bruce F. and Korotitsch, William and Barlow, David H. , year = 1997, month = jan, journal =. Psychometric. doi:10.1016/S0005-7967(96)00068-X , urldate =

  73. [73]

    Adaptive

    Buchholz, Alexander and Chopin, Nicolas and Jacob, Pierre E , abstract =. Adaptive

  74. [74]

    Bunde, Armin , year = 2023, month = nov, journal =. The. doi:10.1002/cite.202300031 , urldate =

  75. [75]

    and Bunke, O

    Bunke, H. and Bunke, O. , year = 1974, month = jan, journal =. Identifiability and. doi:10.1080/02331887408801160 , urldate =

  76. [76]

    and Robinaugh, Donald J

    Burger, Julian and Van Der Veen, Date C. and Robinaugh, Donald J. and Quax, Rick and Riese, Harri. Bridging the. BMC Medicine , volume =. doi:10.1186/s12916-020-01558-1 , urldate =

  77. [77]

    B. Brms:. Journal of Statistical Software , volume =

  78. [78]

    and Ioannidis, John P

    Button, Katherine S. and Ioannidis, John P. A. and Mokrysz, Claire and Nosek, Brian A. and Flint, Jonathan and Robinson, Emma S. J. and Munaf. Power. Nature Reviews Neuroscience , volume =. doi:10.1038/nrn3475 , urldate =

  79. [79]

    and Farrell, Max H

    Calonico, Sebastian and Cattaneo, Matias D. and Farrell, Max H. , year = 2018, publisher =. Coverage. doi:10.48550/ARXIV.1808.01398 , urldate =

  80. [80]

    and Dreber, Anna and Holzmeister, Felix and Ho, Teck-Hua and Huber, J

    Camerer, Colin F. and Dreber, Anna and Holzmeister, Felix and Ho, Teck-Hua and Huber, J. Evaluating the. Nature Human Behaviour , volume =. doi:10.1038/s41562-018-0399-z , urldate =

Showing first 80 references.