Learning Nonlinear Dynamics: Improving the Estimation Efficiency and Reliability of Gaussian Process State-Space Models
Pith reviewed 2026-06-25 21:44 UTC · model grok-4.3
The pith
Modifications to a Gibbs sampler and use of confirmatory factor analysis make Gaussian process state-space models easier to estimate for nonlinear dynamics.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that two modifications to an existing Gibbs sampler for approximate Gaussian process state-space models considerably improve its sampling efficiency and convergence, while a confirmatory factor analysis measurement model reduces identifiability issues. The sampler was validated using simulation-based calibration, showing reliable convergence across many simulated data sets and well-calibrated posterior inferences. A systematically validated software implementation is provided to facilitate use in empirical research.
What carries the argument
Modified Gibbs sampler for Gaussian process state-space models with confirmatory factor analysis measurement model.
If this is right
- The sampler converges reliably across many simulated data sets.
- It produces well-calibrated posterior inferences.
- The approach allows researchers to impose a specific measurement structure on the model.
- Empirical examples demonstrate how the model can be applied and interpreted.
Where Pith is reading between the lines
- These sampler changes might extend to other types of state-space models beyond Gaussian processes.
- The confirmatory factor analysis component could help in domains where measurement models are important, such as psychology.
- Providing open software lowers the barrier for applied researchers to use these models.
Load-bearing premise
The two modifications to the Gibbs sampler preserve the target posterior distribution while only improving mixing and computational speed.
What would settle it
Running the original and modified samplers on identical simulated data and finding that the posteriors differ in a way that cannot be explained by sampling error.
read the original abstract
Understanding dynamic systems is a central goal in many scientific disciplines. State-space models provide a general framework for studying latent dynamic systems based on indirect observations. However, classical state-space methods require researchers to specify the parametric form of the system dynamics in advance, which can be challenging when the underlying processes are nonlinear and only partially explained by theory. Gaussian process state-space models address this by learning the system dynamics directly from data. However, estimating these models exactly can become computationally infeasible for moderately long time-series. In this paper, we therefore aim to improve the Bayesian estimation of approximate Gaussian process state-space models to make these models more accessible and facilitate the statistical learning of nonlinear dynamic systems in empirical research. To this end, we first propose two modifications to an existing Gibbs sampler for these models that considerably improve its sampling efficiency and convergence. Second, we use a confirmatory factor analysis measurement model, which reduces identifiability issues and allows researchers to impose a specific measurement structure on the model. Third, we provide a systematically validated software implementation of the model and sampler for applied use in empirical research. To validate the sampler, we conducted a simulation-based calibration which showed that the sampler converged reliably across many simulated data sets and produces well-calibrated posterior inferences. We further illustrate how the model can be applied and interpreted using two empirical examples. Together, these contributions provide a practical and validated workflow for learning nonlinear latent dynamics with Gaussian process state-space models.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript claims that two modifications to an existing Gibbs sampler for approximate Gaussian process state-space models (GPSSMs) considerably improve sampling efficiency and convergence while preserving correctness; that a confirmatory factor analysis (CFA) measurement model reduces identifiability issues and permits imposition of specific measurement structures; that a systematically validated software implementation is provided; and that simulation-based calibration (SBC) across many simulated datasets confirms reliable convergence and well-calibrated posterior inferences. The approach is illustrated with two empirical examples.
Significance. If the sampler modifications preserve the target distribution and the SBC results hold, the work supplies a practical, validated workflow for Bayesian learning of nonlinear latent dynamics from indirect observations. This addresses a key computational barrier for moderately long time series and identifiability problems that have limited applied use of GPSSMs. Explicit credit is due for the SBC validation across many datasets and the provision of reproducible software, both of which directly support reliability claims.
minor comments (3)
- [Abstract] Abstract: the phrase 'considerably improve its sampling efficiency and convergence' would be strengthened by a brief quantitative statement (e.g., median ESS ratio or Gelman-Rubin statistic reduction) even if space is limited.
- [Sampler modifications section] The manuscript should explicitly state, in the sampler section, that the two modifications leave the target posterior invariant (or provide the short invariance argument), as this underpins the reliability claim validated by SBC.
- [Empirical examples] Figure captions for the empirical examples should include the exact hyperparameter settings and data preprocessing steps used, to aid reproducibility.
Simulated Author's Rebuttal
We thank the referee for the positive and constructive review, which accurately summarizes the manuscript's contributions and correctly identifies the value of the SBC validation and reproducible software. The recommendation for minor revision is noted; however, no specific major comments were provided in the report.
Circularity Check
No significant circularity
full rationale
The paper proposes two modifications to an existing Gibbs sampler for approximate GP state-space models, adopts a CFA measurement model to address identifiability, and validates the resulting sampler via simulation-based calibration across many simulated datasets that confirm convergence and calibration. No equations, predictions, or central claims reduce by construction to fitted inputs or self-citations; the validation pipeline is external (SBC) and the modifications are presented as improvements whose correctness is checked rather than assumed by definition. The derivation chain is therefore self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
2025 , url =
R: A Language and Environment for Statistical Computing , author =. 2025 , url =
2025
-
[2]
2023 , journal =
Simulation-based calibration checking for Bayesian computation: The choice of test quantities shapes sensitivity , author =. 2023 , journal =
2023
-
[3]
Journal of Statistical Software , year =
Dirk Eddelbuettel and Romain Fran. Journal of Statistical Software , year =
-
[4]
Aarts, Emmeke and Haslbeck, Jonas M. B. , year = 2024, month = nov, doi =. Modelling
2024
-
[5]
Abarbanel, H. D. I. , year = 2022, publisher =. The. doi:10.1017/9781009024846 , abstract =
-
[6]
and Worden, Keith , year = 2017, month = aug, journal =
Abdessalem, Anis Ben and Dervilis, Nikolaos and Wagg, David J. and Worden, Keith , year = 2017, month = aug, journal =. Automatic. doi:10.3389/fbuil.2017.00052 , urldate =
-
[7]
Aczel, Balazs and Szaszi, Barnabas and Sarafoglou, Alexandra and Kekecs, Zoltan and Kucharsk. A. Nature Human Behaviour , volume =. doi:10.1038/s41562-019-0772-6 , urldate =
-
[8]
Measurement
Adolf, Janne and Schuurman, No. Measurement. Frontiers in Psychology , volume =
-
[9]
Albert, Jeffrey M. and Nelson, Suchitra , year = 2011, month = sep, journal =. Generalized. doi:10.1111/j.1541-0420.2010.01547.x , urldate =
-
[10]
Alogna, V. K. and Attaya, M. K. and Aucoin, P. and Bahn. Registered. Perspectives on Psychological Science , volume =. doi:10.1177/1745691614545653 , urldate =
-
[11]
Public. PLoS ONE , volume =. doi:10.1371/journal.pone.0024357 , urldate =
-
[12]
The Curse(s) of Dimensionality , author =. Nature Methods , volume =. doi:10.1038/s41592-018-0019-x , urldate =
-
[13]
Kernels for Vector-Valued Functions: a Review
Alvarez, Mauricio A. and Rosasco, Lorenzo and Lawrence, Neil D. , year = 2012, month = apr, number =. Kernels for. doi:10.48550/arXiv.1106.6251 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1106.6251 2012
-
[14]
Proceedings of the
Latent. Proceedings of the
-
[15]
, year = 2017, month = may, journal =
Aminikhanghahi, Samaneh and Cook, Diane J. , year = 2017, month = may, journal =. A. doi:10.1007/s10115-016-0987-z , urldate =
-
[16]
Anderson, Christopher J. and Bahn. Response to. Science , volume =. doi:10.1126/science.aad9163 , urldate =
-
[17]
Andrieu, Christophe and Doucet, Arnaud and Holenstein, Roman , year = 2010, month = jun, journal =. Particle. doi:10.1111/j.1467-9868.2009.00736.x , urldate =
-
[18]
Journal of Forecasting , volume =
Functional. Journal of Forecasting , volume =. doi:10.1002/for.1169 , urldate =
-
[19]
Efficient
Ansley, Craig F and Kohn, Robert , year = 2023, abstract =. Efficient
2023
-
[20]
and Kohn, Robert , year = 1985, month = dec, journal =
Ansley, Craig F. and Kohn, Robert , year = 1985, month = dec, journal =. Estimation,. doi:10.1214/aos/1176349739 , urldate =
-
[21]
Antognini, Joseph F. and Buonocore, Michael H. and Disbrow, Elizabeth A. and Carstens, Earl , year = 1997, month = nov, journal =. Isoflurane Anesthesia Blunts Cerebral Responses to Noxious and Innocuous Stimuli: A. doi:10.1016/S0024-3205(97)00960-0 , urldate =
-
[22]
Antony, Martin M. and Bieling, Peter J. and Cox, Brian J. and Enns, Murray W. and Swinson, Richard P. , year = 1998, month = jun, journal =. Psychometric. doi:10.1037/1040-3590.10.2.176 , urldate =
-
[23]
, year = 2020, month = oct, journal =
Ariens, Sigert and Ceulemans, Eva and Adolf, Janne K. , year = 2020, month = oct, journal =. Time. doi:10.1016/j.jpsychores.2020.110191 , urldate =
-
[24]
Arminger, Gerhard and Muth. A. Psychometrika , volume =. doi:10.1007/BF02294856 , urldate =
-
[25]
Armour, Cherie and Fried, Eiko I. and Deserno, Marie K. and Tsai, Jack and Pietrzak, Robert H. , year = 2017, month = jan, journal =. A. doi:10.1016/j.janxdis.2016.11.008 , urldate =
-
[26]
Bayesian
Asparouhov, Tihomir and Muthen, Bengt , year = 2023, month = feb, file =. Bayesian
2023
-
[27]
Asparouhov, Tihomir and Hamaker, Ellen L. and Muth. Dynamic. Structural Equation Modeling: A Multidisciplinary Journal , volume =. doi:10.1080/10705511.2017.1406803 , urldate =
-
[28]
Aue, Alexander and Norinho, Diogo Dubart and H. On the. Journal of the American Statistical Association , volume =. doi:10.1080/01621459.2014.909317 , urldate =
-
[29]
Ecological Monographs , volume =
A. Ecological Monographs , volume =. doi:10.1002/ecm.1470 , urldate =
-
[30]
Literature
Avery, Matthew , urldate =. Literature
-
[31]
Bak, Maarten and Drukker, Marjan and Hasmi, Laila and. An. PLOS ONE , volume =. doi:10.1371/journal.pone.0162811 , urldate =
-
[32]
, year = 2023, month = dec, journal =
Baral, Suryadyuti and Curran, Patrick J. , year = 2023, month = dec, journal =. Dynamic. doi:10.33697/ajur.2023.096 , urldate =
-
[33]
Barsalou, Lawrence W , year = 2016, month = dec, journal =. Situated. doi:10.1016/j.copsyc.2016.04.009 , urldate =
-
[34]
Bartolucci, Francesco and Pennoni, Fulvia and Vittadini, Giorgio , year = 2016, journal =. Causal
2016
-
[35]
Batz, Philipp and Ruttor, Andreas and Opper, Manfred , year = 2018, month = aug, journal =. Approximate. doi:10.1103/PhysRevE.98.022109 , urldate =
-
[36]
Bauer, Daniel J. and Preacher, Kristopher J. and Gil, Karen M. , year = 2006, journal =. Conceptualizing and. doi:10.1037/1082-989X.11.2.142 , urldate =
-
[37]
, year = 2018, month = aug, journal =
Bauldry, Shawn and Bollen, Kenneth A. , year = 2018, month = aug, journal =. Nonlinear. doi:10.1177/0081175018789441 , urldate =
-
[38]
Beard, Courtney and Millner, Alex J. and Forgeard, Marie J. C. and Fried, Eiko I. and Hsu, Kean J. and Treadway, Michael and Leonard, Chelsea V. and Kertz, Sarah and Bj. Network. Psychological medicine , volume =. doi:10.1017/S0033291716002300 , urldate =
-
[39]
Betancourt, Michael , year = 2020, month = sep, urldate =. Robust
2020
-
[40]
, year = 1994, month = jul, edition =
Bierens, Herman J. , year = 1994, month = jul, edition =. Topics in. doi:10.1017/CBO9780511599279 , urldate =
-
[41]
Billings, S. A. and Lee, K. L. , year = 2004, month = mar, journal =. A. doi:10.1142/S021812740400965X , urldate =
-
[42]
Bishop, D. V. M. , year = 2016, month = apr, journal =. Open. doi:10.1098/rsos.160109 , urldate =
-
[43]
Blanca, Mar. Non-. Psicothema , number =. doi:10.7334/psicothema2016.383 , urldate =
-
[44]
Blight, B. J. N. and Ott, L. , year = 1975, journal =. A. doi:10.1093/biomet/62.1.79 , urldate =
-
[45]
Bodin, Erik and Campbell, Neill D. F. and Ek, Carl Henrik , year = 2017, month = sep, number =. Latent
2017
-
[46]
Boker, Steven M. , editor =. Dynamical. doi:10.1037/13621-016 , urldate =
-
[47]
Intensive
Bolger, Niall and Laurenceau, Jean-Philippe , year = 2013, series =. Intensive
2013
-
[48]
Bollen, Kenneth A. and Curran, Patrick J. , year = 2004, month = feb, journal =. Autoregressive. doi:10.1177/0049124103260222 , urldate =
-
[49]
, year = 2012, month = may, journal =
Bones, Arina K. , year = 2012, month = may, journal =. We. doi:10.1177/1745691612441216 , urldate =
-
[50]
Bongers, Stephan and Forr. Foundations of. The Annals of Statistics , volume =. doi:10.1214/21-AOS2064 , urldate =
-
[51]
Bonsall, M. B. and. Nonlinear. Proceedings of the Royal Society B: Biological Sciences , volume =. doi:10.1098/rspb.2011.1246 , urldate =
-
[52]
Borsboom, Denny and Cramer, Ang. Network. Annual Review of Clinical Psychology , volume =. doi:10.1146/annurev-clinpsy-050212-185608 , urldate =
-
[53]
and Rhemtulla, Mijke and Epskamp, Sacha and Fried, Eiko I
Borsboom, Denny and Deserno, Marie K. and Rhemtulla, Mijke and Epskamp, Sacha and Fried, Eiko I. and McNally, Richard J. and Robinaugh, Donald J. and Perugini, Marco and Dalege, Jonas and Costantini, Giulio and Isvoranu, Adela-Maria and Wysocki, Anna C. and. Network. Nature Reviews Methods Primers , volume =. doi:10.1038/s43586-021-00055-w , urldate =
-
[54]
Borsboom, Denny , year = 2008, month = sep, journal =. Psychometric. doi:10.1002/jclp.20503 , urldate =
-
[55]
Borsboom, Denny and Van Der Maas, Han L. J. and Dalege, Jonas and Kievit, Rogier A. and Haig, Brian D. , year = 2021, month = jul, journal =. Theory. doi:10.1177/1745691620969647 , urldate =
-
[56]
Bos, Fionneke M. and Schreuder, Marieke J. and George, Sandip V. and Doornbos, Bennard and Bruggeman, Richard and. Anticipating. International Journal of Bipolar Disorders , volume =. doi:10.1186/s40345-022-00258-4 , urldate =
-
[57]
Bos, Fionneke M. and Snippe, Evelien and. Can. Psychotherapy and Psychosomatics , volume =. doi:10.1159/000453583 , urldate =
-
[58]
Bos, Elisabeth H. and Wanders, Rob B. K. , year = 2016, month = apr, journal =. Group-. doi:10.1001/jamapsychiatry.2015.3103 , urldate =
-
[59]
Bosq, Denis , editor =. Linear. doi:10.1007/978-1-4612-1154-9 , urldate =
-
[60]
Botha, Imke and Kohn, Robert and South, Leah and Drovandi, Christopher , year = 2023, publisher =. Adaptively. doi:10.48550/ARXIV.2307.11553 , urldate =
-
[61]
Botha, Imke and Kohn, Robert and South, Leah and Drovandi, Christopher , year = 2022, month = oct, number =. Automatically. doi:10.48550/arXiv.2201.11354 , urldate =
-
[62]
Bottegal, Giulio and Pillonetto, Gianluigi , year = 2017, month = jun, number =. The
2017
-
[63]
Box, George E. P. and Jenkins, Gwilym M. , year = 1970, publisher =. Time
1970
-
[64]
and Xu, Fei , year = 2009, month = apr, journal =
Boyd, John P. and Xu, Fei , year = 2009, month = apr, journal =. Divergence (. doi:10.1016/j.amc.2008.12.087 , urldate =
-
[65]
Braude, Stephen E , year = 2002, publisher =
2002
-
[66]
Bringmann, Laura F. and Pe, Madeline L. and Vissers, Nathalie and Ceulemans, Eva and Borsboom, Denny and Vanpaemel, Wolf and Tuerlinckx, Francis and Kuppens, Peter , year = 2016, month = aug, journal =. Assessing. doi:10.1177/1073191116645909 , urldate =
-
[67]
Bringmann, Laura F. and Hamaker, Ellen L. and Vigo, Daniel E. and Aubert, Andr. Changing. Psychological Methods , volume =. doi:10.1037/met0000085 , urldate =
-
[68]
Bringmann, Laura F. and Eronen, Markus I. , year = 2018, month = jul, journal =. Don't. doi:10.1037/rev0000108 , urldate =
-
[69]
and Ferrer, Emilio and Hamaker, Ellen L
Bringmann, Laura F. and Ferrer, Emilio and Hamaker, Ellen L. and Borsboom, Denny and Tuerlinckx, Francis , year = 2015, month = nov, journal =. Modeling. doi:10.1080/00273171.2015.1120182 , urldate =
-
[70]
Bringmann, Laura F. and Vissers, Nathalie and Wichers, Marieke and Geschwind, Nicole and Kuppens, Peter and Peeters, Frenk and Borsboom, Denny and Tuerlinckx, Francis , editor =. A. PLoS ONE , volume =. doi:10.1371/journal.pone.0060188 , urldate =
-
[71]
, year = 2015, series =
Brown, Timothy A. , year = 2015, series =. Confirmatory
2015
-
[72]
Brown, Timothy A. and Chorpita, Bruce F. and Korotitsch, William and Barlow, David H. , year = 1997, month = jan, journal =. Psychometric. doi:10.1016/S0005-7967(96)00068-X , urldate =
-
[73]
Adaptive
Buchholz, Alexander and Chopin, Nicolas and Jacob, Pierre E , abstract =. Adaptive
-
[74]
Bunde, Armin , year = 2023, month = nov, journal =. The. doi:10.1002/cite.202300031 , urldate =
-
[75]
Bunke, H. and Bunke, O. , year = 1974, month = jan, journal =. Identifiability and. doi:10.1080/02331887408801160 , urldate =
-
[76]
Burger, Julian and Van Der Veen, Date C. and Robinaugh, Donald J. and Quax, Rick and Riese, Harri. Bridging the. BMC Medicine , volume =. doi:10.1186/s12916-020-01558-1 , urldate =
-
[77]
B. Brms:. Journal of Statistical Software , volume =
-
[78]
Button, Katherine S. and Ioannidis, John P. A. and Mokrysz, Claire and Nosek, Brian A. and Flint, Jonathan and Robinson, Emma S. J. and Munaf. Power. Nature Reviews Neuroscience , volume =. doi:10.1038/nrn3475 , urldate =
-
[79]
Calonico, Sebastian and Cattaneo, Matias D. and Farrell, Max H. , year = 2018, publisher =. Coverage. doi:10.48550/ARXIV.1808.01398 , urldate =
-
[80]
and Dreber, Anna and Holzmeister, Felix and Ho, Teck-Hua and Huber, J
Camerer, Colin F. and Dreber, Anna and Holzmeister, Felix and Ho, Teck-Hua and Huber, J. Evaluating the. Nature Human Behaviour , volume =. doi:10.1038/s41562-018-0399-z , urldate =
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.