Robust ensemble Kalman filtering under observation noise misspecification via diffusion score matching
Pith reviewed 2026-07-01 16:12 UTC · model grok-4.3
The pith
Diffusion score matching in the analysis step yields a robust Kalman filter that preserves uncertainty quantification under noise misspecification.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The diffusion score matching Kalman filter adjusts information processing in the analysis step by employing diffusion score matching for inference to obtain robustness while maintaining well-quantified uncertainties. In linear Gaussian state space systems it exhibits conjugacy and closed-form parameter updates, robustness, covariance stability, and high-dimensional consistency. Ensemble approximations are derived via stochastic and deterministic coupling as well as implementing localization to obtain EnKF, ESRF and LETKF varieties. The method is evaluated in simulation studies on target-tracking, the chaotic Lorenz 63 system and the Lorenz 96 system in 40 dimensions.
What carries the argument
Diffusion score matching applied to inference in the analysis step of the Kalman filter, enabling generalized Bayesian updates that are robust to observation noise misspecification.
If this is right
- The filter remains conjugate with closed-form updates in linear Gaussian state space systems.
- Covariance stability and high-dimensional consistency hold under the stated conditions.
- Stochastic and deterministic ensemble couplings with localization yield practical EnKF, ESRF and LETKF implementations.
- The approach improves assimilation when dynamics are nonlinear and observation noise may be non-Gaussian.
Where Pith is reading between the lines
- The identified robustness-stability trade-off could guide design of other generalized Bayesian filters beyond the Kalman setting.
- The method may be combined with existing localization or inflation techniques to handle even higher-dimensional or more severely misspecified cases.
- Testing on systems with explicitly heavier-tailed observation noise would directly probe the claimed robustness gains.
Load-bearing premise
That diffusion score matching can be used in the analysis step to navigate the robustness-stability trade-off without destabilizing the filter in challenging non-linear dynamics with non-Gaussian noise.
What would settle it
In the 40-dimensional Lorenz 96 simulation, an instance where the diffusion score matching Kalman filter produces ensemble covariances that fail to cover the true state trajectory or where the filter diverges when observation outliers are present.
Figures
read the original abstract
We address the problem of observation noise misspecification in Bayesian filtering of dynamical systems via recent advances in generalised Bayesian inference. Mis-match in tail decay between the true data generating process and an assumed observation model, often showing via frequent outliers, can strongly impact Bayesian updates and analysis in Kalman filtering. Existing approaches often employ detect-and-delete-schemes or covariance inflation to avoid assimilation of influential instances of mis-specification. In challenging settings where the analysis updates are barely sufficient to counteract the induced forecast uncertainty, these strategies may destabilize or struggle to provide reliable uncertainty quantification. We consider a novel Kalman filter adjusting information processing in the analysis step by employing diffusion score matching for inference to obtain robustness while maintaining well-quantified uncertainties. We provide theoretical properties of the diffusion score matching Kalman filter in linear Gaussian state space systems covering conjugacy and closed form parameter update in the analysis step, robustness, covariance stability, and tuning as well as high-dimensional consistency. We derive ensemble approximations via stochastic and deterministic coupling as well as implementing localization to obtain EnKF, ESRF and LETKF varieties. We evaluate the methods in appropriate simulation studies on target-tracking, the chaotic Lorenz 63 system and the Lorenz 96 system in 40 dimensions. Our insights highlight a critical trade-off between robustness and stability in Bayesian filtering. Methods employing generalized Bayesian inference can navigate this balance and improve data assimilation in challenging environments combining non-linear dynamics and potentially non-Gaussian observation noise.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces a diffusion score matching Kalman filter to achieve robustness against observation noise misspecification in ensemble Kalman filtering. It establishes theoretical properties (conjugacy, closed-form updates, robustness, covariance stability, and high-dimensional consistency) for linear Gaussian state-space systems, derives ensemble approximations (EnKF, ESRF, LETKF) with localization, and evaluates performance via simulations on target tracking and the chaotic Lorenz-63/96 systems.
Significance. If the central claims hold, the work provides a new mechanism for balancing robustness and uncertainty quantification in data assimilation under misspecification, extending generalized Bayesian ideas to ensemble filters with explicit linear-Gaussian theory and practical ensemble implementations. This could be relevant for applications involving outliers or non-Gaussian noise in high-dimensional dynamical systems.
major comments (2)
- [Abstract, §3] Abstract and §3 (theoretical properties): All stated guarantees (conjugacy, closed-form parameter updates, robustness, covariance stability, high-dimensional consistency) are derived exclusively for linear Gaussian state-space systems. The abstract and introduction claim the method 'navigates this balance' in 'challenging environments combining non-linear dynamics and potentially non-Gaussian observation noise,' but no extension of the proofs or stability analysis to the non-linear regime is indicated; the non-linear claims therefore rest entirely on the ensemble simulation results in §5.
- [§5] §5 (simulation studies): The Lorenz-63 and Lorenz-96 experiments (non-linear dynamics) report improved robustness relative to standard EnKF/ESRF/LETKF, but the manuscript provides no diagnostic (e.g., posterior coverage, filter divergence rates, or bias-variance decomposition) that would confirm the advertised 'well-quantified uncertainties' are preserved when the linear-Gaussian conjugacy no longer holds. This is load-bearing for the central trade-off claim.
minor comments (2)
- [§2, §3] Notation for the diffusion score-matching objective and its relation to the analysis-step likelihood should be introduced earlier and used consistently across the linear theory and ensemble sections.
- [§3] The high-dimensional consistency result would benefit from an explicit statement of the scaling regime (e.g., dimension vs. ensemble size) under which the result holds.
Simulated Author's Rebuttal
We thank the referee for the careful reading and constructive comments on our manuscript. We address each major comment below and outline the corresponding revisions.
read point-by-point responses
-
Referee: [Abstract, §3] Abstract and §3 (theoretical properties): All stated guarantees (conjugacy, closed-form parameter updates, robustness, covariance stability, high-dimensional consistency) are derived exclusively for linear Gaussian state-space systems. The abstract and introduction claim the method 'navigates this balance' in 'challenging environments combining non-linear dynamics and potentially non-Gaussian observation noise,' but no extension of the proofs or stability analysis to the non-linear regime is indicated; the non-linear claims therefore rest entirely on the ensemble simulation results in §5.
Authors: We agree that the theoretical results (conjugacy, closed-form updates, robustness, covariance stability, and high-dimensional consistency) are derived exclusively under the linear-Gaussian assumption in §3. The abstract and introduction statements regarding non-linear dynamics and non-Gaussian noise are supported only by the empirical results in §5. We will revise the abstract and the relevant paragraphs in the introduction to explicitly separate the linear-Gaussian theory from the simulation-based evidence for non-linear systems. revision: yes
-
Referee: [§5] §5 (simulation studies): The Lorenz-63 and Lorenz-96 experiments (non-linear dynamics) report improved robustness relative to standard EnKF/ESRF/LETKF, but the manuscript provides no diagnostic (e.g., posterior coverage, filter divergence rates, or bias-variance decomposition) that would confirm the advertised 'well-quantified uncertainties' are preserved when the linear-Gaussian conjugacy no longer holds. This is load-bearing for the central trade-off claim.
Authors: The referee is correct that §5 does not include explicit diagnostics such as posterior coverage, divergence rates, or bias-variance decompositions for the non-linear cases. The reported improvements are based on RMSE and stability metrics. We will add posterior coverage checks (via rank histograms) and divergence-rate statistics to the revised §5 to provide direct support for the uncertainty-quantification claims under non-linear dynamics. revision: yes
Circularity Check
No circularity in derivation chain
full rationale
The paper introduces diffusion score matching into the Kalman analysis step as a novel adjustment for robustness under noise misspecification. Theoretical properties (conjugacy, closed-form updates, robustness, covariance stability, high-dimensional consistency) are stated to be derived specifically for linear-Gaussian state-space systems, while non-linear cases (Lorenz-63/96) are evaluated via ensemble simulations. No equations or steps are shown that reduce a claimed result to a fitted parameter or self-citation by construction; the central claims rest on explicit derivations and external simulation benchmarks rather than tautological re-labeling of inputs. This is the common honest case of a self-contained methodological contribution.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
Nihal Yatawara, Bovas Abraham, and John F MacGregor. A Kalman filter in the presence of outliers.Communi- cations in Statistics-Theory and Methods, 20(5-6):1803–1820, 1991
work page 1991
-
[2]
Robust Kalman filtering for uncertain systems.Systems & Control Letters, 22(2):123–129, 1994
Lihua Xie and Yeng Chai Soh. Robust Kalman filtering for uncertain systems.Systems & Control Letters, 22(2):123–129, 1994
work page 1994
-
[3]
Ayman Boustati, Omer Deniz Akyildiz, Theodoros Damoulas, and Adam Johansen. Generalised Bayesian filtering via sequential Monte Carlo.Advances in Neural Information Processing Systems, 33:418–429, 2020
work page 2020
-
[4]
Outlier-robust Kalman filtering through generalised Bayes.arXiv preprint arXiv:2405.05646, 2024
Gerardo Duran-Martin, Matias Altamirano, Alexander Y Shestopaloff, Leandro Sánchez-Betancourt, Jeremias Knoblauch, Matt Jones, François-Xavier Briol, and Kevin Murphy. Outlier-robust Kalman filtering through generalised Bayes.arXiv preprint arXiv:2405.05646, 2024
-
[5]
Fabián González, O Deniz Akyildiz, Dan Crisan, and Joaquín Míguez. Nudging state-space models for Bayesian filtering under misspecified dynamics.Statistics and Computing, 35(4):112, 2025
work page 2025
-
[6]
Jeremias Knoblauch, Jack Jewson, and Theodoros Damoulas. Generalized variational inference: Three arguments for deriving new posteriors.arXiv preprint arXiv:1904.02063, 2019
-
[7]
Jeremias Knoblauch, Jack Jewson, and Theodoros Damoulas. An optimization-centric view on Bayes’ rule: Reviewing and generalizing variational inference.Journal of Machine Learning Research, 23(132):1–109, 2022
work page 2022
-
[8]
David A McAllester. Some PAC-Bayesian theorems. InProceedings of the eleventh annual Conference on Computational Learning Theory, pages 230–234, 1998
work page 1998
-
[9]
Abhik Ghosh and Ayanendranath Basu. Robust Bayes estimation using the density power divergence.Annals of the Institute of Statistical Mathematics, 68:413–437, 2016
work page 2016
-
[10]
Pier Giovanni Bissiri, Chris C Holmes, and Stephen G Walker. A general framework for updating belief distributions.Journal of the Royal Statistical Society Series B: Statistical Methodology, 78(5):1103–1130, 2016
work page 2016
-
[11]
Principles of Bayesian inference using general divergence criteria
Jack Jewson, Jim Q Smith, and Chris Holmes. Principles of Bayesian inference using general divergence criteria. Entropy, 20(6):442, 2018
work page 2018
-
[12]
Hans Reimann. Towards robust inference for Bayesian filtering of linear Gaussian dynamical systems subject to additive change. Master’s thesis, Universität Potsdam, 2024
work page 2024
-
[13]
Minimum Stein discrepancy estimators.Advances in Neural Information Processing Systems, 32, 2019
Alessandro Barp, François-Xavier Briol, Andrew Duncan, Mark Girolami, and Lester Mackey. Minimum Stein discrepancy estimators.Advances in Neural Information Processing Systems, 32, 2019
work page 2019
-
[14]
Robust and scalable Bayesian online changepoint detection.arXiv preprint arXiv:2302.04759, 2023
Matias Altamirano, François-Xavier Briol, and Jeremias Knoblauch. Robust and scalable Bayesian online changepoint detection.arXiv preprint arXiv:2302.04759, 2023
-
[15]
Robust and conjugate Gaussian process regression.arXiv preprint arXiv:2311.00463, 2023
Matias Altamirano, François-Xavier Briol, and Jeremias Knoblauch. Robust and conjugate Gaussian process regression.arXiv preprint arXiv:2311.00463, 2023
-
[16]
Mathieu Le Provost, Ricardo Baptista, Jeff D Eldredge, and Youssef Marzouk. An adaptive ensemble filter for heavy-tailed distributions: tuning-free inflation and localization.arXiv preprint arXiv:2310.08741, 2023
-
[17]
Huchuan Tang, Hongyu Han, Sheng Zhang, and Wenting Feng. A generalized t-distribution-based kernel adaptive filtering algorithm.IEEE Transactions on Circuits and Systems II: Express Briefs, 2024
work page 2024
-
[18]
Cambridge University Press, 2015
Sebastian Reich and Colin Cotter.Probabilistic forecasting and Bayesian data assimilation. Cambridge University Press, 2015
work page 2015
-
[19]
Optimal information processing and Bayes’s theorem.The American Statistician, 42(4):278–280, 1988
Arnold Zellner. Optimal information processing and Bayes’s theorem.The American Statistician, 42(4):278–280, 1988
work page 1988
-
[20]
Solomon Kullback.Information theory and statistics. Courier Corporation, 1997
work page 1997
-
[21]
Peter J Huber.Robust statistics, volume 523. John Wiley & Sons, 2004
work page 2004
-
[22]
Prasanta Chandra Mahalanobis. On the generalized distance in statistics.Sankhy ¯a: The Indian Journal of Statistics, Series A (2008-), 80:S1–S7, 2018. 35 Robust EnKF
work page 2008
-
[23]
Takuo Matsubara, Jeremias Knoblauch, François-Xavier Briol, and Chris J Oates. Robust generalised Bayesian inference for intractable likelihoods.Journal of the Royal Statistical Society Series B: Statistical Methodology, 84(3):997–1022, 2022
work page 2022
-
[24]
Stability of the Kalman filter with stochastic time-varying parameters
Victor Solo. Stability of the Kalman filter with stochastic time-varying parameters. InProceedings of 35th IEEE Conference on Decision and Control, volume 1, pages 57–61. IEEE, 1996
work page 1996
-
[25]
Xiang Gao, Meera Sitharam, and Adrian E Roitberg. Bounds on the Jensen gap, and implications for mean- concentrated distributions.arXiv preprint arXiv:1712.05267, 2017
-
[26]
Cambridge University Press, 2023
Simo Särkkä and Lennart Svensson.Bayesian filtering and smoothing, volume 17. Cambridge University Press, 2023
work page 2023
-
[27]
Genshiro Kitagawa. Non-Gaussian state-space modeling of nonstationary time series.Journal of the American Statistical Association, 82(400):1032–1041, 1987
work page 1987
-
[28]
Brian R Hunt, Eric J Kostelich, and Istvan Szunyogh. Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter.Physica D: Nonlinear Phenomena, 230(1-2):112–126, 2007
work page 2007
-
[29]
Sebastian Reich. A nonparametric ensemble transform method for Bayesian inference.SIAM Journal on Scientific Computing, 35(4):A2013–A2024, 2013
work page 2013
-
[30]
Sabir Umarov and Constantino Tsallis.Mathematical Foundations of Nonextensive Statistical Mechanics. World Scientific, 2022
work page 2022
-
[31]
Edward N. Lorenz. Deterministic nonperiodic flow.Journal of Atmospheric Sciences, 20(2):130–141, 1963
work page 1963
-
[32]
Qiwen Sun, Takemasa Miyoshi, and Serge Richard. Control simulation experiments of extreme events with the Lorenz-96 model.Nonlinear Processes in Geophysics Discussions, 2022:1–18, 2022
work page 2022
-
[33]
Predictability: A problem partly solved
Edward N Lorenz. Predictability: A problem partly solved. InProceedings of the Seminar on Predictability, volume 1, pages 1–18. Reading, 1996
work page 1996
-
[34]
On Huber’s contaminated model.Journal of Complexity, 77:101745, 2023
Weiyan Mu and Shifeng Xiong. On Huber’s contaminated model.Journal of Complexity, 77:101745, 2023
work page 2023
-
[35]
Kota Takeda and Takashi Sakajo. Uniform error bounds of the ensemble transform Kalman filter for chaotic dynamics with multiplicative covariance inflation.SIAM/ASA Journal on Uncertainty Quantification, 12(4):1315– 1335, 2024
work page 2024
-
[36]
Kota Takeda and Takemasa Miyoshi. Quantifying the minimum ensemble size for asymptotic accuracy of the ensemble Kalman filter using the degrees of instability.EGUsphere, 2025:1–18, 2025
work page 2025
-
[37]
Andrew Stuart and Aretha Teckentrup. Posterior consistency for Gaussian process approximations of Bayesian posterior distributions.Mathematics of Computation, 87(310):721–753, 2018
work page 2018
-
[38]
A robust generalized t distribution-based Kalman filter
Mingming Bai, Chengjiao Sun, and Yonggang Zhang. A robust generalized t distribution-based Kalman filter. IEEE Transactions on Aerospace and Electronic Systems, 58(5):4771–4781, 2022
work page 2022
-
[39]
Gene H Golub and Charles F Van Loan.Matrix computations. JHU Press, 2013
work page 2013
-
[40]
Generalizing Bayesian inference: Updating a 250 years old theorem for the 21st century, August 2021
Lorenzo Pacchiardi. Generalizing Bayesian inference: Updating a 250 years old theorem for the 21st century, August 2021. Accessed: 2024-05-22
work page 2021
-
[41]
Matthias Morzfeld and Sebastian Reich. Data assimilation: mathematics for merging models and data.Snapshots of modern mathematics from Oberwolfach, 2018(11), 2018
work page 2018
-
[42]
Lorenzo Pacchiardi and Ritabrata Dutta. Generalized Bayesian likelihood-free inference using scoring rules estimators.arXiv preprint arXiv:2104.03889, 2021
-
[43]
Pierre Alquier et al. User-friendly introduction to PAC-Bayes bounds.Foundations and Trends® in Machine Learning, 17(2):174–303, 2024
work page 2024
-
[44]
Spatio-temporal Bayesian on-line changepoint detection with model selection
Jeremias Knoblauch and Theodoros Damoulas. Spatio-temporal Bayesian on-line changepoint detection with model selection. InInternational Conference on Machine Learning, pages 2718–2727. PMLR, 2018
work page 2018
-
[45]
Nicolas Chopin, Omiros Papaspiliopoulos, et al.An introduction to sequential Monte Carlo, volume 4. Springer, 2020
work page 2020
-
[46]
Pierre Del Moral, Arnaud Doucet, and Ajay Jasra. An adaptive sequential Monte Carlo method for approximate Bayesian computation.Statistics and Computing, 22(5):1009–1020, 2012
work page 2012
-
[47]
On the choice of MCMC kernels for approximate Bayesian computation with SMC samplers
Anthony Lee. On the choice of MCMC kernels for approximate Bayesian computation with SMC samplers. In Proceedings of the 2012 Winter Simulation Conference (WSC), pages 1–12. IEEE, 2012
work page 2012
-
[48]
Xavier Didelot, Richard G. Everitt, Adam M. Johansen, and Daniel J. Lawson. Likelihood-free estimation of model evidence.Bayesian Analysis, 6(1):49–76, 2011. 36 Robust EnKF
work page 2011
-
[49]
Improving approximate Bayesian computation via quasi-Monte Carlo
Alexander Buchholz and Nicolas Chopin. Improving approximate Bayesian computation via quasi-Monte Carlo. Journal of Computational and Graphical Statistics, 28(1):205–219, 2019
work page 2019
-
[50]
Interpreting diffusion score matching using normalizing flow.arXiv preprint arXiv:2107.10072, 2021
Wenbo Gong and Yingzhen Li. Interpreting diffusion score matching using normalizing flow.arXiv preprint arXiv:2107.10072, 2021
-
[51]
Aapo Hyvärinen and Peter Dayan. Estimation of non-normalized statistical models by score matching.Journal of Machine Learning Research, 6(4), 2005
work page 2005
-
[52]
Measuring sample quality with diffusions.The Annals of Applied Probability, 29(5):2884–2928, 2019
Jackson Gorham, Andrew B Duncan, Sebastian J V ollmer, and Lester Mackey. Measuring sample quality with diffusions.The Annals of Applied Probability, 29(5):2884–2928, 2019
work page 2019
-
[53]
Song Liu, Takafumi Kanamori, and Daniel J Williams. Estimating density models with truncation boundaries using score matching.The Journal of Machine Learning Research, 23(1):8448–8485, 2022
work page 2022
-
[54]
Towards healing the blindness of score matching.arXiv preprint arXiv:2209.07396, 2022
Mingtian Zhang, Oscar Key, Peter Hayes, David Barber, Brooks Paige, and François-Xavier Briol. Towards healing the blindness of score matching.arXiv preprint arXiv:2209.07396, 2022
-
[55]
Interpretation and Generalization of Score Matching
Siwei Lyu. Interpretation and generalization of score matching.arXiv preprint arXiv:1205.2629, 2012
work page internal anchor Pith review Pith/arXiv arXiv 2012
-
[56]
Andreas Anastasiou, Alessandro Barp, François-Xavier Briol, Bruno Ebner, Robert E Gaunt, Fatemeh Ghader- inezhad, Jackson Gorham, Arthur Gretton, Christophe Ley, Qiang Liu, et al. Stein’s method meets computational statistics: A review of some recent developments.Statistical Science, 38(1):120–139, 2023
work page 2023
-
[57]
A kernelized Stein discrepancy for goodness-of-fit tests
Qiang Liu, Jason Lee, and Michael Jordan. A kernelized Stein discrepancy for goodness-of-fit tests. InInterna- tional Conference on Machine Learning, pages 276–284. PMLR, 2016
work page 2016
-
[58]
Pierre Del Moral.Feynman-Kac formulae: genealogical and interacting particle systems with applications. Springer, 2004
work page 2004
-
[59]
Joaquín Míguez, Dan Crisan, and Petar M Djuri´c. On the convergence of two sequential Monte Carlo methods for maximum a posteriori sequence estimation and stochastic global optimization.Statistics and Computing, 23:91–107, 2013. 37 Robust EnKF Appendix A Constructing the Kalman filter from conjugacy We provide the construction of the regular Kalman filter...
work page 2013
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.