Deep numerical schemes for systems of Ergodic BSDEs with applications to regime-switching forward utilities
Pith reviewed 2026-06-25 23:35 UTC · model grok-4.3
The pith
Two neural-network schemes solve systems of coupled ergodic BSDEs for regime-switching forward utilities.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
We introduce two neural-network-based numerical schemes for solving systems of coupled ergodic Backward Stochastic Differential Equations (eBSDEs). We establish a link between these equations and an associated multidimensional BSDE with random terminal time given by the hitting time of the positive recurrent stochastic factor. We present a locally additive deep learning scheme minimizing aggregated local error terms and a Deep Galerkin Method inspired algorithm minimizing the residual of the ergodic PDE system using an ergodic cost representation. We apply the framework to regime-switching forward utilities, deriving a general consistency SPDE and retrieving the eBSDE representation in the h
What carries the argument
The link between the system of ergodic BSDEs and the multidimensional BSDE with random terminal time at the hitting time of the stochastic factor, which enables the neural network training procedures.
If this is right
- The schemes provide numerical approximations of optimal strategies in forward utility models with regime switches.
- In the homothetic case, forward utilities admit a representation via systems of ergodic BSDEs.
- Regime switches affect forward preferences in ways that can be quantified by solving the eBSDE systems.
- The consistency of regime-switching forward utilities is characterized by a stochastic partial differential equation.
Where Pith is reading between the lines
- The neural schemes could be applied to other problems involving ergodic BSDEs outside of utility maximization.
- Accuracy in high-dimensional cases may require adjustments to the network architecture or training procedure.
- Extensions to non-recurrent factors would need alternative representations beyond hitting times.
Load-bearing premise
The stochastic factor is positive recurrent, which ensures the hitting time is finite and connects the ergodic system to a BSDE with random terminal time.
What would settle it
Solve a simple one-dimensional regime-switching model with known closed-form ergodic BSDE solution using the proposed schemes and verify that the numerical outputs converge to the exact values.
Figures
read the original abstract
In this paper, we introduce two neural-network-based numerical schemes for solving systems of coupled ergodic Backward Stochastic Differential Equations (eBSDEs), motivated by the approximation of optimal strategies within the framework of forward utilities in a regime-switching stochastic factor model. Our approach builds on the representation of such models through systems of eBSDEs introduced in [HLT20]. We first establish a link between the solution of the system of ergodic BSDEs and that of an associated multidimensional BSDE with random terminal time, given by the hitting time of the positive recurrent stochastic factor. Building on this representation, we introduce a locally additive deep learning scheme obtained by minimizing aggregated local error terms. We then present a new Deep Galerkin Method (DGM) inspired algorithm that minimizes the residual of the associated ergodic PDE system, relying on a representation of the ergodic cost. Finally, we apply this framework to regime-switching forward utilities in a stochastic factor model. We first derive a general consistency SPDE that characterizes regime-switching forward utilities and retrieve their representation with systems of ergodic BSDEs in the homothetic case. Numerical experiments demonstrate the performance of the proposed methods, with a particular focus on the impact on forward preferences of taking into account regime switches.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces two neural-network schemes for systems of coupled ergodic BSDEs arising from regime-switching forward utility maximization. It first establishes a representation linking the eBSDE system to a multidimensional BSDE with random terminal time equal to the hitting time of a positive-recurrent stochastic factor process. Building on this, it proposes a locally additive deep-learning scheme that minimizes aggregated local errors and a DGM-style algorithm that minimizes the residual of the associated ergodic PDE system (using an ergodic-cost representation). The framework is applied to derive a consistency SPDE for regime-switching forward utilities (recovering the eBSDE representation in the homothetic case) and is tested numerically on the forward-utility problem, with emphasis on the effect of regime switches.
Significance. If the representation result and the numerical schemes hold with supporting analysis, the work supplies practical tools for long-horizon stochastic control problems that incorporate regime switches, an area of growing interest in mathematical finance. The link between ergodic BSDEs and stopped BSDEs under positive recurrence is a useful structural contribution that enables the neural methods; the forward-utility application further illustrates relevance.
major comments (2)
- [Numerical experiments] The numerical experiments section reports performance on the forward-utility example but provides no quantitative error measures, convergence rates, or comparisons against known solutions or alternative discretizations. This absence undermines the claim that the schemes demonstrate reliable performance, especially given that the central motivation is numerical approximation of optimal strategies.
- [Representation result and scheme construction] The representation result (linking the eBSDE system to the BSDE stopped at the hitting time) is load-bearing for both proposed schemes, yet the manuscript supplies no error analysis or stability estimates for the neural approximations of this stopped BSDE. Without such analysis the practical utility of the locally additive and DGM schemes remains unquantified.
minor comments (2)
- Notation for the regime-switching process and the associated generator should be introduced once and used consistently; occasional redefinition of symbols across sections reduces readability.
- [Introduction] The abstract and introduction cite [HLT20] for the eBSDE representation; a brief self-contained recap of the key assumptions from that reference would help readers who have not consulted the prior work.
Simulated Author's Rebuttal
We thank the referee for the detailed report and constructive suggestions. We address each major comment below and indicate the revisions we will make to strengthen the manuscript.
read point-by-point responses
-
Referee: [Numerical experiments] The numerical experiments section reports performance on the forward-utility example but provides no quantitative error measures, convergence rates, or comparisons against known solutions or alternative discretizations. This absence undermines the claim that the schemes demonstrate reliable performance, especially given that the central motivation is numerical approximation of optimal strategies.
Authors: We agree that the numerical section would benefit from quantitative support. The current experiments emphasize qualitative behavior under regime switches, but in the revision we will add error tables against available benchmark solutions (where the ergodic BSDE admits an explicit form), convergence plots with respect to network width/depth and training iterations, and direct comparisons to a standard Euler-type discretization of the stopped BSDE. These additions will be placed in a new subsection of the numerical experiments. revision: yes
-
Referee: [Representation result and scheme construction] The representation result (linking the eBSDE system to the BSDE stopped at the hitting time) is load-bearing for both proposed schemes, yet the manuscript supplies no error analysis or stability estimates for the neural approximations of this stopped BSDE. Without such analysis the practical utility of the locally additive and DGM schemes remains unquantified.
Authors: The representation theorem is used to recast the ergodic system as a stopped BSDE whose terminal time is the hitting time of the recurrent factor process; both neural schemes are then applied to this equivalent problem. While the manuscript does not contain a full a-priori error analysis for the neural approximation of the stopped BSDE (consistent with the largely empirical nature of deep-learning BSDE solvers in the literature), the locally additive scheme explicitly minimizes aggregated local residuals and the DGM scheme minimizes the ergodic PDE residual. In the revision we will insert a short discussion of the Lipschitz stability of the stopped BSDE with respect to the neural-network approximation error and will report additional numerical diagnostics (e.g., sensitivity to the hitting-time truncation) that quantify practical stability. A complete theoretical convergence rate lies outside the present scope but can be noted as future work. revision: partial
Circularity Check
No significant circularity; derivation chain is self-contained
full rationale
The paper derives a link between ergodic BSDE systems and multidimensional BSDEs with random terminal time under the positive-recurrence assumption, then introduces two new neural schemes (locally additive and DGM-style) that minimize local errors or PDE residuals on that representation. These steps are presented as original constructions, not reductions to fitted parameters or self-citations. The application to regime-switching forward utilities derives a consistency SPDE and retrieves the eBSDE representation in the homothetic case, again without the central claims collapsing to prior inputs by definition. Reliance on [HLT20] for the initial representation is external and does not create load-bearing circularity under the stated rules, as the numerical methods and consistency results are independently developed and tested.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption The models admit a representation through systems of eBSDEs as per [HLT20]
Reference graph
Works this paper leans on
-
[1]
Applied Mathematics and Computation , 430 : 500 127287, 2022
Ali Al-Aradi , Adolfo Correia , Gabriel Jardim , Danilo de Freitas Naiff et Yuri Saporito : Extensions of the deep galerkin method. Applied Mathematics and Computation , 430 : 500 127287, 2022
2022
-
[2]
Finance and Stochastics , 24(4) : 500 981--1011, 2020
Levon Avanesyan , Mykhaylo Shkolnikov et Ronnie Sircar : Construction of a class of forward performance processes in stochastic factor models, and an extension of W idder’s theorem. Finance and Stochastics , 24(4) : 500 981--1011, 2020
2020
-
[3]
International Journal of Theoretical and Applied Finance , 5(05) : 500 497--514, 2002
John Buffington et Robert J Elliott : American options with regime switching. International Journal of Theoretical and Applied Finance , 5(05) : 500 497--514, 2002
2002
-
[4]
In Seminar on Stochastic Analysis, Random Fields and Applications: Centro Stefano Franscini, Ascona, September 1996 , pages 73--85
Rainer Buckdahn et Shige Peng : Ergodic backward sde and associated pde. In Seminar on Stochastic Analysis, Random Fields and Applications: Centro Stefano Franscini, Ascona, September 1996 , pages 73--85. Springer, 1999
1996
-
[5]
Probability, Uncertainty and Quantitative Risk , 9(2) : 500 149--180, 2024
Guillaume Broux-Quemerais , Sarah Kaakaï , Anis Matoussi et Wissal Sabbagh : Deep learning scheme for forward utilities using ergodic bsdes. Probability, Uncertainty and Quantitative Risk , 9(2) : 500 149--180, 2024
2024
-
[6]
IEEE Transactions on Automatic Control , 49(3) : 500 442--447, 2004
Nicole Bauerle et Ulrich Rieder : Portfolio optimization with markov-modulated stock prices and interest rates. IEEE Transactions on Automatic Control , 49(3) : 500 442--447, 2004
2004
-
[7]
Insurance: Mathematics and Economics , 88 : 500 93--107, 2019
Wing Fung Chong : Pricing and hedging equity-linked life insurance contracts beyond the classical paradigm: The principle of equivalent forward preferences. Insurance: Mathematics and Economics , 88 : 500 93--107, 2019
2019
-
[8]
Crandall , Hitoshi Ishii et Pierre-Louis Lions : Users guide to viscosity solutions of second order partial differential equations
Michael G. Crandall , Hitoshi Ishii et Pierre-Louis Lions : Users guide to viscosity solutions of second order partial differential equations. Bulletin of the American Mathematical Society , 27 : 500 1--67, 1992
1992
-
[9]
Journal of scientific computing , 79(3) : 500 1667--1712, 2019
Quentin Chan-Wai-Nam , Joseph Mikael et Xavier Warin : Machine learning for semi linear PDE s. Journal of scientific computing , 79(3) : 500 1667--1712, 2019
2019
-
[10]
Stochastic Processes and their applications , 121(3) : 500 407--426, 2011
Arnaud Debussche , Ying Hu et Gianmario Tessitore : Ergodic BSDE s under weak dissipative assumptions. Stochastic Processes and their applications , 121(3) : 500 407--426, 2011
2011
-
[11]
In From Particle Systems to Partial Differential Equations: International Conference, Particle Systems and PDEs VI, VII and VIII, 2017-2019 VIII , pages 227--251
Goncalo Dos Reis et Vadim Platonov : Forward utilities and mean-field games under relative performance concerns. In From Particle Systems to Partial Differential Equations: International Conference, Particle Systems and PDEs VI, VII and VIII, 2017-2019 VIII , pages 227--251. Springer, 2021
2017
-
[12]
Stochastics , 90(6) : 500 927--954, 2018
Nicole El Karoui , Caroline Hillairet et Mohamed Mrad : Consistent utility of investment and consumption: a forward/backward spde viewpoint. Stochastics , 90(6) : 500 927--954, 2018
2018
-
[13]
Decisions in Economics and Finance , 45(1) : 500 375--414, 2022
Nicole El Karoui , Caroline Hillairet et Mohamed Mrad : Ramsey rule with forward/backward utility for long-term yield curves modeling. Decisions in Economics and Finance , 45(1) : 500 375--414, 2022
2022
-
[14]
SIAM Journal on Financial Mathematics , 4(1) : 500 697--736, 2013
Nicole El Karoui et Mohamed Mrad : An exact connection between two solvable SDE s and a nonlinear utility stochastic PDE . SIAM Journal on Financial Mathematics , 4(1) : 500 697--736, 2013
2013
-
[15]
Christoph Frei et Gon c alo Dos Reis : A financial market with interacting investors: does an equilibrium exist? Mathematics and financial economics , 4 : 500 161--182, 2011
2011
-
[16]
SIAM journal on control and optimization , 48(3) : 500 1542--1566, 2009
Marco Fuhrman , Ying Hu et Gianmario Tessitore : Ergodic BSDE s and optimal ergodic control in B anach spaces. SIAM journal on control and optimization , 48(3) : 500 1542--1566, 2009
2009
-
[17]
Stochastic Processes and their Applications , 124(8) : 500 2654--2671, 2014
Christoph Frei : Splitting multidimensional bsdes and finding local equilibria. Stochastic Processes and their Applications , 124(8) : 500 2654--2671, 2014
2014
-
[18]
European Journal of Operational Research , 233(1) : 500 184--192, 2014
Jun Fu , Jiaqin Wei et Hailiang Yang : Portfolio optimization in a regime-switching market with derivatives. European Journal of Operational Research , 233(1) : 500 184--192, 2014
2014
-
[19]
Discrete & Continuous Dynamical Systems-Series B , 23(10), 2018
Emmanuel Gobet et Mohamed Mrad : Convergence rate of strong approximations of compound random maps, application to SPDE s. Discrete & Continuous Dynamical Systems-Series B , 23(10), 2018
2018
-
[20]
: Neural networks-based algorithms for stochastic control and PDE s in finance
Maximilien Germain , Huy \^e n Pham , Xavier Warin et al. : Neural networks-based algorithms for stochastic control and PDE s in finance. Machine Learning and Data Sciences for Financial Markets , pages 426--452, 2023
2023
-
[21]
arXiv preprint arXiv:2407.09034 , 2024
Emmanuel Gobet , Adrien Richou et Lukasz Szpruch : Numerical approximation of ergodic bsdes using non linear feynman-kac formulas. arXiv preprint arXiv:2407.09034 , 2024
arXiv 2024
-
[22]
Guo et Q
X. Guo et Q. Zhang : Closed-form solutions for perpetual american put options with regime switching. SIAM Journal on Applied Mathematics , 64(6) : 500 2034--2049, 2004
2034
-
[23]
: Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
Jiequn Han , Arnulf Jentzen et al. : Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations. Communications in mathematics and statistics , 5(4) : 500 349--380, 2017
2017
-
[24]
Probability, Uncertainty and Quantitative Risk , pages 1--30, 2024
Caroline Hillairet , Sarah Kaakai et Mohamed Mrad : Time-consistent pension policy with minimum guarantee and sustainability constraint. Probability, Uncertainty and Quantitative Risk , pages 1--30, 2024
2024
-
[25]
Stochastic Processes and their Applications , 129(10) : 500 4009--4050, 2019
Ying Hu et Florian Lemonnier : Ergodic BSDE with unbounded and multiplicative underlying diffusion and application to large time behaviour of viscosity solution of HJB equation. Stochastic Processes and their Applications , 129(10) : 500 4009--4050, 2019
2019
-
[26]
SIAM Journal on Control and Optimization , 58(4) : 500 2503--2534, 2020
Ying Hu , Gechun Liang et Shanjian Tang : Systems of ergodic BSDE s arising in regime switching forward performance processes. SIAM Journal on Control and Optimization , 58(4) : 500 2503--2534, 2020
2020
-
[27]
Mathematics of Computation , 89(324) : 500 1547--1579, 2020
C \^o me Hur \'e , Huy \^e n Pham et Xavier Warin : Deep backward schemes for high-dimensional nonlinear PDE s. Mathematics of Computation , 89(324) : 500 1547--1579, 2020
2020
-
[28]
Electronic Journal of Probability , 24 : 500 1 -- 51, 2019
Jonathan Harter et Adrien Richou : A stability approach for solving multidimensional quadratic bsdes. Electronic Journal of Probability , 24 : 500 1 -- 51, 2019
2019
-
[29]
Stochastic Processes and their Applications , 126(4) : 500 1066--1086, 2016
Ying Hu et Shanjian Tang : Multi-dimensional backward stochastic differential equations of diagonally quadratic generators. Stochastic Processes and their Applications , 126(4) : 500 1066--1086, 2016
2016
-
[30]
Elsevier, 2014
Nobuyuki Ikeda et Shinzo Watanabe : Stochastic differential equations and diffusion processes . Elsevier, 2014
2014
-
[31]
SIAM Journal on Control and Optimization , 44(6) : 500 2063--2078, 2006
Arnaud Jobert et Leonard CG Rogers : Option pricing with markov-modulated dynamics. SIAM Journal on Control and Optimization , 44(6) : 500 2063--2078, 2006
2063
-
[32]
Discrete and Continuous Dynamical Systems - B , 29(4) : 500 1695--1729, 2024
Lorenc Kapllani et Long Teng : Deep learning algorithms for solving high-dimensional nonlinear backward stochastic differential equations. Discrete and Continuous Dynamical Systems - B , 29(4) : 500 1695--1729, 2024
2024
-
[33]
Cambridge university press, 1997
Hiroshi Kunita : Stochastic flows and stochastic differential equations , volume 24. Cambridge university press, 1997
1997
-
[34]
Franck Lecocq et Jean-Charles Hourcade : Le taux d’actualisation contre le principe de précaution? L'Actualité Economique , 80 : 500 41--65, 01 2004
2004
-
[35]
Bernoulli , 8(3) : 500 367--405, avril 2002
Damien Lamberton et Gilles Pag \`e s : Recursive computation of the invariant distribution of a diffusion. Bernoulli , 8(3) : 500 367--405, avril 2002
2002
-
[36]
American Mathematical Soc., 2017
David A Levin et Yuval Peres : Markov chains and mixing times , volume 107. American Mathematical Soc., 2017
2017
-
[37]
SIAM Journal on Financial Mathematics , 8(1) : 500 344--372, 2017
Gechun Liang et Thaleia Zariphopoulou : Representation of homothetic forward performance processes in stochastic factor models via ergodic and infinite horizon bsde. SIAM Journal on Financial Mathematics , 8(1) : 500 344--372, 2017
2017
-
[38]
Mathematical Finance , 29(4) : 500 1003--1038, 2019
Daniel Lacker et Thaleia Zariphopoulou : Mean field and n-agent games for optimal investment under relative performance criteria. Mathematical Finance , 29(4) : 500 1003--1038, 2019
2019
-
[39]
International Journal of Theoretical and Applied Finance , 25(01) : 500 2250004, 2022
Anis Matoussi et Mohamed Mrad : Dynamic utility and related nonlinear spdes driven by levy noise. International Journal of Theoretical and Applied Finance , 25(01) : 500 2250004, 2022
2022
-
[40]
Technical report , 2006
Marek Musiela et Thaleia Zariphopoulou : Investments and forward utilities. Technical report , 2006
2006
-
[41]
In Contemporary Quantitative Finance: Essays in Honour of Eckhard Platen , pages 195--216
Marek Musiela et Thaleia Zariphopoulou : Stochastic partial differential equations and portfolio choice. In Contemporary Quantitative Finance: Essays in Honour of Eckhard Platen , pages 195--216. Springer, 2010
2010
-
[42]
Insurance: Mathematics and Economics , 114 : 500 192--211, 2024
Kenneth Tsz Hin Ng et Wing Fung Chong : Optimal investment in defined contribution pension schemes with forward utility preferences. Insurance: Mathematics and Economics , 114 : 500 192--211, 2024
2024
-
[43]
Inspired by Finance: The Musiela Festschrift , pages 475--504, 2014
Sergey Nadtochiy et Thaleia Zariphopoulou : A class of homothetic forward investment performance processes with non-zero volatility. Inspired by Finance: The Musiela Festschrift , pages 475--504, 2014
2014
-
[44]
Osaka Journal of Mathematics , 44 : 500 207--230, 2007
Bernt ksendal et Tusheng Zhang : The it \^o -ventzell formula and forward stochastic differential equations driven by poisson random measures. Osaka Journal of Mathematics , 44 : 500 207--230, 2007
2007
-
[45]
In Stochastic Analysis and Related Topics VI: Proceedings of the Sixth Oslo—Silivri Workshop Geilo 1996 , pages 79--127
\'E tienne Pardoux : Backward stochastic differential equations and viscosity solutions of systems of semilinear parabolic and elliptic PDE s of second order. In Stochastic Analysis and Related Topics VI: Proceedings of the Sixth Oslo—Silivri Workshop Geilo 1996 , pages 79--127. Springer, 1998
1996
-
[46]
Springer, 2014
Etienne Pardoux et Aurel Rascanu : Stochastic Differential Equations, Backward SDEs, Partial Differential Equations . Springer, 2014
2014
-
[47]
Raissi , P
M. Raissi , P. Perdikaris et G. E. Karniadakis : Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics , 378 : 500 686--707, 2019
2019
-
[48]
Mathematical Finance: An International Journal of Mathematics, Statistics and Financial Economics , 19(2) : 500 251--279, 2009
Luz Roc \' o Sotomayor et Abel Cadenillas : Explicit solutions of consumption-investment problems in financial markets with regime switching. Mathematical Finance: An International Journal of Mathematics, Statistics and Financial Economics , 19(2) : 500 251--279, 2009
2009
-
[49]
Journal of computational physics , 375 : 500 1339--1364, 2018
Justin Sirignano et Konstantinos Spiliopoulos : Dgm: A deep learning algorithm for solving partial differential equations. Journal of computational physics , 375 : 500 1339--1364, 2018
2018
-
[50]
HM Treasury , 2007
Nicholas Stern : The economics of climate change: the stern review. HM Treasury , 2007
2007
-
[51]
Stochastic Processes and their Applications , 118(3) : 500 503--515, 2008
Revaz Tevzadze : Solvability of backward stochastic differential equations with quadratic growth. Stochastic Processes and their Applications , 118(3) : 500 503--515, 2008
2008
-
[52]
The Annals of Probability , 46(1) : 500 491 -- 550, 2018
Hao Xing et Gordan Z itkovi\' c : A class of globally solvable markovian quadratic bsde systems and applications. The Annals of Probability , 46(1) : 500 491 -- 550, 2018
2018
-
[53]
Yao , Qing Zhang et Xun Yu Zhou : A Regime-Switching Model for European Options , pages 281--300
David D. Yao , Qing Zhang et Xun Yu Zhou : A Regime-Switching Model for European Options , pages 281--300. Springer US, Boston, MA, 2006
2006
-
[54]
SIAM Journal on Control and Optimization , 30(3) : 500 613--636, 1992
Thaleia Zariphopoulou : Investment-consumption models with transaction fees and markov-chain parameters. SIAM Journal on Control and Optimization , 30(3) : 500 613--636, 1992
1992
-
[55]
SIAM Journal on Control and Optimization , 42(4) : 500 1466--1482, 2003
Xun Yu Zhou et George Yin : Markowitz's mean-variance portfolio selection with regime switching: A continuous-time model. SIAM Journal on Control and Optimization , 42(4) : 500 1466--1482, 2003
2003
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.