REVIEW 3 major objections 5 minor 39 references
A deep learning-driven iterative scheme for high-dimensional HJB equations in portfolio selection with exogenous and endogenous costs
T0 review · 3 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read The paper proposes a deep-learning-driven policy iteration scheme for the two-dimensional HJB equation arising when an investor faces both proportional transaction costs and stochastic liquidity risk, and shows numerically that the resultin
desk verdict Novel model, plausible numerics, but convergence proof rests on an assumption that is the desired limit and validation only hits the Merton degenerate case. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The engine is a policy iteration loop over two neural networks. The value network Q_phi is trained so that the HJB operator applied under the current policy has small squared residual together with the terminal condition; the control network omega_psi, whose sigmoid output enforces the no-shorting constraint, is then trained to maximize that same operator against the updated value function. Derivatives come from automatic differentiation, so no finite-difference grid is needed, and convergence is argued provided the residual H^{π_{k+1}}(t,x,V^{π_k}) tends uniformly to zero, an assumption the paper adopts from earlier policy-improvement theory.
What would settle it
On the Merton validation case, compute the maximum over the sampled domain of |H^{π_{k+1}}(t,x,V^{π_k})| after each policy-improvement step: if this uniform residual does not decrease toward zero even when the value-function training loss shrinks, the central convergence hypothesis is not met. Alternatively, solve the full two-friction HJB with a dense grid-based finite-difference method on a fixed domain and compare the optimal-weight surface: disagreement beyond training noise would show the scheme solves a different limiting equation.
Extended reading notes
Core claim
The central claim is that the deep learning-driven policy iteration scheme — alternating a policy-evaluation step that minimizes the squared PDE residual plus terminal-condition error for the value network, and a policy-improvement step that maximizes the HJB operator with respect to a sigmoid-constrained control network — produces accurate approximations of the value function and optimal policy for Eq. (12). The authors demonstrate this on the Merton benchmark and then use it to establish that both proportional fees and stochastic liquidity risk push the optimal stock fraction below the frictionless level, with the effect varying by utility type: for CRRA utilities the optimal weight is ind
Load-bearing premise
The convergence proof assumes that the residual H^{π_{k+1}}(t,x,V^{π_k}) goes to zero uniformly as iterations proceed, which is essentially the convergence the proof is trying to establish, and the paper gives no argument that the neural-network-trained policies satisfy this condition.
Editorial extensions
If this is right
- The scheme is mesh-free, so adding another risky asset or another stochastic factor does not require re-gridding; the paper expects it to inherit the curse-of-dimensionality resistance of neural PDE solvers.
- For CRRA utilities (power and log), the optimal risky weight is independent of time and wealth even with both frictions present, and the long-run mean-reversion level of liquidity does not affect the optimal weight.
- For CARA (exponential) utility, the optimal weight is time-, wealth-, and liquidity-dependent; fees matter most for small wealth and become negligible for large wealth.
- Raising either the proportional cost rate or the liquidity sensitivity lowers the optimal risky allocation below the frictionless benchmark.
- Because the control is a neural network rather than a discretized set of grid values, the scheme extends naturally to problems with high-dimensional control spaces.
Reading between the lines
- The same two-network iteration should apply to HJB equations with several risky assets or stochastic volatility, where the control network output dimension simply grows; the bottleneck will be whether policy improvement remains stable once the control space has many coordinates.
- The paper's convergence theorem depends on the uniform residual condition (20) holding; a practical check would be to monitor that residual directly during training and use it as a stopping rule, turning the assumption into a testable diagnostic.
- The finding that the long-run liquidity mean-reversion level does not affect CRRA allocations is stated for a power-function liquidity feedback; one could test whether it survives other concave choices of the feedback function.
- The numerical comparisons are all against the frictionless Merton benchmark; comparing against a high-resolution finite-difference solution of the frictional HJB would test whether the PINN policy iteration also matches the true value function under frictions, not just in the benchmark limit.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper considers a continuous-time portfolio selection problem with both exogenous proportional transaction costs and endogenous liquidity costs, the latter modeled by a mean-reverting Ornstein–Uhlenbeck process. The authors derive a two-dimensional HJB equation, propose a deep-learning-based policy iteration scheme (Algorithm 1), give a convergence argument in a general setting, and report numerical experiments for power, logarithmic, and exponential utility. The central claim is that the proposed scheme solves the full HJB equation (12), with potential advantages in high-dimensional settings and no truncation errors.
Significance. If the central claim were established, the paper would offer a practical mesh-free numerical method for high-dimensional HJB equations arising in portfolio selection with market frictions. The paper has clear strengths: the numerical scheme is tested against the Merton analytical solution in the degenerate case, the authors explicitly acknowledge the restrictive nature of their convergence assumption, and the three utility examples provide a useful qualitative picture of how liquidity risk and proportional costs affect portfolio choice. However, the main theoretical and numerical support for the full two-dimensional problem is currently incomplete, so the significance is conditional.
major comments (3)
- [§3.3, Eq. (20)] The convergence proof rests on the assumption H^{π_{k+1}}(t,x,V^{π_k}) → 0 uniformly. This is not a mild regularity condition; it is precisely the statement that the limit of the value iterates solves the HJB equation. The preceding monotonicity argument only shows that V^{π_k} is bounded below by the policy value and (under small errors) is increasing; it does not identify the limit as a solution of (18). No argument links the neural-network loss minimization in Algorithm 1 to this uniform residual limit. Thus the convergence theorem, as stated, is essentially circular and does not establish that Algorithm 1 solves Eq. (12). I would ask the authors to either prove (20) under verifiable conditions on the control and value networks, or invoke and verify a known policy-iteration convergence result, and to report the HJB residual in the numerical experiments.
- [§2, Eqs. (5)–(9)] The derivation of the traded quantity ν and the expected transaction cost is heuristic and contains a dimensionally suspicious expression. Combining Eq. (6) with Eq. (8) gives an expected cost proportional to √δt, not δt, because Eq. (8) already contains √δt. Yet Eq. (9) and the wealth dynamics (10) are written with an extra δt factor, i.e. the cost term is proportional to √(2/(πδt))·δt. Since the cost term enters the drift of the HJB equation, this discrepancy changes the model and the numerical results. Please clarify the approximation and correct the formula. Also, Eq. (5) introduces κ·sign(ν) in the denominator without derivation; the subsequent approximation in Eq. (7) drops the sign dependence, which should be justified rather than assumed.
- [§3.4 and §4] The only quantitative validation of the scheme is the Merton case with β=0 and κ=0, where the two-dimensional HJB equation (12) reduces to a one-dimensional problem without cost terms. This test does not exercise the liquidity dimension, the stochastic-liquidity dynamics, or the transaction-cost terms. The full two-dimensional results in Section 4 are presented without comparison to any reference solution. I recommend adding a validation against a standard finite-difference or alternative numerical solver for at least one of the examples with nonzero β and κ; for Example 1, the power-utility reduction to one dimension provides a natural benchmark.
minor comments (5)
- [Algorithm 1, line 4] The terminal condition is written as |Qϕ(W,L,0)-U(W)|², but the problem is defined on [0,T]; the correct condition is at t=T, as in Eq. (15).
- [§2, Eq. (4)] The notation 'δWS' should be 'δB^S' (or 'dB^S') for consistency with the stock-price dynamics in Eq. (1).
- [§3.4, Fig. 2] The claim of 'exponential or even faster convergence' is based on an empirical log-distance plot for the Merton case; this should be described as empirical, not as a proven rate, and ideally accompanied by a quantified rate or error bars.
- [§4.1, Eq. (22)] The reduction to a one-dimensional PDE for power utility is useful, but the paper does not use this reduced PDE as a benchmark for the general 2D solver. This is a missed opportunity and should be discussed.
- [Throughout] The parameter δt is fixed at 1/12 without a sensitivity study. Since the model depends on δt through the transaction-cost approximation, a robustness check over δt would strengthen the numerical evidence.
Circularity Check
Convergence proof assumes (20), which is the HJB limit itself; the central theoretical claim is conditional on its own conclusion.
-
other
[Section 3.3, Convergence Analysis, assumption (20)]
"Moreover, the convergence of our numerical scheme can be proved under the following restrictive assumption: H πk+1(t, x, Vπk) → 0 uniformly, (20), which was first proposed by Jacka and Mijatovi´ c [24]."
By Eq. (19), H^{π}(t,x,v)=∂_t v+H(t,x,∇v,∇²v,π(t,x)); and the policy-improvement step gives H^{π_{k+1}}(t,x,V^{π_k})=sup_{u∈U}H^u(t,x,V^{π_k}). Thus (20) says exactly that the approximate value functions V^{π_k} satisfy the HJB equation (18) in the uniform limit—the very convergence the section claims to prove. The preceding Itô argument only yields V^{π_k}≤V^{π_{k+1}}+(T−t)||e_k||∞ and does not derive (20) from Algorithm 1. The 'restrictive assumption' is therefore not a mild regularity condition but the target HJB limit itself, so the convergence theorem assumes rather than establishes the desired result.
full rationale
The paper's numerical scheme has independent content: Section 3.4 validates the solver against Merton's analytical solution, and the examples are forward simulations with fixed parameters rather than fits to the target solution. However, the central theoretical claim — that Algorithm 1 converges to the solution of the two-dimensional HJB equation (12) — rests on assumption (20), which is effectively the HJB residual vanishing in the limit. The paper does not show that the neural-network loss minimization produces this uniform limit; it merely labels the condition 'restrictive' and cites [24]. In addition, the only benchmark used (Merton with β=0 and κ=0) is a degenerate case that does not exercise the liquidity or transaction-cost terms. The full-model claim therefore depends on a circular/conditional convergence proof. No self-citation chain, ansatz-smuggling, or renaming of known results is present; the circularity is concentrated in the convergence analysis.
Assumptions & free parameters
free parameters (2)
- λ (transaction cost sensitivity in θ(L)) =
5.0
- ζ (exponent in g(L)=L^ζ) =
unspecified, claimed in (0,1)
assumptions (6)
- domain assumption The HJB equation (12) admits a classical solution and two-layer neural networks can approximate Q* and ω* sufficiently well.
- domain assumption κ^2ω << 1, so κ/(1+κ sign(ν)ω) ≈ κ.
- domain assumption V^{π_k} and f^{π_k} grow quadratically in x and the localizing argument justifies dominated convergence.
- ad hoc to paper The restrictive convergence assumption H^{π_{k+1}}(t,x,V^{π_k}) → 0 uniformly holds.
- domain assumption The stock-price and liquidity dynamics (1) from Pasricha et al. are taken as given.
- ad hoc to paper The coupling θ(L)=θ̄+κλL^ζ represents the intrinsic relationship between exogenous and endogenous transaction costs.
Cite this review
Pith. "Pith review of A deep learning-driven iterative scheme for high-dimensional HJB equations in portfolio selection with exogenous and endogenous costs." pith.science (2026). https://pith.science/paper/D2OGEVDA
@misc{pith2026250902267,
author = {Pith},
title = {Pith review of: A deep learning-driven iterative scheme for high-dimensional HJB equations in portfolio selection with exogenous and endogenous costs},
year = {2026},
howpublished = {\url{https://pith.science/paper/D2OGEVDA}},
note = {Machine review of arXiv:2509.02267}
}
read the original abstract
In this paper, we first conduct a study of the portfolio selection problem, incorporating both exogenous (proportional) and endogenous (resulting from liquidity risk, characterized by a stochastic process) transaction costs through the utility-based approach. We also consider the intrinsic relationship between these two types of costs. To address the associated nonlinear two-dimensional Hamilton-Jacobi-Bellman (HJB) equation, we propose an innovative deep learning-driven policy iteration scheme with three key advantages: i) it has the potential to address the curse of dimensionality; ii) it is adaptable to problems involving high-dimensional control spaces; iii) it eliminates truncation errors. The numerical analysis of the proposed scheme, including convergence analysis in a general setting, is also discussed. To illustrate the impact of these two types of transaction costs on portfolio choice, we conduct through numerical experiments using three typical utility functions.
Figures
Figures from the paper (11 more)
Reference graph
Works this paper leans on
-
[1]
E. O. Abensur and W. P. de Carvalho. Improving portfolio selection by balancing liquidity-risk-return: Evidence from stock markets. Theoretical Economics Letters , 12(2):479–497, 2022
work page 2022
-
[2]
M. A. Al Janabi. Multivariate portfolio optimization under illiquid market prospects: a review of theoretical algorithms and practical techniques for liquidity risk management. Journal of Modelling in Management , 16(1):288–309, 2021
work page 2021
-
[3]
A. Alla, M. Falcone, and D. Kalise. An efficient policy iteration algorithm for dynamic 27 programming equations. SIAM Journal on Scientific Computing , 37(1):A181–A200, 2015
work page 2015
-
[4]
R. Baule. Optimal portfolio selection for the small investor considering risk and trans- action costs. OR spectrum, 32(1):61–76, 2010
work page 2010
-
[5]
A. G. Baydin, B. A. Pearlmutter, A. A. Radul, and J. M. Siskind. Automatic differenti- ation in machine learning: a survey. Journal of machine learning research, 18(153):1–43, 2018
work page 2018
-
[6]
F. Caccioli, I. Kondor, M. Marsili, and S. Still. Liquidity risk and instabilities in portfolio optimization. International Journal of Theoretical and Applied Finance, 19(05):1650035, 2016
work page 2016
-
[7]
T. Chellathurai and T. Draviam. Dynamic portfolio selection with nonlinear transaction costs. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 461(2062):3183–3212, 2005
-
[8]
U. J. Choi, B.-G. Jang, and H.-K. Koo. An algorithm for optimal portfolio selection problem with transaction costs and random lifetimes. Applied mathematics and com- putation, 191(1):239–252, 2007
work page 2007
Show all 39 references
-
[9]
M. Dai, Z. Q. Xu, and X. Y. Zhou. Continuous-time markowitz’s model with transaction costs. SIAM Journal on Financial Mathematics , 1(1):96–125, 2010
2010
-
[10]
Dai and Y
M. Dai and Y. Zhong. Penalty methods for continuous-time portfolio selection with proportional transaction costs. Available at SSRN 1210105 , 2008
2008
-
[11]
M. H. Davis and A. R. Norman. Portfolio selection with transaction costs. Mathematics of operations research, 15(4):676–713, 1990
1990
-
[12]
P. H. Dybvig and L. Pezzo. Mean-variance portfolio rebalancing with transaction costs. Available at SSRN 3373329 , 2020. 28
2020
-
[13]
Feng, M.-W
S.-P. Feng, M.-W. Hung, and Y.-H. Wang. Option pricing with stochastic liquidity risk: Theory and evidence. Journal of Financial Markets , 18:77–95, 2014
2014
-
[14]
Feng, M.-W
S.-P. Feng, M.-W. Hung, and Y.-H. Wang. The importance of stock liquidity on option pricing. International Review of Economics & Finance , 43:457–467, 2016
2016
-
[15]
P. A. Forsyth and G. Labahn. Numerical methods for controlled hamilton-jacobi- bellman pdes in finance. Journal of Computational Finance , 11(2):1, 2007
2007
-
[16]
Funahashi
K.-I. Funahashi. On the approximate realization of continuous mappings by neural networks. Neural networks, 2(3):183–192, 1989
1989
-
[17]
Gonz´ alez and G
A. Gonz´ alez and G. Rubio. Portfolio choice and the effects of liquidity.SERIEs, 2:53–74, 2011
2011
-
[18]
C. Greif. Numerical methods for hamilton-jacobi-bellman equations. University of Wisconsin-Milwaukee, U.S.A, 2017
2017
-
[19]
Grohs, F
P. Grohs, F. Hornung, A. Jentzen, and P. Von Wurstemberger. A proof that artificial neural networks overcome the curse of dimensionality in the numerical approximation of Black–Scholes partial differential equations , volume 284. American Mathematical Society, 2023
2023
-
[20]
Ha and H
Y. Ha and H. Zhang. Algorithmic trading for online portfolio selection under limited market liquidity. European Journal of Operational Research, 286(3):1033–1051, 2020
2020
-
[21]
He and S
X.-J. He and S. Lin. A stochastic liquidity risk model with stochastic volatility and its applications to option pricing. Stochastic Models, pages 1–20, 2024
2024
-
[22]
S. L. Heston. A closed-form solution for options with stochastic volatility with appli- cations to bond and currency options. The review of financial studies , 6(2):327–343, 1993
1993
-
[23]
R. A. Howard. Dynamic programming and markov processes. John Wiley, 1960. 29
1960
-
[24]
S. D. Jacka and A. Mijatovi´ c. On the policy improvement algorithm in continuous time. Stochastics, 89(1):348–359, 2017
2017
-
[25]
Kerimkulov, D
B. Kerimkulov, D. Siska, and L. Szpruch. Exponential convergence and stability of howard’s policy improvement algorithm for controlled diffusions. SIAM Journal on Control and Optimization , 58(3):1314–1340, 2020
2020
-
[26]
D. P. Kingma. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014
2014 arXiv
-
[27]
H. Kraft*. Optimal portfolios and heston’s stochastic volatility model: an explicit solution for power utility. Quantitative Finance, 5(3):303–313, 2005
2005
-
[28]
L. Lu, X. Meng, Z. Mao, and G. E. Karniadakis. Deepxde: A deep learning library for solving differential equations. SIAM review, 63(1):208–228, 2021
2021
-
[29]
Ly Vath, M
V. Ly Vath, M. Mnif, and H. Pham. A model of optimal portfolio selection under liquidity risk and price impact. Finance and Stochastics , 11:51–90, 2007
2007
-
[30]
Markowitz
H. Markowitz. Portfolio selection. The Journal of Finance , 7(1):77–91, 1952
1952
-
[31]
X. Mei, H. Zhu, and C. Chen. Mean-variance portfolio selection with estimation risk and transaction costs. Applied Economics, 55(13):1436–1453, 2023
2023
-
[32]
R. C. Merton. Optimum consumption and portfolio rules in a continuous-time model. Journal of Economic Theory , 3(4):373–413, 1971
1971
-
[33]
B. Niu, Y. Fan, H. Xiao, and B. Xue. Bacterial foraging based approaches to portfolio optimization with liquidity risk. Neurocomputing, 98:90–100, 2012
2012
-
[34]
Pasricha, S.-P
P. Pasricha, S.-P. Zhu, and X.-J. He. A closed-form pricing formula for European options in an illiquid asset market. Financial Innovation , 8(1):30, 2022
2022
-
[35]
Patel and M
N. Patel and M. G. Subrahmanyam. A simple algorithm for optimal portfolio selection with fixed transaction costs. Management Science, 28:303–314, 1982. 30
1982
-
[36]
H. Peng, M. Gan, and X. Chen. A mean-variance model for optimal portfolio selection with transaction costs. IF AC Proceedings Volumes, 41(2):1627–1632, 2008
2008
-
[37]
C. S. Pun and Z. Ye. Optimal dynamic mean–variance portfolio subject to proportional transaction costs and no-shorting constraint. Automatica, 135:109986, 2022
2022
-
[38]
Raissi, P
M. Raissi, P. Perdikaris, and G. E. Karniadakis. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational physics , 378:686–707, 2019
2019
-
[39]
W ANG and S
Z. W ANG and S. Liu. Multi-period mean-variance portfolio selection with fixed and proportional transaction costs. Journal of Industrial & Management Optimization , 9(3), 2013. 31
2013
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.