A primal-dual interior point trust region method for second-order stationary points of Riemannian inequality-constrained optimization problems
Pith reviewed 2026-05-23 04:44 UTC · model grok-4.3
The pith
A primal-dual interior point trust region method converges globally to an approximate KKT point and a weak second-order stationary point for Riemannian inequality-constrained problems.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The Riemannian primal-dual interior point trust region method (RIPTRM) is proved to converge globally to an approximate Karush-Kuhn-Tucker point and a weak second-order stationary point. Under the strict complementarity condition the convergence strengthens to a second-order stationary point. The algorithm is the first to combine a trust-region strategy with an interior-point framework for constrained optimization on Riemannian manifolds while retaining the second-order stationarity guarantee for nonlinear inequality constraints.
What carries the argument
The trust-region subproblem solved at each iteration, which incorporates the primal-dual interior-point barrier conditions into a quadratic model on the tangent space of the manifold.
If this is right
- The method applies directly to nonconvex problems with inequality constraints that arise in control and machine learning on manifolds.
- Both a truncated conjugate gradient solver and an eigenvalue-based exact solver can be used for the trust-region subproblems.
- Numerical tests show that the algorithm consistently reaches solutions of high accuracy.
- The exact subsolver variant performs well on instances where the Hessian of the Lagrangian has a large negative eigenvalue.
Where Pith is reading between the lines
- The same subproblem structure could be reused to design line-search variants that still guarantee second-order stationarity.
- Replacing the fixed barrier with an adaptive one might reduce the number of outer iterations without losing the convergence guarantees.
- The eigenvalue-based subsolver already identifies negative curvature; extending it to a negative-curvature escape step would connect the method to saddle-point avoidance techniques.
Load-bearing premise
The analysis requires the manifold and the objective and constraint functions to be sufficiently smooth and to satisfy standard constraint qualifications that keep the interior-point and trust-region steps well-defined.
What would settle it
A concrete sequence of iterates generated by the method that converges to a point violating the second-order necessary conditions, while all stated smoothness and qualification assumptions continue to hold, would falsify the global convergence claim.
read the original abstract
We consider Riemannian inequality-constrained optimization problems. Such problems inherit the benefits of Riemannian approach developed in the unconstrained setting and naturally arise from applications in control, machine learning, and other fields. We propose a Riemannian primal-dual interior point trust region method (RIPTRM) for solving them. We prove its global convergence to an approximate Karush-Kuhn-Tucker point and a weak second-order stationary point. Under the strict complementarity condition, this result reduces to global convergence to a second-order stationary point. To the best of our knowledge, this is the first algorithm that incorporates the trust region strategy for constrained optimization on Riemannian manifolds, and has the second-order convergence property for optimization problems on Riemannian manifolds with nonlinear inequality constraints. We conduct numerical experiments in which we introduce a truncated conjugate gradient method and an eigenvalue-based subsolver for RIPTRM to approximately and exactly solve the trust region subproblems, respectively. Empirical results show that RIPTRMs consistently find solutions with high accuracy. Additionally, we observe that RIPTRM with the exact search direction shows promising performance in an instance where the Hessian of the Lagrangian has a large negative eigenvalue.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes the Riemannian primal-dual interior point trust region method (RIPTRM) for inequality-constrained optimization on Riemannian manifolds. It establishes global convergence of the method to an approximate KKT point and a weak second-order stationary point; under strict complementarity this strengthens to convergence to a second-order stationary point. The work also describes numerical experiments that employ a truncated conjugate gradient method and an eigenvalue-based subsolver to solve the trust-region subproblems approximately and exactly, respectively, with results indicating high-accuracy solutions.
Significance. If the convergence analysis is rigorous, the result is significant: it supplies the first trust-region algorithm for Riemannian problems with nonlinear inequality constraints that achieves second-order stationarity guarantees. The explicit treatment of both approximate and exact subproblem solvers, together with the reduction from weak to full second-order stationarity under strict complementarity, constitutes a clear technical contribution. The standard smoothness and constraint-qualification assumptions are stated explicitly, and the manuscript supplies the full convergence argument rather than an outline.
minor comments (3)
- [Numerical Experiments] Numerical experiments section: the reported results are described at a high level without error bars, multiple random seeds, or quantitative baseline comparisons against existing Riemannian interior-point or penalty methods; this weakens the empirical support for the practical claims.
- [Introduction] The statement that RIPTRM is the first such method should be accompanied by a concise table or paragraph in the introduction that directly contrasts it with the closest prior Riemannian constrained solvers (e.g., those using penalty or augmented Lagrangian approaches) to make the novelty claim precise.
- [Preliminaries] Notation for the Riemannian metric, retraction, and vector transport is introduced without a dedicated preliminary subsection; a short table collecting these symbols and their properties would improve readability for readers outside the immediate subfield.
Simulated Author's Rebuttal
We thank the referee for their positive summary of the manuscript, recognition of its technical contributions, and recommendation of minor revision. We are pleased that the work is viewed as supplying the first trust-region primal-dual interior-point method on Riemannian manifolds with second-order stationarity guarantees.
Circularity Check
No significant circularity identified
full rationale
The paper presents a convergence proof for a new Riemannian primal-dual interior-point trust-region algorithm. The central claims rest on standard smoothness, constraint qualification, and strict complementarity assumptions that are stated explicitly and are independent of the algorithm's outputs. No derivation step reduces a claimed prediction or stationarity result to a fitted parameter, self-referential definition, or load-bearing self-citation chain; the proof structure follows conventional non-circular analysis for trust-region and interior-point methods on manifolds. The 'first algorithm' claim is a novelty statement, not a mathematical reduction.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption The feasible set is a Riemannian manifold with the objective and constraint functions twice continuously differentiable.
- domain assumption Standard constraint qualifications (e.g., LICQ or MFCQ) hold at limit points.
Forward citations
Cited by 1 Pith paper
-
Local near-quadratic convergence of Riemannian interior point methods
Riemannian interior point methods achieve local near-quadratic convergence to second-order stationary points, with the first algorithm shown to combine this local rate and global convergence guarantees.
Reference graph
Works this paper leans on
- [1]
- [2]
-
[3]
N. Agarwal, N. Boumal, B. Bullins, and C. Cartis , Adaptive regularization with cubics on manifolds, Math. Program., 188 (2021), pp. 85–134
work page 2021
-
[4]
R. Andreani, K. R. Couto, O. P. Ferreira, and G. Haeser , Constraint qualifications and strong global convergence properties of an augmented Lagrangian method on Riemannian manifolds, SIAM J. Optim., 34 (2024), pp. 1799–1825
work page 2024
-
[5]
R. Andreani, K. R. Couto, O. P. Ferreira, G. Haeser, and L. F. Prudente , Global con- vergence of an augmented Lagrangian method for nonlinear programming via Riemannian optimization, 2024, https://optimization-online.org/?p=27595
work page 2024
-
[6]
S. Arahata, T. Okuno, and A. Takeda , Complexity analysis of interior-point methods for second-order stationary points of nonlinear semidefinite optimization problems , Comput. Optim. Appl., 86 (2023), pp. 555–598
work page 2023
-
[7]
H. Y. Benson, R. J. V anderbei, and D. F. Shanno , Interior-point methods for nonconvex nonlinear programming: filter methods and merit functions , Comput. Optim. Appl., 23 (2002), pp. 257–272
work page 2002
-
[8]
R. Bergmann and R. Herzog , Intrinsic formulation of KKT conditions and constraint qual- ifications on smooth manifolds , SIAM J. Optim., 29 (2010), pp. 2423–2444
work page 2010
-
[9]
E. G. Birgin, O. P. Ferreira, G. Haeser, N. Maculan, L. M. Ramirez, and L. F. Pru- dente, Smoothing ℓ1-exact penalty methiod for intrinsically constarined Riemannian op- timization problems, 2025, https://optimization-online.org/?p=28986
work page 2025
-
[10]
N. Boumal, An introduction to optimization on smooth manifolds, Cambridge University Press, Cambridge, 2023
work page 2023
-
[11]
N. Boumal, P.-A. Absil, and C. Cartis , Global rates of convergence for nonconvex optimiza- tion on manifolds , IMA J. Numer. Anal., 39 (2019), pp. 1–33
work page 2019
-
[12]
S. Brossette, A. Escande, and A. Kheddar , Multicontact postures computation on mani- folds, IEEE Trans. Robotics, 34 (2018), pp. 1252–1265
work page 2018
-
[13]
R. H. Byrd, J. C. Gilbert, and J. Nocedal , A trust region method based on interior point techniques for nonlinear programming, Math. Program., 89 (2000), pp. 149–185
work page 2000
-
[14]
R. H. Byrd, G. Liu, and J. Nocedal , On the local behavior of an interior point method for nonlinear programming, in Numerical Analysis 1997, Chapman and Hall/CRC, Harlow, 1997, pp. 37–56
work page 1997
- [15]
- [16]
-
[17]
A. R. Conn, N. I. M. Gould, D. Orban, and P. L. Toint , A primal-dual trust-region algorithm for non-convex nonlinear programming , Math. Program., 87 (2000), pp. 215– 249
work page 2000
-
[18]
A. R. Conn, N. I. M. Gould, and P. L. Toint , Trust region methods, SIAM, Philadelphia, 2000
work page 2000
-
[19]
C. Criscitiello and N. Boumal , Efficiently escaping saddle points on manifolds , in NeurIPS, 2019, pp. 5987–5997
work page 2019
-
[20]
F. E. Curtis, N. I. M. Gould, D. P. Robinson, and P. L. Toint , An interior-point trust- funnel algorithm for nonlinear optimization , Math. Program., 161 (2017), pp. 73–134
work page 2017
-
[21]
F. R. de Oliveira and O. P. Ferreira , Newton method for finding a singularity of a special class of locally Lipschitz continuous vector fields on Riemannian manifolds , J. Optim. Theory Appl., 185 (2020), pp. 522–539
work page 2020
-
[22]
M. P. do Carmo , Riemannian Geometry, Birkh¨ auser, Basel, 1992
work page 1992
-
[23]
A. Forsgren, P. E. Gill, and M. H. Wright , Interior methods for nonlinear optimization , SIAM Rev., 44 (2002), pp. 525–597
work page 2002
-
[24]
N. I. M. Gould, D. Orban, A. Sartenaer, and P. L. Toint , Superlinear convergence of primal-dual interior point algorithms for nonlinear programming , SIAM J. Optim., 11 (2001), pp. 974–1002
work page 2001
-
[25]
N. I. M. Gould, D. Orban, and P. L. Toint , Numerical methods for large-scale nonlinear 26 M. OBARA, T. OKUNO, AND A. TAKEDA optimization, Acta Numer., 14 (2005), pp. 299–361
work page 2005
-
[26]
F. Goyens and C. W. Royer , Riemannian trust-region methods for strict saddle functions with complexity guarantees. arXiv:2402.07614v2, 2024
-
[27]
O. Hinder and Y. Ye , Worst-case iteration bounds for log barrier methods on problems with nonconvex constraints, Math. Oper. Res., (2023). to appear
work page 2023
- [28]
-
[29]
W. Huang, P.-A. Absil, and K. A. Gallivan , A Riemannian symmetric rank-one trust-region method, Math. Program., 150 (2015), pp. 179–216
work page 2015
-
[30]
W. Huang, P.-A. Absil, and K. A. Gallivan , A Riemannian BFGS method without dif- ferentiated retraction for nonconvex optimization problems , SIAM J. Optim., 28 (2018), pp. 470–495
work page 2018
-
[31]
H. Kasai and B. Mishra , Inexact trust-region algorithms on Riemannian manifolds , in NeurIPS, 2018, pp. 4252–4265
work page 2018
-
[32]
D. Kiessling, S. Leyffer, and C. V anaret , A unified funnel restoration SQP algorithm . arXiv:2404.09208, 2024
- [33]
-
[34]
J. M. Lee , Introduction to smooth manifolds , Springer, New York, second ed., 2012
work page 2012
-
[35]
J. M. Lee , Introduction to Riemannian manifolds , Springer, New York, second ed., 2018
work page 2018
- [36]
- [37]
-
[38]
Y. Luo, X. Li, and A. Zhang , Nonconvex factorization and manifold formulations are almost equivalent in low-rank matrix optimization , INFORMS J. Optim., (2024). to appear
work page 2024
- [39]
-
[40]
Y. Narushima, S. Nakayama, M. Takemura, and H. Yabe , Memoryless quasi-Newton meth- ods based on the spectral-scaling Broyden family for Riemannian optimization , J. Optim. Theory Appl., 197 (2023), pp. 639–664
work page 2023
-
[41]
J. Nocedal and S. J. Wright , Numerical Optimization, Springer, New York, 2006
work page 2006
- [42]
-
[43]
Local near-quadratic convergence of Riemannian interior point methods
M. Obara, T. Okuno, and A. Takeda , Local near-quadratic convergence of Riemannian interior point methods. arXiv:2505.19724, 2025
work page internal anchor Pith review Pith/arXiv arXiv 2025
- [44]
-
[45]
H. Sakai and H. Iiduka , Modified memoryless spectral-scaling Broyden family on Riemannian optimization, J. Optim. Theory Appl., 202 (2024), pp. 834–853
work page 2024
-
[46]
H. Sato, Riemannian conjugate gradient methods: general framework and specific algorithms with convergence analyses, SIAM J. Optim., 32 (2022), pp. 2690–2717
work page 2022
-
[47]
H. Sato and K. Sato , Riemannian optimal system identification algorithm for linear MIMO systems, IEEE Control Syst. Lett., 1 (2017), pp. 376 – 381
work page 2017
-
[48]
K. Sato and H. Sato , Structure-preserving H 2 optimal model reduction based on the Rie- mannian trust-region method, IEEE Trans. Automat. Control, 63 (2017), pp. 505–512
work page 2017
-
[49]
K. Sato, H. Sato, and T. Damm , Riemannian optimal identification method for linear sys- tems with symmetric positive-definite matrix , IEEE Trans. Automat. Control, 65 (2020), pp. 4493–4508
work page 2020
-
[50]
A. Schiela and J. Ortiz , An SQP method for equality constrained optimization on Hilbert manifolds, SIAM J. Optim., 31 (2021), pp. 949–981
work page 2021
- [51]
- [52]
-
[53]
S. Sra, N. K. Vishnoi, and O. Yildiz , On geodesically convex formulations for the Brascamp- Lieb constant, in APPROX/RANDOM, vol. 116, 2018, pp. 25:1–25:15
work page 2018
-
[54]
Y. Sun, N. Flammarion, and M. F azel , Escaping from saddle points on Riemannian mani- folds, in NeurIPS, 2019, pp. 7276–7286. RIEMANNIAN INTERIOR POINT TRUST REGION METHOD 27
work page 2019
-
[55]
J. Townsend, N. Koep, and S. Weichwald , Pymanopt: A python toolbox for optimization on manifolds using automatic differentiation , J. Mach. Learn. Res., 17 (2016), pp. 1—-5
work page 2016
-
[56]
P. Tseng, Convergent infeasible interior-point trust-region methods for constrained minimiza- tion, SIAM J. Optim., 13 (2002), pp. 432–469
work page 2002
-
[57]
M. Ulbrich, S. Ulbrich, and L. N. Vicente , A globally convergent primal-dual interior-point filter method for nonlinear programming, Math. Program., 100 (2004), pp. 379–410
work page 2004
-
[58]
A. W ¨achter and L. T. Biegler , Failure of global convergence for a class of interior point methods for nonlinear programming, Math. Program., 88 (2000), pp. 565–574
work page 2000
-
[59]
M. Weber and S. Sra , Global optimality for Euclidean CCCP under Riemannian convexity , in ICML, 2023, pp. 202:36709–36803
work page 2023
-
[60]
Y. Yamakawa and H. Sato , Sequential optimality conditions for nonlinear optimization on Riemannian manifolds and a globally convergent augmented Lagrangian method , Comput. Optim. Appl., 81 (2022), pp. 397–421
work page 2022
-
[61]
H. Yamashita, H. Yabe, and T. Tanabe , A globally and superlinearly convergent primal- dual interior point trust region method for large scale constrained optimization , Math. Program., 102 (2005), pp. 111–151
work page 2005
-
[62]
W. H. Yang, L.-H. Zhang, and R. Song , Optimality conditions for the nonlinear programming problems on Riemannian manifolds , Pac. J. Optim., 10 (2014), pp. 415–434
work page 2014
-
[63]
K. Ye, K. S.-W. Wong, and L.-H. Lim , Optimization on flag manifolds , Math. Program., 194 (2022), pp. 621–660
work page 2022
-
[64]
R. Zass and A. Shashua , Nonnegative sparse PCA, in NIPS, 2006, pp. 1561–1568
work page 2006
-
[65]
J. Z. S. Zhang , A cubic regularized Newton’s method over Riemannian manifolds . arXiv:1805.05565, 2018. Appendix A. Proofs of Lemmas 4.8 and 4.13. In this section, we derive the proofs of the key lemmas, Lemmas 4.8 and 4.13, that estimate the gaps between the predicted and actual reductions. To prove the lemmas, we first express the gaps in the following...
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[66]
Suppose R = Exp and that, for every i ∈ I , the function gi : M → R is Li-Lipschitz continuous; that is, there exists Li > 0 such that |gi(x1) − gi(x2)| ≤ Li dist(x1, x2) for all x1, x2 ∈ M. Then, Assumption B.7 holds
-
[67]
If xℓ ℓ is bounded, then Assumption B.7 holds. Proof. We first prove Item 1. Notice that, due to the completeness of M, the domain of the exponential map atx is the whole of Tx M for all x ∈ M. It follows from [10, Proposition 10.41] that Li-Lipschitz continuity is equivalent to gi Expx(ξx) − gi(x) ≤ Li∥ξx ∥x for all x ∈ M and all ξx ∈ Tx M. Therefore, fo...
-
[68]
If xℓ ℓ is bounded, then Assumption B.10 holds
-
[69]
If M is compact, then Assumption B.10 holds. Proof. Under Item 1 or Item 2, let Q ⊆ M be a compact subset with xℓ ℓ ⊆ Q. For any δR > 0, define T := (x, ξx) ∈ TM: x ∈ Q and ∥ξx ∥x ≤ δR . Note that T is compact [10, Exercise 10.31]. Thus, from the smoothness of R and the continuity of the operator norm, there exists LR > 0 such that ∥D Rx(ξx)∥op ≤ LR for a...
-
[70]
Assumption B.8 holds
-
[71]
Under Assumptions B.5 and B.7, if lim j→∞ dx ℓj x ℓj = 0,(E-3) then Assumption B.9 holds. Proof. First, we consider Item 1. Since the dual variable is updated when the primal iterate is successful, we focus on the successful iterations. From Item 1 of Lemma 4.11, there exists ˜ε > 0 such that 1 ˜ ε ≥ 1 gi(x ℓ) for any i ∈ I and all ℓ ∈ N0, which, together...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.