Requiring LICQ/SCS/SOSC everywhere in bilevel optimization is non-prevalent and rigid, while holding almost everywhere is prevalent, but the distinction introduces fundamental difficulties.
arXiv preprint arXiv:2309.01753 , year=
4 Pith papers cite this work. Polarity classification is still indexing.
citation-role summary
citation-polarity summary
years
2026 4roles
background 1polarities
background 1representative citing papers
Second-order bilevel methods achieve Õ(ε^{-1.5}) iteration complexity for second-order stationary points, faster than first-order approaches, with a lazy variant improving computational efficiency by √d.
Formalizes Root-Finding Bilevel Optimization (RF-BO) and introduces a Jacobian-free TTSA algorithm that structurally avoids variance amplification, with convergence guarantees and reported gains over squared-residual baselines in SimCLR, ODE control, RL entropy tuning, and generative modeling.
BROS achieves memory-efficient single-loop stochastic bilevel optimization with O(ε^{-2}) sample complexity by performing updates in randomized subspaces and using Rademacher bi-probe correction for unbiased estimation.
citing papers explorer
-
Escaping the Variance Trap: Jacobian-Free Dynamics for Root-Finding Bilevel Optimization
Formalizes Root-Finding Bilevel Optimization (RF-BO) and introduces a Jacobian-free TTSA algorithm that structurally avoids variance amplification, with convergence guarantees and reported gains over squared-residual baselines in SimCLR, ODE control, RL entropy tuning, and generative modeling.
-
BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization
BROS achieves memory-efficient single-loop stochastic bilevel optimization with O(ε^{-2}) sample complexity by performing updates in randomized subspaces and using Rademacher bi-probe correction for unbiased estimation.