REVIEW 2 cited by
A stochastic smoothing framework for nonconvex-nonconcave minEmax problems with applications to Wasserstein distributionally robust optimization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We study a class of stochastic nonsmooth optimization problems in which an outer variable minimizes the expectation of a pointwise maximum. This minimization--expectation--maximization (minEmax) problem arises in Wasserstein distributionally robust optimization and adversarially robust training, and it cannot in general be reformulated as a finite-dimensional minimax problem when the underlying distribution is not empirical. We propose a stochastic smoothing proximal gradient method based on log-mean-exp smoothing of the value function. Under compactness and Lipschitz-type assumptions, we present nonasymptotic analysis in terms of Goldstein stationarity and show that every almost-sure cluster point generated by our method is a Clarke stationary point; by Clarke regularity, such a point is also directional stationary for the original problem. Numerical experiments on newsvendor, robust regression, and adversarially robust learning problems show that the proposed method is competitive with existing baselines.
Forward citations
Cited by 2 Pith papers
-
Unregularized limit of stochastic gradient method for Wasserstein distributionally robust optimization
Gradients of the entropically smoothed and sampled WDRO objective converge to Clarke subgradients of the unregularized objective as regularization vanishes, yielding O(log N/√N) SGD convergence rates up to sampling error.
-
A single-loop SPIDER-type stochastic subgradient method for expectation-constrained nonconvex nonsmooth optimization
A SPIDER-type stochastic subgradient method with smoothed exact penalization reaches (epsilon,epsilon)-KKT points of expectation-constrained nonconvex nonsmooth problems in O(epsilon^-4) iterations.
Discussion (0). Continue with ORCID to comment.