TY - JOUR
T1 - Complexity guarantees for an implicit smoothing-enabled method for stochastic MPECs
AU - Cui, Shisheng
AU - Shanbhag, Uday V.
AU - Yousefian, Farzad
N1 - Publisher Copyright:
© 2022, Springer-Verlag GmbH Germany, part of Springer Nature and Mathematical Optimization Society.
PY - 2023/4
Y1 - 2023/4
N2 - Mathematical programs with equilibrium constraints (MPECs) represent a class of hierarchical programs that allow for modeling problems in engineering, economics, finance, and statistics. While stochastic generalizations have been assuming increasing relevance, there is a pronounced absence of efficient first/zeroth-order schemes with non-asymptotic rate guarantees for resolving even deterministic variants of such problems. We consider a subclass of stochastic MPECs (SMPECs) where the parametrized lower-level equilibrium problem is given by a deterministic/stochastic variational inequality problem whose mapping is strongly monotone, uniformly in upper-level decisions. Under suitable assumptions, this paves the way for resolving the implicit problem with a Lipschitz continuous objective via a gradient-free zeroth-order method by leveraging a locally randomized spherical smoothing framework. Efficient algorithms for resolving the implicit problem allow for leveraging any convexity property possessed by the implicit problem, which in turn facilitates the computation of approximate global minimizers. In this setting, we present schemes for single-stage and two-stage stochastic MPECs when the upper-level problem is either convex or nonconvex in an implicit sense. (I). Single-stage SMPECs. In single-stage SMPECs, in convex regimes, our proposed inexact schemes are characterized by a complexity in upper-level projections, upper-level samples, and lower-level projections of O(1ϵ2), O(1ϵ2), and O(1ϵ2ln(1ϵ)), respectively. Analogous bounds for the nonconvex regime are O(1ϵ), O(1ϵ2), and O(1ϵ3), respectively. (II). Two-stage SMPECs. In two-stage SMPECs, in convex regimes, our proposed inexact schemes have a complexity in upper-level projections, upper-level samples, and lower-level projections of O(1ϵ2), O(1ϵ2), and O(1ϵ2ln(1ϵ)) while the corresponding bounds in the nonconvex regime are O(1ϵ), O(1ϵ2), and O(1ϵ2ln(1ϵ)), respectively. In addition, we derive statements for accelerated schemes in settings where the exact solution of the lower-level problem is available. Preliminary numerics suggest that the schemes scale with problem size, are relatively robust to modification of algorithm parameters, show distinct benefits in obtaining near-global minimizers for convex implicit problems in contrast with competing solvers, and provide solutions of similar accuracy in a fraction of the time taken by sample-average approximation (SAA).
AB - Mathematical programs with equilibrium constraints (MPECs) represent a class of hierarchical programs that allow for modeling problems in engineering, economics, finance, and statistics. While stochastic generalizations have been assuming increasing relevance, there is a pronounced absence of efficient first/zeroth-order schemes with non-asymptotic rate guarantees for resolving even deterministic variants of such problems. We consider a subclass of stochastic MPECs (SMPECs) where the parametrized lower-level equilibrium problem is given by a deterministic/stochastic variational inequality problem whose mapping is strongly monotone, uniformly in upper-level decisions. Under suitable assumptions, this paves the way for resolving the implicit problem with a Lipschitz continuous objective via a gradient-free zeroth-order method by leveraging a locally randomized spherical smoothing framework. Efficient algorithms for resolving the implicit problem allow for leveraging any convexity property possessed by the implicit problem, which in turn facilitates the computation of approximate global minimizers. In this setting, we present schemes for single-stage and two-stage stochastic MPECs when the upper-level problem is either convex or nonconvex in an implicit sense. (I). Single-stage SMPECs. In single-stage SMPECs, in convex regimes, our proposed inexact schemes are characterized by a complexity in upper-level projections, upper-level samples, and lower-level projections of O(1ϵ2), O(1ϵ2), and O(1ϵ2ln(1ϵ)), respectively. Analogous bounds for the nonconvex regime are O(1ϵ), O(1ϵ2), and O(1ϵ3), respectively. (II). Two-stage SMPECs. In two-stage SMPECs, in convex regimes, our proposed inexact schemes have a complexity in upper-level projections, upper-level samples, and lower-level projections of O(1ϵ2), O(1ϵ2), and O(1ϵ2ln(1ϵ)) while the corresponding bounds in the nonconvex regime are O(1ϵ), O(1ϵ2), and O(1ϵ2ln(1ϵ)), respectively. In addition, we derive statements for accelerated schemes in settings where the exact solution of the lower-level problem is available. Preliminary numerics suggest that the schemes scale with problem size, are relatively robust to modification of algorithm parameters, show distinct benefits in obtaining near-global minimizers for convex implicit problems in contrast with competing solvers, and provide solutions of similar accuracy in a fraction of the time taken by sample-average approximation (SAA).
UR - http://www.scopus.com/inward/record.url?scp=85139500654&partnerID=8YFLogxK
U2 - 10.1007/s10107-022-01893-6
DO - 10.1007/s10107-022-01893-6
M3 - Article
AN - SCOPUS:85139500654
SN - 0025-5610
VL - 198
SP - 1153
EP - 1225
JO - Mathematical Programming
JF - Mathematical Programming
IS - 2
ER -