Abstract:Stochastic sequential quadratic optimization (SQP) methods for solving continuous optimization problems with nonlinear equality constraints have attracted attention recently, such as for solving large-scale data-fitting problems subject to nonconvex constraints. However, for a recently proposed subclass of such methods that is built on the popular stochastic-gradient methodology from the unconstrained setting, convergence guarantees have been limited to the asymptotic convergence of the expected value of a stationarity measure to zero. This is in contrast to the unconstrained setting in which almost-sure convergence guarantees (of the gradient of the objective to zero) can be proved for stochastic-gradient-based methods. In this paper, new almost-sure convergence guarantees for the primal iterates, Lagrange multipliers, and stationarity measures generated by a stochastic SQP algorithm in this subclass of methods are proved. It is shown that the error in the Lagrange multipliers can be bounded by the distance of the primal iterate to a primal stationary point plus the error in the latest stochastic gradient estimate. It is further shown that, subject to certain assumptions, this latter error can be made to vanish by employing a running average of the Lagrange multipliers that are computed during the run of the algorithm. The results of numerical experiments are provided to demonstrate the proved theoretical guarantees.

Continuity and Stability of a Quadratic Mixed-Integer Stochastic Program

Quantitative Stability of Mixed-Integer Two-Stage Quadratic Stochastic Programs

Continuity and Stability of Two-Stage Stochastic Programs with Quadratic Continuous Recourse

Continuity and Stability of Fully Random Two-Stage Stochastic Programs with Mixed-Integer Recourse

Quantitative Stability of Two-Stage Linear Second-Order Conic Stochastic Programs with Full Random Recourse

Quantitative Stability of Full Random Two-Stage Problems with Quadratic Recourse

Quantitative Stability of Fully Random Two-Stage Stochastic Programs with Mixed-Integer Recourse

Quantitative Stability Analysis of Two-Stage Stochastic Linear Programs with Full Random Recourse

Quantitative Stability of Full Random Two-Stage Stochastic Programs with Recourse

Continuity of the Optimal Value Function and Optimal Solutions of Parametric Mixed-Integer Quadratic Programs

Quantitative Analysis for a Class of Two-Stage Stochastic Linear Variational Inequality Problems

Quantitative Stability Analysis of Stochastic Quasi-Variational Inequality Problems and Applications

Stabilizing control of robustness for systems with maximum uncertain parameters - A quadratic programming approach

Existence of Solutions in Bi-level Stochastic Linear Programming with Integer Variables

Two-Stage Stochastic Variational Inequality Arising from Stochastic Programming

Two-Stage Stochastic Programming with Linearly Bi-parameterized Quadratic Recourse.

On Linear Stability of Parametric Convex Quadratic Programming

Almost-sure convergence of iterates and multipliers in stochastic sequential quadratic optimization

Solving a Class of Convex Stochastic Programs Via Monte Carlo Simulation

Quantitative Stability of Multistage Stochastic Programs Via Calm Modifications

Weak Continuity of Risk Functionals with Applications to Stochastic Programming