Abstract:We consider a two-stage stochastic optimization problem, in which a long-term optimization variable is coupled with a set of short-term optimization variables in both objective and constraint functions. Despite that two-stage stochastic optimization plays a critical role in various engineering and scientific applications, there still lack efficient algorithms, especially when the long-term and short-term variables are coupled in the constraints. To overcome the challenge caused by tightly coupled stochastic constraints, we first establish a two-stage primal-dual decomposition (PDD) method to decompose the two-stage problem into a long-term problem and a family of short-term subproblems. Then we propose a PDD-based stochastic successive convex approximation (PDD-SSCA) algorithmic framework to find KKT solutions for two-stage stochastic optimization problems. At each iteration, PDD-SSCA first runs a short-term sub-algorithm to find stationary points of the short-term subproblems associated with a mini-batch of the state samples. Then it constructs a convex surrogate for the long-term problem based on the deep unrolling of the short-term sub-algorithm and the back propagation method. Finally, the optimal solution of the convex surrogate problem is solved to generate the next iterate. We establish the almost sure convergence of PDD-SSCA and customize the algorithmic framework to solve two important application problems. Simulations show that PDD-SSCA can achieve superior performance over existing solutions.

On the Convergence of L-shaped Algorithms for Two-Stage Stochastic Programming

Online Successive Convex Approximation for Two-Stage Stochastic Nonconvex Optimization

A New Convergent Hybrid Learning Algorithm for Two-Stage Stochastic Programs.

Towards Global Solutions for Nonconvex Two-Stage Stochastic Programs: A Polynomial Lower Approximation Approach

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Two-Stage Stochastic Optimization via Primal-Dual Decomposition and Deep Unrolling

Two-Stage Stochastic Programming with Linearly Bi-parameterized Quadratic Recourse.

A Decomposition Algorithm for Two-Stage Stochastic Programs with Nonconvex Recourse Functions

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network

A Unified Analysis of Stochastic Optimization Methods Using Jump System Theory and Quadratic Constraints

Discrete Approximation and Convergence Analysis for a Class of Decision-Dependent Two-Stage Stochastic Linear Programs

Asymptotic Results of Stochastic Decomposition for Two-Stage Stochastic Quadratic Programming

Linear Convergence for Distributed Stochastic Optimization with Coupled Inequality Constraints

Complexity of stochastic dual dynamic programming

Can Decentralized Stochastic Minimax Optimization Algorithms Converge Linearly for Finite-Sum Nonconvex-Nonconcave Problems?

Numerical Methods for Convex Multistage Stochastic Optimization

Convergence Analysis of a Nonlinear Lagrangian Algorithm for Nonlinear Programming with Inequality Constraints

Two Stochastic Optimization Algorithms for Convex Optimization with Fixed Point Constraints

The Convergence of a Dual Algorithm for Nonlinear Programming