Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.

An Approximation Scheme for Stochastic Programs with Second Order Dominance Constraints

Probability Approximation Schemes for Stochastic Programs with Distributionally Robust Second-Order Dominance Constraints

A smoothing penalized Sample Average Approximation Method for Stochastic Programs with Second-Order Stochastic Dominance Constraints.

On Distributionally Robust Optimization Problems with K-Th Order Stochastic Dominance Constraints Induced by Full Random Quadratic Recourse

Convergence Analysis of Stationary Points in Sample Average Approximation of Stochastic Programs with Second Order Stochastic Dominance Constraints.

Multivariate Robust Second-Order Stochastic Dominance and Resulting Risk-Averse Optimization

Discrete Approximation for Two-Stage Stochastic Variational Inequalities

Solving Nonsmooth Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization

Discrete Approximation and Convergence Analysis for a Class of Decision-Dependent Two-Stage Stochastic Linear Programs

Distributionally Robust Second-Order Stochastic Dominance Constrained Optimization with Wasserstein Ball

Quantitative Stability and Empirical Approximation of Risk-Averse Models Induced by Two-Stage Stochastic Programs with Full Random Recourse.

Stability Analysis of Optimization Problems with $k$th Order Stochastic and Distributionally Robust Dominance Constraints Induced by Full Random Recourse

Sample Average Approximation Method for a Class of Stochastic Variational Inequality Problems.

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Quantitative Stability of Two-Stage Linear Second-Order Conic Stochastic Programs with Full Random Recourse

Robust Stochastic Approximation Approach to Stochastic Programming

The Almost Everywhere Upper Semiconvergence of the Optimal Solution Set Sequence of Empirical Approximations for Stochastic Programs

Exact Penalization, Level Function Method, and Modified Cutting-Plane Method for Stochastic Programs with Second Order Stochastic Dominance Constraints

Asymptotic Analysis of Sample Average Approximation for Stochastic Optimization Problems with Joint Chance Constraints Via Conditional Value at Risk and Difference of Convex Functions

Distributionally Robust Optimization with Multivariate Second-Order Stochastic Dominance Constraints with Applications in Portfolio Optimization

An entropy penalized approach for stochastic control problems. Complete version