Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.

Asymptotic Analysis of Sample Average Approximation for Stochastic Optimization Problems with Joint Chance Constraints Via Conditional Value at Risk and Difference of Convex Functions

Sample Average Approximation Method for a Class of Stochastic Variational Inequality Problems.

On Convergence to Stochastic Integrals

Nonasymptotic Upper Estimates for Errors of the Sample Average Approximation Method to Solve Risk-Averse Stochastic Programs

Sample Average Approximation for Portfolio Optimization under CVaR constraint in an (re)insurance context

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

On sample average approximation for two-stage stochastic programs without relatively complete recourse

Sample Average Approximation for Stochastic Programming with Equality Constraints

Statistical inference and hypotheses testing of risk averse stochastic programs

Conditional Value-at-Risk Approximation to Value-at-Risk Constrained Programs: A Remedy Via Monte Carlo.

0/1 Constrained Optimization Solving Sample Average Approximation for Chance Constrained Programming

Robust Stochastic Approximation Approach to Stochastic Programming

Solving Nonsmooth Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization

A 0/1 Constrained Optimization Solving Sample Average Approximation for Chance Constrained Programming

Convergence of Randomized Quasi-Monte Carlo Sampling for Value-at-Risk and Conditional Value-at-Risk

Asymptotic representations for importance-sampling estimators of value-at-risk and conditional value-at-risk

Asymptotic Time-Uniform Inference for Parameters in Averaged Stochastic Approximation

CVaR-Based Approximations of Wasserstein Distributionally Robust Chance Constraints with Application to Process Scheduling

Metric Entropy-Free Sample Complexity Bounds for Sample Average Approximation in Convex Stochastic Programming

Stochastic Approximation of Smooth and Strongly Convex Functions: Beyond the Convergence Rate