Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.

Stochastic Approximation Proximal Method of Multipliers for Convex Stochastic Programming

Stochastic Approximation Proximal Subgradient Method for Stochastic Convex-Concave Minimax Optimization

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Regrets of Proximal Method of Multipliers for Online Non-convex Optimization with Long Term Constraints

Solving Nonsmooth Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization

N ov 2 01 6 A Proximal Stochastic Quasi-Newton Algorithm

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

A Single-Loop Stochastic Proximal Quasi-Newton Method for Large-Scale Nonsmooth Convex Optimization

A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization.

Random Multi-Constraint Projection: Stochastic Gradient Methods for Convex Optimization with Many Constraints

Stochastic Optimization for Non-convex Inf-Projection Problems

Stochastic Approximation in convex multiobjective optimization

Regret minimization in stochastic non-convex learning via a proximal-gradient approach

Numerical Methods for Convex Multistage Stochastic Optimization

Robust Stochastic Approximation Approach to Stochastic Programming

Single-Loop Stochastic Algorithms for Difference of Max-Structured Weakly Convex Functions

Stochastic Block-Coordinate Gradient Projection Algorithms for Submodular Maximization.

Optimal Stochastic Strongly Convex Optimization with a Logarithmic Number of Projections

The stochastic proximal distance algorithm

A Stochastic Alternating Direction Method of Multipliers for Non-smooth and Non-convex Optimization

Stochastic Optimization under Hidden Convexity