Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.

Stochastic ISTA/FISTA Adaptive Step Search Algorithms for Convex Composite Optimization

Online Successive Convex Approximation for Two-Stage Stochastic Nonconvex Optimization

Computer-Assisted Design of Accelerated Composite Optimization Methods: OptISTA

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Proximal Subgradient Norm Minimization of ISTA and FISTA

Stochastic subgradient for composite optimization with functional constraints

FISTA and Extensions -- Review and New Insights

A Smoothing Stochastic Gradient Method for Composite Optimization

Parameter-Free FISTA by Adaptive Restart and Backtracking

Adaptive smoothing mini-batch stochastic accelerated gradient method for nonsmooth convex stochastic composite optimization

Stochastic smoothing accelerated gradient method for nonsmooth convex composite optimization

A FISTA-type accelerated gradient algorithm for solving smooth nonconvex composite optimization problems

Optimal Stochastic Approximation Algorithms for Strongly Convex Stochastic Composite Optimization I: A Generic Algorithmic Framework

Average Curvature FISTA for Nonconvex Smooth Composite Optimization Problems

Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization

On inexact stochastic splitting methods for a class of nonconvex composite optimization problems with relative error

Stochastic Optimization for Nonconvex Problem with Inexact Hessian Matrix, Gradient, and Function

Stagewise Accelerated Stochastic Gradient Methods for Nonconvex Optimization