Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.

Simulation-Based Discrete Optimization of Stochastic Discrete Event Systems Subject to Non Closed-Form Constraints.

Stochastic Steepest-Descent Optimization Of Multiple-Objective Mobile Sensor Coverage

Direct Approaches for PDE-constrained Dynamic Optimization Based on Space–time Orthogonal Collocation on Finite Elements

A Framework For Locally Convergent Random-Search Algorithms For Discrete Optimization Via Simulation

Simulation Optimization: A New Approach

A simulation based optimization method for multi-stage production-distribution systems subject to non-analytical constraints

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

Discrete Optimization Via Simulation Using Coordinate Search

Chapter 2 Discrete Optimization via Simulation

Stochastic Systems Simulation Optimization

Balancing Search and Estimation in Random Search Based Stochastic Simulation Optimization

Solving a Class of Convex Stochastic Programs Via Monte Carlo Simulation

Discrete optimization via simulation: algorithms and error control

A simulation-based approach for solving optimisation problems with ODE-type steady state constraints

An adaptive sampling algorithm for simulation-based optimization with descriptive complexity constraints

Efficient Simulation Budget Allocation for Stochastically Constrained Simulation Optimization with Regression in Partitioned Domains

A Note on the Stochastic Ruler Method for Discrete Simulation Optimization

Efficient Computing Budget Allocation for Simulation-Based Optimization With Stochastic Simulation Time

Estimation of the Pareto Front in Stochastic Simulation Through Stochastic Kriging.

Adaptive Partitioning Strategy for High-Dimensional Discrete Simulation-based Optimization Problems