Abstract:This paper proposes a constrained stochastic successive convex approximation (CSSCA) algorithm to find a stationary point for a general non-convex stochastic optimization problem, whose objective and constraint functions are non-convex and involve expectations over random states. Most existing methods for non-convex stochastic optimization, such as the stochastic (average) gradient and stochastic majorization-minimization, only consider minimizing a stochastic non-convex objective over a deterministic convex set. The proposed CSSCA algorithm can also handle stochastic non-convex constraints in optimization problems, and it opens the way to solving more challenging optimization problems that occur in many applications. The algorithm is based on solving a sequence of convex objective/feasibility optimization problems obtained by replacing the objective/constraint functions in the original problems with some convex surrogate functions. The CSSCA algorithm allows a wide class of surrogate functions and thus provides many freedoms to design good surrogate functions for specific applications. Moreover, it also facilitates parallel implementation for solving large-scale stochastic optimization problems, which arise naturally in today's signal processing such as machine learning and big data analysis. We establish the convergence of the CSSCA algorithm with a feasible initial point, and customize the algorithmic framework to solve several important application problems. Simulations show that the CSSCA algorithm can achieve superior performance over existing solutions.

Unweighted Stochastic Local Search can be Effective for Random CSP Benchmarks

More efficient stochastic local search for satisfiability

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

On the Effect of Learned Clauses on Stochastic Local Search

An Efficient Implementation for WalkSAT

Deterministic Counting Lovász Local Lemma Beyond Linear Programming

Efficient Constraint Generation for Stochastic Shortest Path Problems

NLocalSAT: Boosting Local Search with Solution Prediction

Sampling Constraint Satisfaction Solutions in the Local Lemma Regime

Using deep learning to construct stochastic local search SAT solvers with performance bounds

Local algorithms and the failure of log-depth quantum advantage on sparse random CSPs

Phase transition for Local Search on planted SAT

Rethinking the Soft Conflict Pseudo Boolean Constraint on MaxSAT Local Search Solvers

Adapting Stochastic Search For Real-time Dynamic Weighted Constraint Satisfaction

Stochastic Local Search Using the Search Space Smoothing Meta-Heuristic: A Case Study.

Learning Variable Ordering Heuristics for Solving Constraint Satisfaction Problems

Improving probability selection based weights for satisfiability problems

Improving the Performance of Stochastic Local Search for Maximum Vertex Weight Clique Problem Using Programming by Optimization

Finding Unsatisfiable Subformulas With Stochastic Method

Appendix A . A Bernoulli Factory for Margin Overflow 39 Appendix B . Monotonicity of Constraint Properties 41 Appendix C . { 2 , 3 }-tree Witness for Constraint Properties

Counting-Based Search: Branching Heuristics for Constraint Satisfaction Problems