Abstract:In this paper, we study a class of deterministically constrained stochastic optimization problems. Existing methods typically aim to find an $\epsilon$-stochastic stationary point, where the expected violations of both constraints and first-order stationarity are within a prescribed accuracy $\epsilon$. However, in many practical applications, it is crucial that the constraints be nearly satisfied with certainty, making such an $\epsilon$-stochastic stationary point potentially undesirable due to the risk of significant constraint violations. To address this issue, we propose single-loop variance-reduced stochastic first-order methods, where the stochastic gradient of the stochastic component is computed using either a truncated recursive momentum scheme or a truncated Polyak momentum scheme for variance reduction, while the gradient of the deterministic component is computed exactly. Under the error bound condition with a parameter $\theta \geq 1$ and other suitable assumptions, we establish that these methods respectively achieve a sample and first-order operation complexity of $\widetilde O(\epsilon^{-\max\{\theta+2, 2\theta\}})$ and $\widetilde O(\epsilon^{-\max\{4, 2\theta\}})$ for finding a stronger $\epsilon$-stochastic stationary point, where the constraint violation is within $\epsilon$ with certainty, and the expected violation of first-order stationarity is within $\epsilon$. For $\theta=1$, these complexities reduce to $\widetilde O(\epsilon^{-3})$ and $\widetilde O(\epsilon^{-4})$ respectively, which match, up to a logarithmic factor, the best-known complexities achieved by existing methods for finding an $\epsilon$-stochastic stationary point of unconstrained smooth stochastic optimization problems.

Complexity of Zeroth- and First-order Stochastic Trust-Region Algorithms

First- and Second-Order High Probability Complexity Bounds for Trust-Region Methods with Noisy Oracles

A Fully Stochastic Second-Order Trust Region Method

Sample Complexity Analysis for Adaptive Optimization Algorithms with Stochastic Oracles

Trust-Region Stochastic Optimization with Variance Reduction Technique

Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models

Trust Region Methods for Nonconvex Stochastic Optimization Beyond Lipschitz Smoothness

Stochastic Trust-Region Algorithm in Random Subspaces with Convergence and Expected Complexity Analyses

Global Convergence of a Stochastic Levenberg–Marquardt Algorithm Based on Trust Region

Adaptive Sampling-Based Bi-Fidelity Stochastic Trust Region Method for Derivative-Free Stochastic Optimization

Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithm

Stochastic Optimization for Nonconvex Problem with Inexact Hessian Matrix, Gradient, and Function

On complexity constants of linear and quadratic models for derivative-free trust-region algorithms

A RETROSPECTIVE TRUST REGION ALGORITHM WITH TRUST REGION CONVERGING TO ZERO

Improving Sample Efficiency of Model-Free Algorithms for Zero-Sum Markov Games

Fully stochastic trust-region methods with Barzilai-Borwein steplengths

The Sample Complexity Of ERMs In Stochastic Convex Optimization

Convergence of trust-region algorithms in compact metric spaces

Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees

Zeroth-order Asynchronous Doubly Stochastic Algorithm with Variance Reduction.