Abstract:In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second-order stationary points. Our method utilizes a random model to represent the objective function, which is constructed from stochastic observations of the objective and is designed to satisfy proper adaptive accuracy conditions with a high but fixed probability. To converge to first-order stationary points, our method computes a gradient step in each iteration defined by minimizing a quadratic approximation of the objective subject to a (relaxed) linear approximation of the problem constraints and a trust-region constraint. To converge to second-order stationary points, our method additionally computes an eigen step to explore the negative curvature of the reduced Hessian matrix, as well as a second-order correction step to address the potential Maratos effect, which arises due to the nonlinearity of the problem constraints. Such an effect may impede the method from moving away from saddle points. Both gradient and eigen step computations leverage a novel parameter-free decomposition of the step and the trust-region radius, accounting for the proportions among the feasibility residual, optimality residual, and negative curvature. We establish global almost sure first- and second-order convergence guarantees for our method, and present computational results on CUTEst problems, regression problems, and saddle-point problems to demonstrate its superiority over existing line-search-based stochastic methods.

A trust-region method for stochastic variational inference with applications to streaming data

Trust-Region Based Stochastic Variational Inference for Distributed and Asynchronous Networks

A Trust-Region Method for Graphical Stein Variational Inference

Streaming Variational Monte Carlo

Bayesian Stochastic Gradient Descent for Stochastic Optimization with Streaming Input Data

Variational Bayesian Inference for Robust Streaming Tensor Factorization and Completion

Learning from time-dependent streaming data with online stochastic algorithms

Importance Sampled Stochastic Optimization for Variational Inference

Global Convergence of a Stochastic Levenberg–Marquardt Algorithm Based on Trust Region

Trust-Region Stochastic Optimization with Variance Reduction Technique

Stochastic Optimization Algorithms for Instrumental Variable Regression with Streaming Data

Stochastic Gradient Descent as Approximate Bayesian Inference

Automated Variational Inference in Probabilistic Programming

Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models

Stochastic Methods in Variational Inequalities: Ergodicity, Bias and Refinements

Variational Approximation of Factor Stochastic Volatility Models

Using Large Ensembles of Control Variates for Variational Inference

Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference

Robust Factorization and Completion of Streaming Tensor Data via Variational Bayesian Inference

Stochastic variance-reduced Gaussian variational inference on the Bures-Wasserstein manifold