Abstract:To solve non-smooth convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one being differentiable and the other potentially non-smooth. We then use stochastic differential inclusions where the drift term is minus the subgradient of the objective function, and the diffusion term is either bounded or square-integrable. In this context, under Lipschitz's continuity of the differentiable term and a growth condition of the non-smooth term, our first main result shows almost sure weak convergence of the trajectory process towards a minimizer of the objective function. Then, using Tikhonov regularization with a properly tuned vanishing parameter, we can obtain almost sure strong convergence of the trajectory towards the minimum norm solution. We find an explicit tuning of this parameter when our objective function satisfies a local error-bound inequality. We also provide a comprehensive complexity analysis by establishing several new pointwise and ergodic convergence rates in expectation for the convex and strongly convex case.

Iterative methods for constrained convex minimization problem in Hilbert spaces

Projection and contraction method with double inertial steps for quasi-monotone variational inequalities

An asymptotical regularization with convex constraints for inverse problems

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

Extrapolated Sequential Constraint Method for Variational Inequality over the Intersection of Fixed-Point Sets

Strong convergence of new iterative projection methods with regularization for solving monotone variational inequalities in Hilbert spaces

A HYBRID CONJUGATE GRADIENT METHOD FOR UNCONSTRAINED OPTIMIZATION WITH APPLICATION

New Three-Step Iterative Method for Solving Mixed Variational Inequalities

Fast hybrid method for solving variational inequalities beyond monotonicity in real Banach spaces

A hybrid inexact regularized Newton and negative curvature method

The Hill Detouring Method for Minimizing Hinging Hyperplanes Functions.

Novel Accelerated Cyclic Iterative Approximation for Hierarchical Variational Inequalities Constrained by Multiple-Set Split Common Fixed-Point Problems

An explicit spectral Fletcher–Reeves conjugate gradient method for bi-criteria optimization

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

A new algorithm for approximating solutions of the common variational inclusion

An Iterative Method for Solving the Multiple-Sets Split Variational Inequality Problem

Convergence of two-step inertial Tseng's extragradient methods for quasimonotone variational inequality problem

Easily implementable iterative methods for variational inequalities with nonlinear diffusion–convection operator and constraints to the gradient of solution

A Descent Method for Nonsmooth Multiobjective Optimization in Hilbert Spaces

Strong and linear convergence of projection-type method with an inertial term for finding minimum-norm solutions of pseudomonotone variational inequalities in Hilbert spaces

A New Hybrid Descent Algorithm for Large-Scale Nonconvex Optimization and Application to Some Image Restoration Problems