Abstract:To solve non-smooth convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one being differentiable and the other potentially non-smooth. We then use stochastic differential inclusions where the drift term is minus the subgradient of the objective function, and the diffusion term is either bounded or square-integrable. In this context, under Lipschitz's continuity of the differentiable term and a growth condition of the non-smooth term, our first main result shows almost sure weak convergence of the trajectory process towards a minimizer of the objective function. Then, using Tikhonov regularization with a properly tuned vanishing parameter, we can obtain almost sure strong convergence of the trajectory towards the minimum norm solution. We find an explicit tuning of this parameter when our objective function satisfies a local error-bound inequality. We also provide a comprehensive complexity analysis by establishing several new pointwise and ergodic convergence rates in expectation for the convex and strongly convex case.

Stability and regularization for ill-posed Cauchy problem of a stochastic parabolic differential equation

Stability and regularization for ill-posed Cauchy problem of a stochastic parabolic differential equation

An inverse Cauchy problem of a stochastic hyperbolic equation

Stability and Regularization of a Discrete Approximation to the Cauchy Problem for Laplace's Equation

A kind regularization method with Poisson kernel to solve Cauchy problem of Schrödinger equation

A Modified Tikhonov Regularization Method for a Cauchy Problem of a Time Fractional Diffusion Equation

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption

Cauchy Problem of Stochastic Kinetic Equations

A variational regularization method for solving the non-characteristic Cauchy problem in multiple dimensions

Well-posedness and Tikhonov regularization of an inverse source problem for a parabolic equation with an integral constraint

Regularization with two differential operators and its application to inverse problems

Carleman Estimate for Stochastic Parabolic Equations and Inverse Stochastic Parabolic Problems

Generalized Tikhonov regularization method for an inverse boundary value problem of the fractional elliptic equation

Method of fundamental solutions with an optimal regularization technique for the Cauchy problem of the modified Helmholtz equation

The Index Function and Tikhonov Regularization for Ill-Posed Problems

Stability estimate for an inverse stochastic parabolic problem of determining unknown time-varying boundary

Tikhonov regularization for simultaneous inversion of initial value and source term of a time‐fractional Black‐Scholes equation

Determination the Solution of a Stochastic Parabolic Equation by the Terminal Value

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

Regularized solutions for some backward nonlinear parabolic equations with statistical data

Carleman estimates for space semi-discrete approximations of one-dimensional stochastic parabolic equation and its applications