Abstract:In the framework of real Hilbert spaces, we investigate first-order dynamical systems governed by monotone and continuous operators. We demonstrate that when the monotone operator flow is augmented with a Tikhonov regularization term, the resulting trajectory converges strongly to the element of the set of zeros with minimal norm. In addition, rates of convergence in norm for the trajectory's velocity and the operator along the trajectory can be derived in terms of the regularization function. In some particular cases, these rates of convergence can outperform the ones of the coercive operator flows and can be as fast as $O(\frac{1}{t})$ as $t \rightarrow +\infty$. In this way, we emphasize a surprising acceleration feature of the Tikhonov regularization. Additionally, we explore these properties for monotone operator flows that incorporate time rescaling and an anchor point and show that they are closely linked to second-order dynamics with a vanishing damping term. The convergence and convergence rate results we achieve for these systems complement recent findings for the Fast Optimistic Gradient Descent Ascent (OGDA) dynamics. When the monotone operator is defined as the identity minus a nonexpansive operator, the monotone equations transform into a fixed point problem. In such cases, explicitly discretizing the system with Tikhonov regularization, enhanced by an anchor point, leads to the Halpern fixed point iteration. We identify two regimes for the regularization sequence which ensure that the generated sequence of iterates converges strongly to the fixed point nearest to the anchor point. Furthermore, we establish a general theoretical framework that provides convergence rates for the vanishing of the discrete velocity and the fixed point residual. For certain regularization sequences, we derive specific convergence rates that align with those observed in continuous time.

On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions

Strong convergence of an inertial Tikhonov regularized dynamical system governed by a maximally comonotone operator

Strong convergence and fast rates for systems with Tikhonov regularization

Tikhonov regularization of monotone operator flows not only ensures strong convergence of the trajectories but also speeds up the vanishing of the residuals

Solving maximally comonotone inclusion problems via an implicit Newton-like inertial dynamical system and its discretization

On the convergence of an inertial proximal algorithm with a Tikhonov regularization term

Inertial dynamics with vanishing Tikhonov regularization for multobjective optimization

Strong convergence towards the minimum norm solution via temporal scaling and Tikhonov approximation of a first-order dynamical system

Fast convergence rates and trajectory convergence of a Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

Strong asymptotic convergence of a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term

A proximal-gradient inertial algorithm with Tikhonov regularization: strong convergence to the minimal norm solution

An asymptotic viscosity selection result for the regularized Newton dynamic

A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique

Tikhonov regularized second-order plus first-order primal-dual dynamical systems with asymptotically vanishing damping for linear equality constrained convex optimization problems

Convergence of Inertial Dynamics Driven by Sums of Potential and Nonpotential Operators with Implicit Newton-Like Damping

Continuous Dynamics Related to Monotone Inclusions and Non-Smooth Optimization Problems

A fast continuous time approach for non-smooth convex optimization with time scaling and Tikhonov regularization

Second Order Dynamics Featuring Tikhonov Regularization and Time Scaling

Fast second-order dynamics with slow vanishing damping approaching the zeros of a monotone and continuous operator

Regularized dynamics for monotone inverse variational inequalities in hilbert spaces