Abstract:In the framework of real Hilbert spaces, we investigate first-order dynamical systems governed by monotone and continuous operators. We demonstrate that when the monotone operator flow is augmented with a Tikhonov regularization term, the resulting trajectory converges strongly to the element of the set of zeros with minimal norm. In addition, rates of convergence in norm for the trajectory's velocity and the operator along the trajectory can be derived in terms of the regularization function. In some particular cases, these rates of convergence can outperform the ones of the coercive operator flows and can be as fast as $O(\frac{1}{t})$ as $t \rightarrow +\infty$. In this way, we emphasize a surprising acceleration feature of the Tikhonov regularization. Additionally, we explore these properties for monotone operator flows that incorporate time rescaling and an anchor point and show that they are closely linked to second-order dynamics with a vanishing damping term. The convergence and convergence rate results we achieve for these systems complement recent findings for the Fast Optimistic Gradient Descent Ascent (OGDA) dynamics. When the monotone operator is defined as the identity minus a nonexpansive operator, the monotone equations transform into a fixed point problem. In such cases, explicitly discretizing the system with Tikhonov regularization, enhanced by an anchor point, leads to the Halpern fixed point iteration. We identify two regimes for the regularization sequence which ensure that the generated sequence of iterates converges strongly to the fixed point nearest to the anchor point. Furthermore, we establish a general theoretical framework that provides convergence rates for the vanishing of the discrete velocity and the fixed point residual. For certain regularization sequences, we derive specific convergence rates that align with those observed in continuous time.

Contraction of Riccati flows applied to the convergence analysis of a max-plus curse of dimensionality free method

On a Complex Hessian Flow

The Exponential Convergence of the CR Yamabe Flow

Flow by Gauss Curvature to the Aleksandrov and Dual Minkowski Problems

Asymptotic Convergence for a Class of Fully Nonlinear Curvature Flows

On the Convergence of the Accelerated Riccati Iteration Method.

Gradient descent for unbounded convex functions on Hadamard manifolds and its applications to scaling problems

Minimizing movements for the generalized power mean curvature flow

Non-collapsing, non-inflating and convergence results for solutions to Ricci flow with $L^{p}$ bounded scalar curvature

On the Hamilton-Lott conjecture in higher dimensions

Further details of “ Space of Ricci flows ( II ) ”

Matrix Li-Yau-Hamilton estimates under Ricci Flow and parabolic frequency

Tikhonov regularization of monotone operator flows not only ensures strong convergence of the trajectories but also speeds up the vanishing of the residuals

Ricci flow on K\"ahler-Einstein manifolds

Weighted combinatorial Ricci flow and metrics defined by degenerate circle packings

Contraction and Convergence Rates for Discretized Kinetic Langevin Dynamics

Preconditioned flow as a solution to the hierarchical growth problem in the generalized Lefschetz thimble method

Matrix Li–Yau–Hamilton estimates under Ricci flow and parabolic frequency

Complex Nonsymmetric Algebraic Riccati Equations Arising In Markov Modulated Fluid Flows

Stability of the heat flow under convergence in concentration and consequences