Abstract:Riemannian convex optimization and minimax optimization have recently drawn considerable attention. Their appeal lies in their capacity to adeptly manage the non-convexity of the objective function as well as constraints inherent in the feasible set in the Euclidean sense. In this work, we delve into monotone Riemannian Variational Inequality Problems (RVIPs), which encompass both Riemannian convex optimization and minimax optimization as particular cases. In the context of Euclidean space, it is established that the last-iterates of both the extragradient (EG) and past extragradient (PEG) methods converge to the solution of monotone variational inequality problems at a rate of $O\left(\frac{1}{\sqrt{T}}\right)$ (Cai et al., 2022). However, analogous behavior on Riemannian manifolds remains an open question. To bridge this gap, we introduce the Riemannian extragradient (REG) and Riemannian past extragradient (RPEG) methods. We demonstrate that both exhibit $O\left(\frac{1}{\sqrt{T}}\right)$ last-iterate convergence. Additionally, we show that the average-iterate convergence of both REG and RPEG is $O\left(\frac{1}{T}\right)$, aligning with observations in the Euclidean case (Mokhtari et al., 2020). These results are enabled by judiciously addressing the holonomy effect so that additional complications in Riemannian cases can be reduced and the Euclidean proof inspired by the performance estimation problem (PEP) technique or the sum-of-squares (SOS) technique can be applied again.

Extragradient Sliding for Composite Non-Monotone Variational Inequalities

Extragradient method with feasible inexact projection to variational inequality problem

New Extragradient-Type Methods for Solving Variational Inequalities

Extragradient Method for Variational Inequalities

An accelerated subgradient extragradient algorithm for solving bilevel variational inequality problems involving non-Lipschitz operator

On the convergence properties of non-Euclidean extragradient methods for variational inequalities with generalized monotone operators

An Accelerated Extragradient Algorithm for Bilevel Pseudomonotone Variational Inequality Problems with Application to Optimal Control Problems

Modified Extragradient Methods for Solving Variational Inequalities

On the Hypomonotone Class of Variational Inequalities

Subgradient extragradient method with double inertial steps for quasi-monotone variational inequalities

Mirror-prox sliding methods for solving a class of monotone variational inequalities

An accelerated stochastic extragradient-like algorithm with new stepsize rules for stochastic variational inequalities

Gradient sliding for composite optimization

The extragradient method for quasi-monotone variational inequalities

A modified subgradient extragradient method with non-monotonic step sizes for solving quasimonotone variational inequalities

Extragradient Type Methods for Riemannian Variational Inequality Problems

On Modified Subgradient Extragradient Methods for Pseudomonotone Variational Inequality Problems with Applications

Extension of the subgradient extragradient algorithm for solving variational inequalities without monotonicity

Double inertial extragradient algorithms for solving variational inequality problems with convergence analysis

Viscosity extragradient algorithms with double inertial extrapolation steps for quasimonotone variational inequalities and fixed point problems

Revisiting Subgradient Extragradient Methods for Solving Variational Inequalities