Abstract:Riemannian convex optimization and minimax optimization have recently drawn considerable attention. Their appeal lies in their capacity to adeptly manage the non-convexity of the objective function as well as constraints inherent in the feasible set in the Euclidean sense. In this work, we delve into monotone Riemannian Variational Inequality Problems (RVIPs), which encompass both Riemannian convex optimization and minimax optimization as particular cases. In the context of Euclidean space, it is established that the last-iterates of both the extragradient (EG) and past extragradient (PEG) methods converge to the solution of monotone variational inequality problems at a rate of $O\left(\frac{1}{\sqrt{T}}\right)$ (Cai et al., 2022). However, analogous behavior on Riemannian manifolds remains an open question. To bridge this gap, we introduce the Riemannian extragradient (REG) and Riemannian past extragradient (RPEG) methods. We demonstrate that both exhibit $O\left(\frac{1}{\sqrt{T}}\right)$ last-iterate convergence. Additionally, we show that the average-iterate convergence of both REG and RPEG is $O\left(\frac{1}{T}\right)$, aligning with observations in the Euclidean case (Mokhtari et al., 2020). These results are enabled by judiciously addressing the holonomy effect so that additional complications in Riemannian cases can be reduced and the Euclidean proof inspired by the performance estimation problem (PEP) technique or the sum-of-squares (SOS) technique can be applied again.

Unified Framework of Extragradient-Type Methods for Pseudomonotone Variational Inequalities

New Extragradient-Type Methods for Solving Variational Inequalities

Modified Extragradient Methods for Solving Variational Inequalities

Extragradient method with feasible inexact projection to variational inequality problem

Tseng's extragradient method with double projection for solving pseudomonotone variational inequality problems in Hilbert spaces

Subgradient extragradient method with double inertial steps for quasi-monotone variational inequalities

An accelerated stochastic extragradient-like algorithm with new stepsize rules for stochastic variational inequalities

On quasi-inertial double extragradient-type iterations for variational inequalities and Bregman relatively asymptotically nonexpansive mapping

Extragradient Method for Variational Inequalities

Two subgradient extragradient methods based on the golden ratio technique for solving variational inequality problems

Mann-type extragradient algorithm for solving variational inequality and fixed point problems

Double inertial extragradient algorithms for solving variational inequality problems with convergence analysis

An extra gradient Anderson-accelerated algorithm for pseudomonotone variational inequalities

Extragradient Type Methods for Riemannian Variational Inequality Problems

Viscosity extragradient algorithms with double inertial extrapolation steps for quasimonotone variational inequalities and fixed point problems

Extension of the subgradient extragradient algorithm for solving variational inequalities without monotonicity

An inertial Tseng's extragradient method for solving multi-valued variational inequalities with one projection

Modified inertial extragradient methods for finding minimum-norm solution of the variational inequality problem with applications to optimal control problem

Projection and contraction method with double inertial steps for quasi-monotone variational inequalities

Three novel inertial subgradient extragradient methods for quasi-monotone variational inequalities in Banach spaces

On A New Numerical Method For Solving General Variational Inequalities