Abstract:For min-max optimization and variational inequalities problems (VIP) encountered in diverse machine learning tasks, Stochastic Extragradient (SEG) and Stochastic Gradient Descent Ascent (SGDA) have emerged as preeminent algorithms. Constant step-size variants of SEG/SGDA have gained popularity, with appealing benefits such as easy tuning and rapid forgiveness of initial conditions, but their convergence behaviors are more complicated even in rudimentary bilinear models. Our work endeavors to elucidate and quantify the probabilistic structures intrinsic to these algorithms. By recasting the constant step-size SEG/SGDA as time-homogeneous Markov Chains, we establish a first-of-its-kind Law of Large Numbers and a Central Limit Theorem, demonstrating that the average iterate is asymptotically normal with a unique invariant distribution for an extensive range of monotone and non-monotone VIPs. Specializing to convex-concave min-max optimization, we characterize the relationship between the step-size and the induced bias with respect to the Von-Neumann's value. Finally, we establish that Richardson-Romberg extrapolation can improve proximity of the average iterate to the global solution for VIPs. Our probabilistic analysis, underpinned by experiments corroborating our theoretical discoveries, harnesses techniques from optimization, Markov chains, and operator theory.

Method with batching for stochastic finite-sum variational inequalities in non-Euclidean setting

Method with Batching for Stochastic Finite-Sum Variational Inequalities in Non-Euclidean Setting

Optimal Analysis of Method with Batching for Monotone Stochastic Finite-Sum Variational Inequalities

High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variance

Methods for Solving Variational Inequalities with Markovian Stochasticity

A New Algorithm for Stochastic Variational Inequality with an Application

Improved Variance Reduction Extragradient Method with Line Search for Stochastic Variational Inequalities.

Variance-reduction for Variational Inequality Problems with Bregman Distance Function

Two Novel Algorithms for Solving Variational Inequality Problems Governed by Fixed Point Problems and Their Applications

Sample Average Approximation Method for a Class of Stochastic Variational Inequality Problems.

Universal methods for variational inequalities: deterministic and stochastic cases

Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization

Methods for Optimization Problems with Markovian Stochasticity and Non-Euclidean Geometry

Adaptive Methods or Variational Inequalities with Relatively Smooth and Reletively Strongly Monotone Operators

Stochastic Methods in Variational Inequalities: Ergodicity, Bias and Refinements

Iterative Algorithms for Variational Inequality and Equilibrium Problems with Applications.

On quasi-inertial double extragradient-type iterations for variational inequalities and Bregman relatively asymptotically nonexpansive mapping

An Inexact Variance-Reduced Method For Stochastic Quasi-Variational Inequality Problems With An Application In Healthcare

Approximating Common Solutions of Variational Inequalities by Iterative Algorithms with Applications

Global Convergence of an Inexact Operator Splitting Method for Monotone Variational Inequalities