Abstract:The monotone Variational Inequality (VI) is a general model with important applications in various engineering and scientific domains. In numerous instances, the VI problems are accompanied by function constraints that can be data-driven, making the usual projection operator challenging to compute. This paper presents novel first-order methods for the function-constrained Variational Inequality (FCVI) problem in smooth or nonsmooth settings with possibly stochastic operators and constraints. We introduce the AdOpEx method, which employs an operator extrapolation on the KKT operator of the FCVI in a smooth deterministic setting. Since this operator is not uniformly Lipschitz continuous in the Lagrange multipliers, we employ an adaptive two-timescale algorithm leading to bounded multipliers and achieving the optimal $O(1/T)$ convergence rate. For the nonsmooth and stochastic VIs, we introduce design changes to the AdOpEx method and propose a novel P-OpEx method that takes partial extrapolation. It converges at the rate of $O(1/\sqrt{T})$ when both the operator and constraints are stochastic or nonsmooth. This method has suboptimal dependence on the noise and Lipschitz constants of function constraints. We propose a constraint extrapolation approach leading to the OpConEx method that improves this dependence by an order of magnitude. All our algorithms easily extend to saddle point problems with function constraints that couple the primal and dual variables while maintaining the same complexity results. To the best of our knowledge, all our complexity results are new in the literature

Convergence Analysis of Non-Strongly-Monotone Stochastic Quasi-Variational Inequalities

Nonconvex quasi-variational inequalities: stability analysis and application to numerical optimization

An Inexact Variance-Reduced Method For Stochastic Quasi-Variational Inequality Problems With An Application In Healthcare

Quantitative Stability Analysis of Stochastic Quasi-Variational Inequality Problems and Applications

CONVERGENCE ANALYSIS OF A QUASI-NEWTONALGORITHM FOR VARIATIONAL INEQUALITY PROBLEMS WITH BOUND CONSTRAINTS

A Projection-Based Algorithm for Solving Stochastic Inverse Variational Inequality Problems

Some iterative algorithms for solving mixed variational inequalities

Convergence Analysis of Projection Method for Variational Inequalities

Beyond Monotone Variational Inequalities: Solution Methods and Iteration Complexities

Solving quasimonotone and non-monotone variational inequalities

Convergence of an Iterative Algorithm for Systems of Variational Inequalities and Nonexpansive Mappings with Applications

A Class of Quasi-Variational Inequalities with Unbounded Constraint Maps: Existence Results and Applications

Convergence Analysis For Non Linear System Of Parabolic Variational Inequalities

A reconsideration on convergence of the extra-gradient method for solving quasimonotone variational inequalities

Existence of Solutions and Convergence Analysis for a System of Quasivariational Inclusions in Banach Spaces

Strong convergence theorems by an extragradient-like approximation methods for quasi-variational inequalities

Strong convergence of an inertial iterative algorithm for variational inequality problem, generalized equilibrium problem, and fixed point problem in a Banach space

Convergence Properties of Feasible Descent Methods for Solving Variational Inequalities in Banach Spaces

Weak Convergence of Iterative Methods for Solving Quasimonotone Variational Inequalities

New approximation methods for solving quasi-monotone variational inequalities

First-order methods for Stochastic Variational Inequality problems with Function Constraints