Abstract:The monotone Variational Inequality (VI) is a general model with important applications in various engineering and scientific domains. In numerous instances, the VI problems are accompanied by function constraints that can be data-driven, making the usual projection operator challenging to compute. This paper presents novel first-order methods for the function-constrained Variational Inequality (FCVI) problem in smooth or nonsmooth settings with possibly stochastic operators and constraints. We introduce the AdOpEx method, which employs an operator extrapolation on the KKT operator of the FCVI in a smooth deterministic setting. Since this operator is not uniformly Lipschitz continuous in the Lagrange multipliers, we employ an adaptive two-timescale algorithm leading to bounded multipliers and achieving the optimal $O(1/T)$ convergence rate. For the nonsmooth and stochastic VIs, we introduce design changes to the AdOpEx method and propose a novel P-OpEx method that takes partial extrapolation. It converges at the rate of $O(1/\sqrt{T})$ when both the operator and constraints are stochastic or nonsmooth. This method has suboptimal dependence on the noise and Lipschitz constants of function constraints. We propose a constraint extrapolation approach leading to the OpConEx method that improves this dependence by an order of magnitude. All our algorithms easily extend to saddle point problems with function constraints that couple the primal and dual variables while maintaining the same complexity results. To the best of our knowledge, all our complexity results are new in the literature

Extrapolated Sequential Constraint Method for Variational Inequality over the Intersection of Fixed-Point Sets

A Trust Region-Type Method for Solving Monotone Variational Inequality

An extrapolated fixed-point optimization method for strongly convex smooth optimizations

First-order methods for Stochastic Variational Inequality problems with Function Constraints

Strong convergence of modified inertial extragradient methods for non-Lipschitz continuous variational inequalities and fixed point problems

Modified Extragradient Methods for Solving Variational Inequalities

Extragradient method with feasible inexact projection to variational inequality problem

On Approximating Solutions to Non-monotone Variational Inequality Problems: An Approach Through the Modified Projection and Contraction Method

Mann-type extragradient algorithm for solving variational inequality and fixed point problems

Projection and contraction method with double inertial steps for quasi-monotone variational inequalities

Parallel inertial forward–backward splitting methods for solving variational inequality problems with variational inclusion constraints

Extragradient Method for Variational Inequalities

New Extragradient-Type Methods for Solving Variational Inequalities

A novel method for hierarchical variational inequality with split common fixed point constraint

Novel Accelerated Cyclic Iterative Approximation for Hierarchical Variational Inequalities Constrained by Multiple-Set Split Common Fixed-Point Problems

On the intermixed method for mixed variational inequality problems: another look and some corrections

On quasi-inertial double extragradient-type iterations for variational inequalities and Bregman relatively asymptotically nonexpansive mapping

An accelerated stochastic extragradient-like algorithm with new stepsize rules for stochastic variational inequalities

Primal Methods for Variational Inequality Problems with Functional Constraints

Non-monotonic and self-adaptive strongly convergent iterative methods for efficiently solving variational inequalities with pseudomonotone operators

Generalized Set-valued Nonlinear Variational-like Inequalities and Fixed Point Problems: Existence and Approximation Solvability Results