Abstract:The monotone Variational Inequality (VI) is a general model with important applications in various engineering and scientific domains. In numerous instances, the VI problems are accompanied by function constraints that can be data-driven, making the usual projection operator challenging to compute. This paper presents novel first-order methods for the function-constrained Variational Inequality (FCVI) problem in smooth or nonsmooth settings with possibly stochastic operators and constraints. We introduce the AdOpEx method, which employs an operator extrapolation on the KKT operator of the FCVI in a smooth deterministic setting. Since this operator is not uniformly Lipschitz continuous in the Lagrange multipliers, we employ an adaptive two-timescale algorithm leading to bounded multipliers and achieving the optimal $O(1/T)$ convergence rate. For the nonsmooth and stochastic VIs, we introduce design changes to the AdOpEx method and propose a novel P-OpEx method that takes partial extrapolation. It converges at the rate of $O(1/\sqrt{T})$ when both the operator and constraints are stochastic or nonsmooth. This method has suboptimal dependence on the noise and Lipschitz constants of function constraints. We propose a constraint extrapolation approach leading to the OpConEx method that improves this dependence by an order of magnitude. All our algorithms easily extend to saddle point problems with function constraints that couple the primal and dual variables while maintaining the same complexity results. To the best of our knowledge, all our complexity results are new in the literature

Optimality conditions for solutions of constrained inverse vector variational inequalities by means of nonlinear scalarization

Vector Variational-Like Inequalities with Constraints: Separation and Alternative

Scalarizations and Optimality of Constrained Set-Valued Optimization Using Improvement Sets and Image Space Analysis

Variational Inequalities for Set-Valued Vector Fields on Riemannian Manifolds: Convexity of the Solution Set and the Proximal Point Algorithm.

Existence of Solutions for Variational Inequalities on Riemannian Manifolds

Nonlinear scalarization in set optimization based on the concept of null set

Nonlinear scalarizations in set optimization with variable ordering structures and applications

Optimality-based domain reduction for inequality-constrained NLP and MINLP problems

A Variational Inequality Approach to Optimal Control Problems with Joint Constraints.

Extended Newton-type Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

Existence of Weak Efficient Solutions of Set-Valued Optimization Problems

Parallel inertial forward–backward splitting methods for solving variational inequality problems with variational inclusion constraints

Vector optimization problems with weakened convex and weakened affine constraints in linear topological spaces

Solutions for the Nonlinear Mixed Variational Inequality Problem in the System

The Continuity and Convexity of a Nonlinear Scalarization Function with Applications in Set Optimization Problems Involving a Partial Order Relation

Optimality Conditions of Strict Minimality in Optimization Problems under Inclusion Constraints.

Bishop-Phelps Type Scalarization for Vector Optimization in Real Topological-Linear Spaces

Charnes-Cooper Scalarization and Convex Vector Optimization

Optimality conditions for the nonlinear programming problems on Riemannian manifolds

First-order methods for Stochastic Variational Inequality problems with Function Constraints

Unconstrained Optimization Method for Solving Linear Inequalities