Abstract:While Variational Inequality (VI) is a well-established mathematical framework that subsumes Nash equilibrium and saddle-point problems, less is known about its extension, Quasi-Variational Inequalities (QVI). QVI allows for cases where the constraint set changes as the decision variable varies allowing for a more versatile setting. In this paper, we propose extra-gradient and gradient-based methods for solving a class of monotone Stochastic Quasi-Variational Inequalities (SQVI) and establish a rigorous convergence rate analysis for these methods. Our approach not only advances the theoretical understanding of SQVI but also demonstrates its practical applicability. Specifically, we highlight its effectiveness in reformulating and solving problems such as generalized Nash Equilibrium, bilevel optimization, and saddle-point problems with coupling constraints.
What problem does this paper attempt to address?
### What problem does this paper attempt to solve?
This paper aims to solve the convergence analysis problem of non - strongly monotone Stochastic Quasi - Variational Inequalities (SQVI). Specifically, the paper proposes the extra - gradient method and the gradient - based method for solving a class of monotone SQVI problems, and establishes a strict convergence rate analysis of these methods. These problems are of great significance in practical applications, such as:
1. **Generalized Nash equilibrium problems**: Involving the strategy sets of multiple players depending on the strategies of other players.
2. **Bi - level optimization problems**: One optimization problem is nested in another optimization problem, such as hyper - parameter optimization and meta - learning.
3. **Saddle - point problems with coupling constraints**: Widely exist in machine learning, such as Adversarial Generative Networks (GAN), reinforcement learning, etc.
#### Core contributions of the paper
1. **Propose new methods**: For non - strongly monotone SQVI problems, the extra - gradient method and the gradient - based method are proposed.
2. **Convergence rate analysis**: For the first time, the results of linear convergence rate are established for this type of problems, especially when the operator satisfies the quadratic growth property.
3. **Handle complex constraint sets**: By introducing the approximate projection technique, the challenges brought by the dynamically changing constraint sets are solved.
4. **Combine theory and practice**: Not only promotes the theoretical understanding, but also shows the effectiveness of these methods in practical problems.
#### Specific problem description
The goal of the paper is to find \(x^*\in K(x^*)\) that satisfies the following condition:
\[\langle F(x^*), y - x^*\rangle\geq0,\quad\forall y\in K(x^*)\]
where \(K:X\rightarrow2^X\) is a set - valued mapping with non - empty, closed and convex values, and \(K(x)\subseteq X\), \(X\subseteq\mathbb{R}^n\) is a convex compact set. In addition, \(F(x)\triangleq\mathbb{E}[G(x,\xi)]\), \(\xi:\Omega\rightarrow\mathbb{R}^d\), \(G:X\times\mathbb{R}^d\rightarrow\mathbb{R}^n\), and the associated probability space is represented as \((\Omega,\mathcal{F},P)\).
#### Research background
Although there are rich research results on Variational Inequalities (VI) and their extended Stochastic Variational Inequalities (SVI), the research on Quasi - Variational Inequalities (QVI) is still limited. Most of the existing methods for solving VI are not applicable to SQVI problems, which requires the development of new techniques to solve this problem.
By introducing the extra - gradient method and the gradient - based method, as well as the approximate projection technique, the paper successfully solves the convergence analysis of non - strongly monotone SQVI problems and provides theoretical and practical breakthroughs.