Iteratively Regularized Gradient Tracking Methods for Optimal Equilibrium Seeking

Yuyang Qiu,Farzad Yousefian,Brian Zhang

2024-11-28

Abstract:In noncooperative Nash games, equilibria are often inefficient. This is exemplified by the Prisoner's Dilemma and was first provably shown in the 1980s. Since then, understanding the quality of Nash equilibrium (NE) received considerable attention, leading to the emergence of inefficiency measures characterized by the best or the worst equilibrium. Traditionally, computing an optimal NE in monotone regimes is done through two-loop schemes which lack scalability and provable performance guarantees. The goal in this work lies in the development of among the first single-timescale distributed gradient tracking optimization methods for optimal NE seeking over networks. Our main contributions are as follows. By employing a regularization-based relaxation approach within two existing distributed gradient tracking methods, namely Push-Pull and DSGT, we devise and analyze two single-timescale iteratively regularized gradient tracking algorithms. The first method addresses computing the optimal NE over directed networks, while the second method addresses a stochastic variant of this problem over undirected networks. For both methods, we establish the convergence to the optimal NE and derive new convergence rate statements for the consensus error of the generated iterates. We provide preliminary numerical results on a Nash-Cournot game.

Optimization and Control

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in non - cooperative Nash games, how to find the optimal Nash equilibrium (NE) in a network environment through the distributed gradient - tracking optimization method, especially under the monotonicity condition. Traditional methods for calculating the optimal NE usually involve two - layer loop schemes, which lack scalability and performance guarantees. Therefore, this research aims to develop a single - time - scale distributed gradient - tracking optimization method to overcome these problems and provide a method for calculating the global optimal solution.

### Problem Background and Motivation

1. **Inefficient Equilibrium in Non - cooperative Nash Games**
- Nash equilibrium (NE) is usually inefficient in non - cooperative games, which was first proven in the 1980s (such as the Prisoner's Dilemma). Since then, understanding the quality of Nash equilibrium has become a research hotspot.

2. **Limitations of Traditional Methods**
- Traditional methods calculate the optimal NE under monotonic conditions through two - layer loop schemes, but these methods lack scalability and performance guarantees. Especially in the presence of uncertainty, the computational complexity is high and it is difficult to obtain accurate solutions.

### Research Objectives

- **Develop a Single - Time - Scale Distributed Gradient - Tracking Optimization Method**
- The objective of this research is to develop a new single - time - scale distributed gradient - tracking optimization method for finding the optimal NE in a network environment. Specifically, the author proposes two iterative regularized gradient - tracking algorithms: one is suitable for directed networks, and the other is a stochastic variant suitable for undirected networks.

### Main Contributions

1. **Application of Iterative Regularization Method**
- By introducing regularization techniques into existing distributed gradient - tracking methods (such as Push - Pull and DSGT), the author designs and analyzes two single - time - scale iterative regularized gradient - tracking algorithms.

2. **Convergence and Convergence Rate**
- For these two methods, the author establishes theoretical results on convergence to the optimal NE and derives new statements on the consensus error convergence rate.

3. **Preliminary Numerical Experiments**
- Provides preliminary numerical experiment results on the Nash - Cournot game, verifying the effectiveness of the proposed method.

### Formula Representation

- **VI Problem Definition**
\[
\text{SOL}(X, F)\triangleq\{x\in X\mid F(x)^{\top}(y - x)\geq0,\forall y\in X\}
\]

- **Optimization Problem Form**
\[
\min_{x\in\mathbb{R}^n}\sum_{i = 1}^m f_i(x)\quad\text{s.t.}\quad x\in\text{SOL}\left(X,\sum_{i = 1}^m F_i\right)
\]

- **Tikhonov Trajectory**
\[
x^*_{\lambda_k}=\arg\min_{x\in\text{SOL}(\mathbb{R}^n, F+\lambda_k\nabla f)} f(x)
\]

Through these formulas and methods, this research provides new ideas and tools for efficiently calculating the optimal Nash equilibrium in a distributed network environment.