Distributed Nash Equilibrium Learning for Average Aggregative Games: Harnessing Smoothness to Accelerate the Algorithm.

Wei Pan,Xinli Xu,Yu Lu,Weidong Zhang

DOI: https://doi.org/10.1109/jsyst.2023.3264791

IF: 4.802

2023-01-01

IEEE Systems Journal

Abstract:Convergence speed is one of the most important features of an equilibrium-seeking algorithm. In this article, we address the problem of algorithm acceleration for distributed Nash equilibrium (NE) learning in networked average aggregative games with partial decision information. Harnessing the smoothness of cost functions, we propose a novel accelerated NE learning algorithm by integrating a momentum term into a gradient descent step. We prove that the distributed algorithm converges to the exact Nash equilibrium with constant stepsize by bounding four key consensus error terms. When cost functions are strongly convex and interaction graph is undirected and connected, the proposed algorithm enjoys a linear convergence rate $\mathcal {O}(\rho (\bm {M}(\theta))^{k})$ , $\rho (\bm {M}(\theta))$ is the spectral radius of a parameterized matrix $\bm {M}(\theta)$ ( $\theta$ is stepsize, $k$ is iterations). Simulation results under two different communication graphs show the momentum term does accelerate the algorithm, the iteration numbers of convergence to specific relative error are significantly reduced, up to 80% when the stepsize is small and the graph connectivity is high.