Abstract:This paper considers Nash equilibrium seeking for N-cluster noncooperative games in which the explicit expressions of the agents’ local objective functions are not available to the agents. As an alternative, the output values of the agents’ local objective functions are supposed to be measurable. An extremum seeker is designed to achieve the Nash equilibrium seeking for the N-cluster noncooperative games. The design of the extremum seeker is based on a dynamic average consensus protocol and the modulation of the sinusoidal dither signals. Through Lyapunov stability analysis, the convergence results are analytically studied. Local and nonlocal convergence results are derived under local and global characterizations of the Nash equilibrium for the N-cluster noncooperative games, respectively. Compared with our previous works on Nash equilibrium seeking for the N-cluster noncooperative games, the main advantages and characteristics of the proposed method are threefold. Firstly, the proposed method broadens the applicability of the existing Nash equilibrium seeking strategies to circumstances in which the agents cannot access the explicit expressions of their local objective functions. Moreover, the proposed seeking strategy performs as a unified strategy that solves the noncooperative games and the social cost minimization problems without utilizing explicit model information. Secondly, the proposed seeking strategy requires each agent to update fewer auxiliary variables compared with the existing methods and hence reduces the communication and computation costs. Thirdly, different from most of the existing works that adopt singular perturbation to analyze the stability of extremum seekers, this paper establishes the convergence results via Lyapunov stability analysis, which is novel and provides some new insights on the analysis of extremum seekers. A numerical example is provided to verify the effectiveness of the proposed method.

Almost Sure Convergence to Approximate Nash Equilibrium in Zero-Sum Extensive-Form Games with Noisy Feedback

Exponential Convergence of Gradient Methods in Concave Network Zero-sum Games

Second-Order Algorithms for Finding Local Nash Equilibria in Zero-Sum Games

Nash Equilibrium Strategy in Stochastic Non-cooperative Games

Learning Nash Equilibria in Zero-Sum Stochastic Games via Entropy-Regularized Policy Approximation

Towards convergence to Nash equilibria in two-team zero-sum games

Policy Optimization Provably Converges to Nash Equilibria in Zero-Sum Linear Quadratic Games

A Necessary and Sufficient Condition Beyond Monotonicity for Convergence of the Gradient Play in Continuous Games

Convergence of Policy Gradient Methods for Nash Equilibria in General-sum Stochastic Games

Near-Optimal Learning of Extensive-Form Games with Imperfect Information

A Policy-Gradient Approach to Solving Imperfect-Information Games with Iterate Convergence

Learning Zero-Sum Linear Quadratic Games with Improved Sample Complexity and Last-Iterate Convergence

Convergence of $\text{log}(1/ε)$ for Gradient-Based Algorithms in Zero-Sum Games without the Condition Number: A Smoothed Analysis

Consensus‐based and Extremum Seeking Methods for Distributed Generalized Nash Equilibrium

The Computation of Approximate Feedback Stackelberg Equilibria in Multiplayer Nonlinear Constrained Dynamic Games

An Exponentially Converging Particle Method for the Mixed Nash Equilibrium of Continuous Games

Iteratively Regularized Gradient Tracking Methods for Optimal Equilibrium Seeking

Nash equilibrium computation in two-network zero-sum games: An incremental algorithm

Distributed stochastic subgradient-free algorithm for Nash equilibrium seeking in two-network zero-sum games

The computation of approximate feedback Stackelberg equilibria in multi-player nonlinear constrained dynamic games

An Extremum Seeking-Based Approach for Nash Equilibrium Seeking in N-cluster Noncooperative Games.