Abstract:This article studies the generalized Nash equilibrium (GNE) seeking problem of second-integrator multiplayer systems. In particular, each player is endowed with an individual payoff function with respect to collective decision variables, and simultaneously, a coupling inequality constraint and a set constraint are imposed to each player. The players communicate with their local neighbors over a directed topology. To begin with, a distributed-observer-based seeking strategy is synthesized by leveraging a proper composite variable. It is first demonstrated using nonsmooth analysis that the established distributed observer enables each player to accurately estimate the decision variables of others in terms of a strongly connected topology condition. Upon this basis, all the decision variables are then shown to converge to the expected GNE asymptotically borrowing from convex theory. In addition, three extension results are also given under the built GNE seeking framework. First, under the postulation that the velocity information is unavailable, a velocity-free distributed GNE seeking strategy is synthesized for second-integrator systems by implementing a proper auxiliary dynamics. Second, we consider nonlinear Euler-Lagrange systems with unknown inertia parameters and synthesize an improved distributed GNE seeking strategy resorting to an adaptation technique. Third, we focus on integrator chain systems and synthesize a modified distributed GNE seeking strategy using a new composite variable based on a proper coordinate transformation. For three extension cases, we all show in detail the achievement of the GNE seeking objective. Finally, a practical example is simulated to confirm the built GNE seeking results.

Multiplayer Stackelberg-Nash Game for Nonlinear System via Value Iteration-Based Integral Reinforcement Learning

Two-Player Stackelberg Game for Linear System Via Value Iteration Algorithm

Hierarchical Optimal Synchronization for Linear Systems Via Reinforcement Learning: A Stackelberg–Nash Game Perspective

Multiplayer hierarchical decision‐making for discrete‐time nonlinear networks of service via value iteration adaptive dynamic programming

Monte Carlo Neural Fictitious Self-Play: Achieve Approximate Nash equilibrium of Imperfect-Information Games.

Scalable and Independent Learning of Nash Equilibrium Policies in $n$-Player Stochastic Games with Unknown Independent Chains

Sliding-mode surface-based approximate optimal control for nonlinear multiplayer Stackelberg-Nash games via adaptive dynamic programming

Convergence of Learning Dynamics in Stackelberg Games

An efficient model‐free adaptive optimal control of continuous‐time nonlinear non‐zero‐sum games based on integral reinforcement learning with exploration

Empirical Policy Optimization for n-Player Markov Games

Learning Stationary Nash Equilibrium Policies in [math]-Player Stochastic Games with Independent Chains

SLS-BRD: A system-level approach to seeking generalised feedback Nash equilibria

Distributed GNE Seeking Strategy for Second-Integrator Multiplayer Systems Over Directed Topologies

Approximate N-Player Nonzero-Sum Game Solution for an Uncertain Continuous Nonlinear System

Follower Agnostic Methods for Stackelberg Games

Score-Based Equilibrium Learning in Multi-Player Finite Games with Imperfect Information

Distributed Stackelberg Equilibrium Seeking for Networked Multi-Leader Multi-Follower Games with A Clustered Information Structure

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

Nash Equilibrium in Iterated Multiplayer Games Under Asynchronous Best-Response Dynamics

Nash Equilibria for Linear Quadratic Discrete-time Dynamic Games via Iterative and Data-driven Algorithms

Distributed Adaptive Nash Equilibrium Seeking And Disturbance Rejection For Noncooperative Games Of High-Order Nonlinear Systems With Input Saturation And Input Delay