Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

Multi-leader Multi-Follower Game-Based ADMM for Big Data Processing

Game Theory for Big Data Processing: Multileader Multifollower Game-Based ADMM

Bridge the Gap Between ADMM and Stackelberg Game: Incentive Mechanism Design for Big Data Networks.

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Improved Hierarchical ADMM for Nonconvex Cooperative Distributed Model Predictive Control

Distributed ADMM for Time-Varying Communication Networks

Online Parallel Multi-Task Relationship Learning via Alternating Direction Method of Multipliers

Adaptive dynamic programming-based hierarchical decision-making of non-affine systems

Distributed Adaptive Flocking Control for Large-Scale Multiagent Systems

Decentralized Optimal Tracking Control for Large-scale Multi-Agent Systems under Complex Environment: A Constrained Mean Field Game with Reinforcement Learning Approach

A Multi-Population Mean-Field Game Approach for Large-Scale Agents Cooperative Attack-Defense Evolution in High-Dimensional Environments

A Hierarchical Distributed Data-Driven Adaptive Learning Control for Nonaffine Nonlinear MASs

Sampled-data based adaptive mean field games for leader-follower stochastic multi-agent systems

Optimal Leader-Following Consensus Control of Multi-Agent Systems: A Neural Network Based Graphical Game Approach

A Multi-Leader Multi-Follower Stackelberg Game for Coalition-Based UAV MEC Networks

Coded Stochastic ADMM for Decentralized Consensus Optimization With Edge Computing

Decentralized optimal large scale multi-player pursuit-evasion strategies: A mean field game approach with reinforcement learning

Optimal Distributed Leader-Following Consensus of Linear Multi-Agent Systems: A Dynamic Average Consensus-Based Approach

Distributed Stackelberg Equilibrium Seeking for Networked Multi-Leader Multi-Follower Games with A Clustered Information Structure

Two-block vs. Multi-block ADMM: An empirical evaluation of convergence