Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

Distributed Formation Control for a Class of Human-in-the-Loop Multiagent Systems

Behavior Learning Based Distributed Tracking Control for Human-in-the-Loop Multi-Agent Systems

Adaptive Distributed Tracking Control for Markov Jump Multiagent Systems with a Non-Strict Leader

HiTL-based adaptive fuzzy tracking control of MASs: A distributed fixed-time strategy

Human-in-the-Loop Formation-Containment Control for Multiagent Systems: An Observer-Based Distributed Unknown Input Reconstruction Method

Practical Optimal Formation-Containment Tracking Control of Nonlinear Multiagent Systems With Unknown Dynamics

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Affine Formation Control for Heterogeneous Multi-Agent Systems with Directed Interaction Networks

Proactive cooperative consensus control for a class of human-in-the-loop multi-agent systems with human time-delays

Leader-Follower Formation Learning Control of Discrete-Time Nonlinear Multiagent Systems

Human-in-the-Loop Consensus Control for Multiagent Systems With External Disturbances

Distributed H(Infinity) Formation Control For Discrete-Time Multi-Agent Systems

Distributed H∞ formation control for discrete-time multiagent systems

Synthesis With Guaranteed Cost and Less Human Intervention for Human-in-the-Loop Control Systems

Distributed Adaptive Formation Tracking Control under Fixed and Switching Topologies: Application on General Linear Multi-Agent Systems

Discrete-Time Stress Matrix-Based Formation Control of General Linear Multi-Agent Systems

Formation Control of Heterogeneous Discrete-Time Nonlinear Multi-Agent Systems with Uncertainties

Distributed Leader-Follower Affine Formation Maneuver Control for High-Order Multiagent Systems

Formation Control for High-Order Linear Time-Invariant Multi-Agent Systems with Time Delays

Fully Distributed Formation Tracking for High-order Nonlinear Multi-agent Systems with Heterogeneous Uncertainties

Linear Formation Control of Multi-Agent Systems