Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

A Hierarchical Distributed Data-Driven Adaptive Learning Control for Nonaffine Nonlinear MASs

Distributed Adaptive Tracking Control for Unknown Nonlinear Networked Systems

Cooperative Tracking Control for Nonlinear MASs under Event-Triggered Communication.

Adaptive Distributed Tracking Control for Markov Jump Multiagent Systems with a Non-Strict Leader

Decentralized Adaptive Control of a Class of Discrete-Time Multi-Agent Systems for Hidden Leader Following Problem

Distributed Synchronization Control of Nonaffine Multiagent Systems with Guaranteed Performance

Distributed Adaptive Fuzzy Coordination Control of Heterogeneous Non-affine Nonlinear Leader-Following Systems Under Unreliable Communication Environments

Behavior Learning Based Distributed Tracking Control for Human-in-the-Loop Multi-Agent Systems

Data-Driven-Based Cooperative Resilient Learning Method for Nonlinear MASs under DoS Attacks.

Leader-Follower Formation Learning Control of Discrete-Time Nonlinear Multiagent Systems

Adaptive coordinated control of networked non-affine nonlinear systems with a non-autonomous nonlinear leader

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Optimal Tracking Control of Heterogeneous MASs Using Event-Driven Adaptive Observer and Reinforcement Learning

Distributed adaptive fixed-time neural networks control for nonaffine nonlinear multiagent systems

Distributed Adaptive Tracking Control of Hidden Leader-Follower Multi-Agent Systems with Unknown Parameters

Nonlinear leader-following MASs control: a data-driven adaptive sliding mode approach with prescribed performance

Event-Triggered Distributed Data-Driven Iterative Learning Bipartite Formation Control for Unknown Nonlinear Multiagent Systems

Fuzzy adaptive event-triggered distributed control for a class of nonlinear multi-agent systems

Adaptive neural consensus tracking control of distributed nonlinear multiagent systems with unmodeled dynamics

Model‐free learning‐based distributed cooperative tracking control of human‐in‐the‐loop multi‐agent systems

Cyclic-Small-Gain Approach to Adaptive Control for Multiagent Systems With Unknown Interconnected Dynamics