Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

Hierarchical Nash Equilibrium Seeking for Optimal Fault-Tolerant Formation Control of Networked MSVs in Aggregative Games

Distributed fixed-time Nash equilibrium seeking algorithm for multiple ASVs: A hybrid event-triggered approach

Formation Tracking Control for Networked Heterogeneous MSV Systems with Actuator Faults: A Distributed Optimal Event-Triggered Fixed-Time Sliding Mode Fault-Tolerant Control Approach

Learning‐based hierarchical control for fault‐tolerant cooperation of networked marine surface vehicles

Cooperative Time-Varying Formation Fuzzy Tracking Control of Multiple Heterogeneous Uncertain Marine Surface Vehicles with Actuator Failures.

Adaptive Fault-Tolerant Fuzzy Containment Control for Networked Autonomous Surface Vehicles: A Noncooperative Game Approach

Distributed Fixed-Time Optimal Formation Control of Networked Marine Surface Vehicles with External Disturbances

Distributed Formation Control with Open-Loop Nash Strategy

Distributed Fault Tolerant Control for Multi-Agent Systems with Sensor Faults in Non-Cooperative Games

Distributed Adaptive Fault-Tolerant Formation Control for Heterogeneous Multiagent Systems With Communication Link Faults

Distributed Adaptive Formation Control of MSVs with Prescribed Performance under Undirected Graph

Robust Fault-Tolerant Formation Maneuver Control for Multiagent Systems With Mismatched Disturbances

Distributed fault‐tolerant parallel formation control of underactuated marine surface vehicles with limited control input

Distributed fault-tolerant time-varying formation control for high-order linear multi-agent systems with actuator failures

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Position constrained adaptive time-varying formation control of autonomous surface vessels with uncertain dynamics

Distributed fault‐tolerant time‐varying formation control of heterogeneous multi‐agent systems

Distributed Fault-Tolerant Time-Varying Formation Control for Second-Order Multi-Agent Systems With Actuator Failures and Directed Topologies

Adaptive Cooperative Formation Control of Autonomous Surface Vessels with Uncertain Dynamics and External Disturbances

Formation Control with Feedback Nash Strategy for Multiple Unmanned Aerial Vehicles in Unknown Environments

Robust Adaptive Formation Tracking of Autonomous Surface Vehicles with Guaranteed Performance and Actuator Faults