Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

Leadership Hierarchy-based Formation Control Via Adaptive Chaotic Pigeon-inspired Optimization

Formation Control of Multi-UAV Systems with Time and Angle Constraints

Low-complexity Formation Control of Marine Vehicle System Based on Prescribed Performance

A Framework for Optimized Topology Design and Leader Selection in Affine Formation Control

Model Predictive Flocking Control for Second-Order Multi-Agent Systems with Input Constraints

A Multi-agent Formation Control Algorithm in Interference Environment

Adaptive leader-follower formation control for autonomous mobile robots

Distributed Formation Navigation of Constrained Second-Order Multiagent Systems with Collision Avoidance and Connectivity Maintenance

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

Leader-following Formation Control Based on Pursuit Strategies

A distributed predictive formation control strategy for cyber-physical multi-agent systems under communication constraints

Adaptive Time-Varying Formation Maneuvering Control for Multi-Robot Systems in Complex Obstacle-Rich Environments

Learning-Based Multi-Robot Formation Control With Obstacle Avoidance

Finite-time formation control for multi-agent systems

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Directed Formation Control Using Distance and Angle in Local Coordinate Frameworks

Integrated Optimal Formation Control of Multiple Unmanned Aerial Vehicles

Formation control with pole placement for multi-agent systems

Multiagent Flocking with Angle-Based Formation Shape Control

An output formation consensus control for leader–follower networked multi‐agent systems under communication constraints and switching topologies

Adaptive neural formation control for underactuated unmanned surface vehicles with collision and connectivity constraints