Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

Distributed hierarchical MPC based on evolutionary game for formation control with collision and obstacle avoidance

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Multi-Agent Formation Control With Obstacle Avoidance Based On Receding Horizon Strategy

Tracking and Formation of Multi-agent Systems with Collision and Obstacle Avoidance Based on Distributed RHC

Decentralized Flocking Of Multi-Agent System Based On Mpc With Obstacle/Collision Avoidance

Robust Distributed Model Predictive Control for Formation Tracking of Nonholonomic Vehicles

A Synthesis Approach of Distributed Model Predictive Control for Homogeneous Multi-Agent System with Collision Avoidance.

Distributed Formation Navigation of Constrained Second-Order Multiagent Systems with Collision Avoidance and Connectivity Maintenance

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Multi-Agent Path Planning based on MPC and DDPG

Distributed MPC for Tracking and Formation of Homogeneous Multi‐agent System with Time‐Varying Communication Topology

Formation and Obstacle Avoidance Control for Multiagent Systems

Distributed game strategy for unmanned aerial vehicle formation with external disturbances and obstacles

A distributed predictive formation control strategy for cyber-physical multi-agent systems under communication constraints

A distributed model predictive control scheme for leader–follower multi-agent systems

Distributed Model Predictive Control for Multi‐agent Flocking Via Neighbor Screening Optimization

Optimized bipartite formation control for multiagent systems with obstacle and collision avoidance

Formation Control and Obstacle Avoidance for Multi-Agent Systems Based on Virtual Leader-Follower Strategy

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

Hybrid Distributed Model Predictive Control Using Dynamic Cooperation

Distributed MPC for Trajectory Tracking and Formation Control of Multi-UAVs With Leader-Follower Structure