Abstract:Here, a novel hierarchical game theoretic algorithm has been developed to provide a feasible theory foundation for solving large‐scale multi‐agent system distributed optimal formation problems by effectively integrating the mean‐field game, the Stackelberg game, and the cooperative game. This algorithm addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. This paper introduces a distributed adaptive formation control for large‐scale multi‐agent systems (LS‐MAS) that addresses the heavy computational complexity and communication traffic challenges while directly extending conventional distributed control from small scale to large scale. Specifically, a novel hierarchical game theoretic algorithm is developed to provide a feasible theory foundation for solving LS‐MAS distributed optimal formation problem by effectively integrating the mean‐field game (MFG), the Stackelberg game, and the cooperative game. In particular, LS‐MAS is divided into multiple groups geographically with each having one group leader and a significant amount of followers. Then, a cooperative game is used among multi‐group leaders to formulate distributed inter‐group formation control for leaders. Meanwhile, an MFG is adopted for a large number of intra‐group followers to achieve the collective intra‐group formation while a Stackelberg game is connecting the followers with their corresponding leader within the same group to achieve the overall LS‐MAS multi‐group formation behavior. Moreover, a hybrid actor–critic‐based reinforcement learning algorithm is constructed to learn the solution of the hierarchical game‐based optimal distributed formation control. Finally, to show the effectiveness of the presented schemes, numerical simulations and Lyapunov analysis is performed.

Distributed Multiscale Formation Optimization for Multiagent Systems

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Distributed Swarm Trajectory Optimization for Formation Flight in Dense Environments

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Distributed Formation Navigation of Constrained Second-Order Multiagent Systems with Collision Avoidance and Connectivity Maintenance

Distributed Formation Control with Open-Loop Nash Strategy

Distributed Multi-Step Subgradient Optimization for Multi-Agent System

A Multi-agent Formation Control Algorithm in Interference Environment

Distributed Optimization for Second-Order Discrete-Time Multiagent Systems with Set Constraints.

Distributed optimization via multi-agent systems

Wireless Localization and Formation Control with Asynchronous Agents

On the Performance Bound of Multi-Agent Formation with Localization Uncertainty

Distributed Constrained Optimization for Second-Order Multiagent Systems Via Event-Based Communication

Decentralized Adaptive Formation via Consensus-Oriented Multi-Agent Communication

Distributed Online Optimization for Multi-Agent Networks With Coupled Inequality Constraints

Hierarchical game theoretical distributed adaptive control for large scale multi‐group multi‐agent system

Directed Formation Control Using Distance and Angle in Local Coordinate Frameworks

Scaling Robust Optimization for Multi-Agent Robotic Systems: A Distributed Perspective

Distributed formation output regulation of switching heterogeneous multi-agent systems

An Integrated Localization and Control Framework for Multi-Agent Formation

Robust Affine Formation Control of Multiagent Systems