Abstract:This article presents a novel distributed flocking control method for large-scale multiagent systems (LS-MASs) operating in uncertain environments. When dealing with a massive number of flocking agents in uncertain environments, existing flocking methods encounter the problem of communication complexity and "Curse of dimensionality" caused by the exponential growth of agent interactions while solving PDE-based optimal flocking control for large-scale systems. The mean field game (MFG) method addresses this issue by transforming interactions among all agents into the interaction of each individual agent with average effects represented by a probability density function (pdf) of other agents. However, relying solely on a pdf term to consider other agents' states can result in inefficient flocking performance due to the absence of a proficient coordination mechanism encompassing all agents involved in flocking. To overcome these difficulties and achieve the desired flocking performance for LS-MASs, the agents are decomposed into a finite number of subgroups. Each subgroup comprises a leader and followers, and a hybrid game theory is developed to manage both inter-and intragroup interactions. The method incorporates a cooperative game that links leaders from different groups to formulate distributed flocking control, a Stackelberg game that teams up leaders and followers within the same group to extend collective flocking behavior, and an MFG for followers to address the challenges of LS-MASs. Furthermore, to achieve distributed adaptive flocking using the hybrid game structure, we propose a hierarchical actor-critic-mass-based reinforcement learning technique. This approach incorporates a multiactor-critic method for leaders and an actor-critic-mass algorithm for followers, enabling adaptive flocking control in a distributed manner for large-scale agents. Finally, numerical simulation including comparison study and Lyapunov analysis demonstrates the effectiveness of the developed method.

Fully Distributed Model-Free Flocking of Multiple Euler-Lagrange Systems

Distributed Leader-follower Formation Control of Nonholonomic Mobile Robots

Robot Flocking Control with Part Information of the Virtual Leader

Leader-Following Connectivity-Preserving Consensus of Multiple Euler–Lagrange Systems With Disturbances

A Multi-Agent Flocking System with Communication Delays Via Distributed Model Predictive Control

Flocking of Multi-agent Systems with Unknown Nonlinear Dynamics and Heterogeneous Virtual Leader

Model Predictive Flocking Control for Second-Order Multi-Agent Systems with Input Constraints

Distributed Adaptive Flocking Control for Large-Scale Multiagent Systems

Decentralized Leader-Follower Flocking of Multiple Non-Holonomic Agents

Robust Consensus of Multiple Euler-Lagrange Systems via a Distributed Reduced-Order Observer

Flexible Distributed Flocking Control for Multi-agent Unicycle Systems

Leaderless Consensus of Heterogeneous Multiple Euler–Lagrange Systems With Unknown Disturbance

Output-Feedback Flocking Control of Multiple Autonomous Surface Vehicles Based on Data-Driven Adaptive Extended State Observers

Distributed Leaderless and Leader-Following Consensus Control of Multiple Euler-Lagrange Systems with Unknown Control Directions

Self-triggered Distributed Model Predictive Control for Flocking of Multi-agent Systems

A Connectivity-Preserving Flocking Algorithm for Nonlinear Multi-Agent Systems with Bounded Potential Function

Fully Distributed Event-Triggered Optimal Coordinated Control for Multiple Euler–Lagrangian Systems

Collision-free Source Seeking and Flocking Control of Multi-agents with Connectivity Preservation

Leader-Following Consensus of Heterogeneous Linear Multiagent Systems With Communication Time-Delays via Adaptive Distributed Observers

Flocking of Multi-Agent Systems with Multiple Virtual Leaders Based on Connectivity Preservation Approach

Flocking Coordination of Multiple Mobile Autonomous Agents with Asymmetric Interactions and Switching Topology