Abstract:This article presents a novel distributed flocking control method for large-scale multiagent systems (LS-MASs) operating in uncertain environments. When dealing with a massive number of flocking agents in uncertain environments, existing flocking methods encounter the problem of communication complexity and "Curse of dimensionality" caused by the exponential growth of agent interactions while solving PDE-based optimal flocking control for large-scale systems. The mean field game (MFG) method addresses this issue by transforming interactions among all agents into the interaction of each individual agent with average effects represented by a probability density function (pdf) of other agents. However, relying solely on a pdf term to consider other agents' states can result in inefficient flocking performance due to the absence of a proficient coordination mechanism encompassing all agents involved in flocking. To overcome these difficulties and achieve the desired flocking performance for LS-MASs, the agents are decomposed into a finite number of subgroups. Each subgroup comprises a leader and followers, and a hybrid game theory is developed to manage both inter-and intragroup interactions. The method incorporates a cooperative game that links leaders from different groups to formulate distributed flocking control, a Stackelberg game that teams up leaders and followers within the same group to extend collective flocking behavior, and an MFG for followers to address the challenges of LS-MASs. Furthermore, to achieve distributed adaptive flocking using the hybrid game structure, we propose a hierarchical actor-critic-mass-based reinforcement learning technique. This approach incorporates a multiactor-critic method for leaders and an actor-critic-mass algorithm for followers, enabling adaptive flocking control in a distributed manner for large-scale agents. Finally, numerical simulation including comparison study and Lyapunov analysis demonstrates the effectiveness of the developed method.

Cooperative Flocking And Learning In Multi-Robot Systems For Predator Avoidance

Multi-Robot Learning Dynamic Obstacle Avoidance in Formation with Information-Directed Exploration.

An Adaptive Fuzzy Reinforcement Learning Cooperative Approach for the Autonomous Control of Flock Systems

Research on Motion Planning Based on Flocking Control and Reinforcement Learning for Multi-Robot Systems

Learning-Based Multi-Robot Formation Control With Obstacle Avoidance

Heuristic Predictive Control for Multi-Robot Flocking in Congested Environments

State-of-the-Art Flocking Strategies for the Collective Motion of Multi-Robots

Fully Distributed Multi-Robot Collision Avoidance via Deep Reinforcement Learning for Safe and Efficient Navigation in Complex Scenarios

Flocking with obstacle avoidance based on fuzzy logic

Multi-robot Target Encirclement Control with Collision Avoidance via Deep Reinforcement Learning

Scalable Task-Driven Robotic Swarm Control via Collision Avoidance and Learning Mean-Field Control

Learning-Based Multi-UAV Flocking Control With Limited Visual Field and Instinctive Repulsion

Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learning

Distributed deformable configuration control for multi-robot systems with low-cost platforms

Cooperative coevolution of real predator robots and virtual robots in the pursuit domain

Distributed Adaptive Flocking Control for Large-Scale Multiagent Systems

Interactive Multi-Robot Flocking with Gesture Responsiveness and Musical Accompaniment

Flexible Distributed Flocking Control for Multi-agent Unicycle Systems

Multi-UAV Flocking Control with a Hierarchical Collective Behavior Pattern Inspired by Sheep

C3F: Constant Collaboration and Communication Framework for Graph-Representation Dynamic Multi-Robotic Systems

Intelligent Control of Swarm Robotics Employing Biomimetic Deep Learning