Abstract:In this study, a novel graph-embedding technique based on a graph neural network (GNN) is proposed to identify the topology in the motion of a unmanned aerial vehicles (UAV) swarm and quickly obtain local information around each agent. We also propose a model reference reinforcement learning method to learn the potential field function and determine an appropriate strategy for each agent that can satisfy the requirements of collaborative motion and obstacle avoidance for large-scale UAV swarms. First, a new swarm structure is proposed to provide reserved maneuvering space for UAVs during flight. In addition, a method was proposed to encode the obstacle avoidance behavior of multiple UAVs in a continuous space into spatial maps. A graph attention mechanism (GAT) structure based on local information was proposed to obtain dynamic graph information, and each individual output action was obtained according to the current state information. To improve the training effect, this method can restrain the UAV group while maintaining the formation and preventing collisions among the UAV. Second, a new distributed control algorithm based on multi-agent reinforcement learning (MARL) is proposed by learning the potential field function using local information obtained by a GNN. Each individual can repel and cooperate with the target within a short range and attract objects over a long distance. Finally, simulation results demonstrate the effectiveness and superiority of the proposed method, which has great potential for application in online autonomous collaboration.

Force-directed formation and guidance for large scale swarming system of micro air vehicles

Formation Control of Multi-UAV Systems with Time and Angle Constraints

Distributed Swarm Trajectory Optimization for Formation Flight in Dense Environments

V-Shaped Formation Control for Robotic Swarms Constrained by Field of View

Distributed bearing-based formation control of unmanned aerial vehicle swarm via global orientation estimation

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

A Mean-Field Game Control for Large-Scale Swarm Formation Flight in Dense Environments

An Effective and Scalable Approach for Swarm-on-Swarm Air Combat Decision

Adaptive leader-follower formation control for autonomous mobile robots

Formation flight of fixed-wing UAV swarms: A group-based hierarchical approach

Grouping Formation and Obstacle Avoidance Control of UAV Swarm Based on Synchronous DMPC

Agile Formation Control of Drone Flocking Enhanced With Active Vision-Based Relative Localization

Integrated the Artificial Potential Field with the Leader–Follower Approach for Unmanned Aerial Vehicles Cooperative Obstacle Avoidance

Large Scale UAVs Collaborative Formation Simulation Based on Starlings' Flight Mechanism.

Three-Dimensional Leaderless Flocking Control Of Large-Scale Small Unmanned Aerial Vehicles

Graph-Based Multi-agent Reinforcement Learning for Large-Scale UAVs Swarm System Control

Decentralized shape formation and force-based interactive formation control in robot swarms

Path Planning and Formation Control of Multi-target Using Virtual Spring Model

Obstacle Avoidance of Resilient UAV Swarm Formation with Active Sensing System in the Dense Environment

Swarm control with collision avoidance for multiple underactuated surface vehicles

Path-guided time-varying formation control with collision avoidance and connectivity preservation of under-actuated autonomous surface vehicles subject to unknown input gains