Abstract:The development of machine learning and artificial intelligence algorithms, as well as the progress of unmanned aerial vehicle swarm technology, has significantly enhanced the intelligence and autonomy of unmanned aerial vehicles in search missions, resulting in greater efficiency when searching unknown areas. However, as search scenarios become more complex, the existing unmanned aerial vehicle swarm search method lacks scalability and efficient cooperation. Furthermore, due to the increasing scale of search scenarios, the accuracy and real-time performance of global information are difficult to ensure, necessitating the provision of local information. This paper focuses on the large-scale search scenario and split it to provide both local and global information for running unmanned aerial vehicle swarm search algorithms. Since the search environment is often unknown, dynamic, and complex, it requires adaptive decision-making in a constantly changing environment, which is suitable for modeling as a Markov decision process. Considering the sequential-based scenario, we propose a distributed collaborative search method based on a multi-agent reinforcement learning algorithm, which can operate efficiently in complex and large-scale scenarios. Additionally, the proposed method can utilize a convolutional neural network to process high-dimensional map data with almost no loss of the structure information. Experimental results demonstrate that the proposed method can collaboratively search unknown areas, avoid collisions and repetitions, and find all targets faster compared with the benchmarks.

The Game of Drones: rapid agent-based machine-learning models for multi-UAV path planning

Game of Drones: Multi-UAV Pursuit-Evasion Game With Online Motion Planning by Deep Reinforcement Learning

Multi-agent systems for quadcopters

Comparative Analysis of Agent-Oriented Task Assignment and Path Planning Algorithms Applied to Drone Swarms

Advancing Drone Swarm Simulation: A Comprehensive System for Real-Time Control and Dynamic Interaction

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

High-Speed Motion Planning for Aerial Swarms in Unknown and Cluttered Environments

Programming and Deployment of Autonomous Swarms using Multi-Agent Reinforcement Learning

Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning

MULTI-AGENT PATH PLANNING OF ROBOTIC SWARMS IN AGRICULTURAL FIELDS

UAV Path Planning Model Leveraging Machine Learning and Swarm Intelligence for Smart Agriculture

Coverage Path Planning and Point-of-Interest Detection Using Autonomous Drone Swarms

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

Digital Twin-Enabled Decision-Making Framework for Multi-UAV Mission Planning: A Multiagent Deep Reinforcement Learning Perspective

A Distributed Method for UAV Swarm Path Planning

Drone swarm patrolling with uneven coverage requirements

Multiagent UAVs Routing in Distributed vs Decentralized models: Game theory approach

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

An Unmanned Air Combat System Based on Swarm Intelligence

Game of Drones: Intelligent Online Decision Making of Multi-UAV Confrontation

Application of Deep Reinforcement Learning to UAV Swarming for Ground Surveillance