Abstract:Target searching is crucial in real-world scenarios such as search and rescue in disaster sites and battlefield target reconnaissance. Unmanned aerial vehicles (UAVs) are an ideal technical solution for target searching in large-scale and high-risk areas because they are agile, low cost, and able to collaborate and carry different sensors. In complex scenarios like battlefields, due to the lack of communication infrastructures and the intensive interference, UAVs often operate in communication denied environments. As a result, fast and reliable communication channels between UAVs and ground operators are difficult to establish. Thus, in such conditions, UAVs must be able to complete tasks autonomously and intelligently, without receiving real-time commands from the operators. With the rapid advances in artificial intelligence, reinforcement learning has shown potentiality for solving continuous decision problems. The target searching problem studied in this paper falls into this category and is suitable for adopting reinforcement learning technologies. However, the feasibility of reinforcement learning in UAV-based target searching in communication denied environments is not clear and, thus, requires in-depth investigations. As a pilot study in this direction, this paper models the target searching problem in communication denied and confrontation situations and proposes a simulation environment based on this model. Extensive experiments are conducted to answer the following questions. (1) Can reinforcement learning be applied in target searching by multi-UAVs in communication denied environments? (2) What are the advantages and disadvantages of different reinforcement learning algorithms in solving this problem? (3) How the degree of communication denial influences the performance of these algorithms? The current mainstream reinforcement learning technologies are adopted to perform simulations, whose results are analyzed quantitatively, leading to the following observations. (1) Reinforcement learning can effectively solve target searching problems for multi-UAVs in communication denied environments. (2) Compared with other algorithms, an autonomous decision-making UAV cluster based on a deep Q-network (DQN)exhibits the best problem-solving ability. (3) The algorithm performance changes with the degree of communication denial but remains largely stable when the communication condition varies.

A Reinforcement Learning Approach for UAV Target Searching and Tracking

Cooperative Target Searching And Tracking Via Uct With Probability Distribution Model

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

A Cooperative Search and Coverage Algorithm with Controllable Revisit and Connectivity Maintenance for Multiple Unmanned Aerial Vehicles.

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

A Vision-based UAV Tracker Aiming at Aerial Targets

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

An Improved Method Based on Deep Reinforcement Learning for Target Searching

UAV Target Tracking Method Based on Deep Reinforcement Learning

UAV Autonomous Trajectory Planning in Target Tracking Tasks Via a DQN Approach.

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Eye in the Sky: Energy Efficient Model-Based Reinforcement Learning Aided Target Tracking Using UAVs

A Robust and Efficient UAV Path Planning Approach for Tracking Agile Targets in Complex Environments

Autonomous UAV-based surveillance system for multi-target detection using reinforcement learning

Feasibility of reinforcement learning for UAV-based target searching in a simulated communication denied environment

Multi-UAV Autonomous Collaborative Target Tracking in Dynamic Environment Based on Multi-agent Reinforcement Learning

UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach

Searching and Tracking an Unknown Number of Targets: A Learning-Based Method Enhanced with Maps Merging

Multi-UAV Collaborative Search and Strike based on Reinforcement Learning

Deep Reinforcement Learning Based Computation Offloading and Trajectory Planning for Multi-UAV Cooperative Target Search

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks