Abstract:Unmanned aerial vehicle (UAV) swarm shows great potential as an effective tool for target tracking through completing complex tasks by collaboration of heterogeneous UAVs. However, UAV swarm scheduling faces challenges with poor quality communication and obstacles, especially in communication denial environment with multiple obstacles. To overcome these challenges, first, this paper proposes a scheduling slot model which divides the scheduling process into multiple time slots, allowing UAVs to communicate in communication slots while predicting instead of communication in communication denial slots. In communication denial slots, this model utilizes route fitting and two-stage Kalman filtering for UAV location prediction and optimizes UAV scheduling to align with predicted positions. In enabled slots, this model corrects position deviations to obtain precise UAV locations manually. Then, we propose an obstacle avoidance strategy to facilitate swarm scheduling for target searching under communication constraints. The obstacle avoidance strategy simplifies obstacles as regular hexagons and facilitates the determination of UAV avoidance routes by introducing intermediary points. Finally, to optimize UAV scheduling strategy, we propose a region co-evolution algorithm (RCEA), which emphasizes the collaboration among diverse individuals or populations. RCEA adopts area evaluation and Pareto strategy to enhance scheduling efficiency with following three steps. RCEA divides the overall scheduling region into multiple sub-regions, generates the foundational solution pool through the implementation of the area evaluation or Pareto strategy, and then proceeds to execute the region cooperation process base on the foundational solution pool. Simulation experiments are conducted to validate the performance of human-UAV interaction scheduling model with proposed scheduling methods and obstacle avoidance strategy. The simulation results demonstrate that RCEA outperforms other scheduling algorithms for UAV swarm in communication denial environment with multiple obstacles. Note to Practitioners —This paper addresses challenges inherent in real-world application scenarios, and the proposed algorithm has the potential to bring many benefits to practitioners. Firstly, the scheduling slot model can be applied not only to UAV swarm for target searching but can also be extended to other swarm devices for complex tasks with collaboration relying on communication support while facing poor quality communication or obstacles. Secondly, the proposed RCEA focuses on collaboration and region partitioning, the algorithm demonstrates remarkable scalability, effectively tackling challenges across diverse scales and complexities. Thirdly, the experimental scenarios can serve as a validation dataset for other peer researchers, and although the simulation experiment is based on a 2D movement model, this study still offers theoretical support applicable to a 3D movement model.

UAV Swarm Deployment and Trajectory for 3D Area Coverage via Reinforcement Learning

Deep Reinforcement Learning Based Three-Dimensional Area Coverage With UAV Swarm

Three-Dimensional Area Coverage with UAV Swarm Based on Deep Reinforcement Learning

Distributed UAV Swarms for 3D Urban Area Coverage with Incomplete Information Using Event-Triggered Hierarchical Reinforcement Learning

Reinforcement Learning-Based Low-Altitude Path Planning for UAS Swarm in Diverse Threat Environments

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning

Deep Reinforcement Learning Based Distributed 3D UAV Trajectory Design

Three-dimensional deep reinforcement learning for trajectory and resource optimization in UAV communication systems

Learning-Based UAV Coverage-Aware Path Planning in Large-scale Urban Environments

3D-Trajectory and Phase-Shift Design for RIS-Assisted UAV Systems Using Deep Reinforcement Learning

Cooperative Motion Planning for Persistent 3D Visual Coverage with Multiple Quadrotor UAVs

Human-UAV Interaction Assisted Heterogeneous UAV Swarm Scheduling for Target Searching in Communication Denial Environment

Collaborative Reinforcement Learning Based Unmanned Aerial Vehicle (UAV) Trajectory Design for 3D UAV Tracking

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Decentralized Learning Control for Multi-UAV Swarm Simultaneous Coverage and Tracking

Computationally-Efficient Distributed Algorithms of Navigation of Teams of Autonomous UAVs for 3D Coverage and Flocking

A Reinforcement Learning-based Decentralized Method of Avoiding Multi-UAV Collision in 3-D Airspace

Dynamic Decentralized 3D Urban Coverage and Patrol with UAVs

Control-Aware Trajectory Predictions for Communication-Efficient Drone Swarm Coordination in Cluttered Environments