Abstract:The deployment of UAVs as aerial base stations (BSs) has been considered as a promising supplement to the ground networks, which can quickly build an emergency communication network in a disaster area or significantly relief the communication burden imposed by hot-spots. However, the application of UAVs as aerial BSs is constrained by the limited onboard energy and communication coverage of UAVs. In particular, for a large target area, multiple UAVs should be deployed to meet the communication requirements. Therefore, designing the optimal trajectories of multiple UAVs is crucial to boost the UAV network performance. Inspired by the promising future of UAV BSs, this paper aims at proposing a distributed 3-dimensional (3D) trajectory design algorithm for multiple UAVs to optimize the system performance. We formulate the trajectory design problem as a multi-objective optimization problem to improve the user equipment (UE) access rate, ensure fair access opportunities, increase transmitted data volume and reduce energy consumption. Further inspired by the decision-making ability of deep reinforcement learning (DRL) in complex environments, we propose a DRL based trajectory design algorithm for multiple UAVs, namely DMTD, in which UAVs can explore both the optimal flight altitude and the potential UE distribution area in the iterative interactions with the environment, and then select the optimal flight trajectories to boost the network performance from multiple aspects. Extensive experimental results under different UE distributions have demonstrated that the proposed DMTD algorithm can find the optimal altitude to provide maximum coverage. Moreover, DMTD beats existing algorithms by providing high UE access rate, ensuring fair network service and increasing total transmitted data volume at the cost of a relatively low energy consumption. Especially in the scenes with dense and randomly distributed UEs, DMTD provides a UE access rate close to 0.9 and transmits 6 times of data volume than existing algorithms.

Adaptive Multi-UAV Trajectory Planning Leveraging Digital Twin Technology for Urban IIoT Applications

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

Joint Optimization of Flying Trajectory and Task Offloading for UAV-Enabled MEC Networks: A Digital Twin-Assisted Hybrid Learning Approach

On collaborative multi-UAV trajectory planning for data collection

Priority-Oriented Trajectory Planning for UAV-Aided Time-Sensitive IoT Networks

A Learning-Based Trajectory Planning of Multiple UAVs for AoI Minimization in IoT Networks

Deep Reinforcement Learning Based Distributed 3D UAV Trajectory Design

Edge-Intelligence-Powered Joint Computation Offloading and Unmanned Aerial Vehicle Trajectory Optimization Strategy

Digital Twin-Enabled Decision-Making Framework for Multi-UAV Mission Planning: A Multiagent Deep Reinforcement Learning Perspective

Efficient Trajectory Planning for Optimizing Energy Consumption and Completion Time in UAV-Assisted IoT Networks

Continuous Transfer Learning for UAV Communication-aware Trajectory Design

Digital Twin Assisted Task Assignment in Multi-UAV Systems: A Deep Reinforcement Learning Approach

A Dynamic Trajectory Planning Algorithm for Urban Ultra-Low Altitude UAVs Based on a Fusion Heuristic Algorithm

DRL-UTPS: DRL-Based Trajectory Planning for Unmanned Aerial Vehicles for Data Collection in Dynamic IoT Network

Dynamic Online Trajectory Planning for a UAV-Enabled Data Collection System

Optimal Transmission Control and Learning-Based Trajectory Design for UAV-Assisted Detection and Communication

Multi-UAV Trajectory Planning for Energy-Efficient Content Coverage: A Decentralized Learning-Based Approach

Joint optimization of UAV communication connectivity and obstacle avoidance in urban environments using a double-map approach

Trajectory Planning for Unmanned Aerial Vehicles in Complicated Urban Environments: A Control Network Approach