Abstract:The deployment of UAVs as aerial base stations (BSs) has been considered as a promising supplement to the ground networks, which can quickly build an emergency communication network in a disaster area or significantly relief the communication burden imposed by hot-spots. However, the application of UAVs as aerial BSs is constrained by the limited onboard energy and communication coverage of UAVs. In particular, for a large target area, multiple UAVs should be deployed to meet the communication requirements. Therefore, designing the optimal trajectories of multiple UAVs is crucial to boost the UAV network performance. Inspired by the promising future of UAV BSs, this paper aims at proposing a distributed 3-dimensional (3D) trajectory design algorithm for multiple UAVs to optimize the system performance. We formulate the trajectory design problem as a multi-objective optimization problem to improve the user equipment (UE) access rate, ensure fair access opportunities, increase transmitted data volume and reduce energy consumption. Further inspired by the decision-making ability of deep reinforcement learning (DRL) in complex environments, we propose a DRL based trajectory design algorithm for multiple UAVs, namely DMTD, in which UAVs can explore both the optimal flight altitude and the potential UE distribution area in the iterative interactions with the environment, and then select the optimal flight trajectories to boost the network performance from multiple aspects. Extensive experimental results under different UE distributions have demonstrated that the proposed DMTD algorithm can find the optimal altitude to provide maximum coverage. Moreover, DMTD beats existing algorithms by providing high UE access rate, ensuring fair network service and increasing total transmitted data volume at the cost of a relatively low energy consumption. Especially in the scenes with dense and randomly distributed UEs, DMTD provides a UE access rate close to 0.9 and transmits 6 times of data volume than existing algorithms.

Decentralized 4D Trajectory Generation for UAVs Based on Improved Intrinsic Tau Guidance Strategy

Four-Dimensional Trajectory Generation for UAVs Based on Multi-Agent Q Learning

Bio-inspired Collision-Free 4D Trajectory Generation for UAVs Using Tau Strategy

A Bio-Inspired Collision-Free 4d Trajectory Generation Method For Unmanned Aerial Vehicles Based On Tau Theory

On the Four-dimensional Trajectory Control of UAV

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Improved Tau-H Strategy for Four-Dimensional Cooperative Route Planning of Multi-Uavs

Three-dimensional Piecewise Guidance Strategy for Multi-Uavs Guaranteeing Simultaneous Arrival and Field-of-view Constraint

Research on UAV 4D Trajectory Control Based on Adaptive Fuzzy PID

Improved A* and Fuzzy Dynamic Window Based Dynamic Trajectory Planning for an UAV

Real-Time Four-Dimensional Trajectory Generation Based on Gain-Scheduling Control and a High-Fidelity Aircraft Model

Simulation of Dynamic Path Planning for UAV in 4D Space

Time-optimal Trajectory Generation for Aerial Coverage of Urban Building

Local Trajectory Planning of Unmanned Aerial Vehicle Formation Based on Time Cooperative Strategy

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Distributed 3D UAV Trajectory Design

Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning

Differential Flatness-based Fast Trajectory Planning for Fixed-wing Unmanned Aerial Vehicles

Flight Guidance of Aircrafts in Continuous Descent Operation Based on 4D Trajectory

Real-Time Path Planning of Unmanned Aerial Vehicle for Target Tracking and Obstacle Avoidance in Complex Dynamic Environment

Fast Cooperative Trajectory Generation of Unmanned Aerial Vehicles Using a Bezier Curve-Based Shaping Method