Abstract:Cellular-connected unmanned aerial vehicles (UAVs) are expected to become integral components of future cellular networks. To this end, one of the important problems to address is how to support energy-efficient UAV operation while maintaining reliable connectivity between those aerial users and cellular networks. In this paper, we aim to minimize the energy consumption of cellular-connected UAV via jointly designing the mission completion time and UAV trajectory, as well as communication base station (BS) associations, while ensuring a satisfactory communication connectivity with the ground cellular network during the UAV flight. An optimization problem is formulated by taking into account the UAV’s flight energy consumption and various practical aspects of the air-ground communication models, including BS antenna pattern, interference from non-associated BSs and local environment. The formulated problem is difficult to tackle due to the lack of closed-form expressions and non-convexity nature. To this end, we first assume that the channel knowledge map (CKM) or radio map for the considered area is available, which contains rich information about the relatively stable (large-scale) channel parameters. By utilizing path discretization technique, we obtain a discretized equivalent problem and develop an efficient solution based on graph theory by employing convex optimization technique and a dynamic-weight shortest path algorithm over graph. Next, we study the more practical case that the CKM is unavailable initially. By transforming the optimization problem to a Markov decision process (MDP), we develop a deep reinforcement learning (DRL) algorithm based on multi-step learning and double Q-learning over a dueling Deep Q-Network (DQN) architecture, where the UAV acts as an agent to explore and learn its moving policy according to its local observations of the measured signal samples. Extensive simulations are carried out and the results show that our proposed designs significantly outperform baseline schemes. Furthermore, our results reveal new insights of energy-efficient UAV flight with connectivity requirements and unveil the tradeoff between UAV energy consumption and time duration along line segments.

Path Design for Cellular-Connected UAV with Reinforcement Learning

Connectivity-Aware 3D UAV Path Design With Deep Reinforcement Learning

Energy Minimization for Cellular-Connected UAV: from Optimization to Deep Reinforcement Learning

Cellular UAV-to-Device Communications: Trajectory Design and Mode Selection by Multi-agent Deep Reinforcement Learning

Reinforcement Learning for Decentralized Trajectory Design in Cellular UAV Networks with Sense-and-Send Protocol.

Simultaneous Navigation and Radio Mapping for Cellular-Connected UAV With Deep Reinforcement Learning

A Motion Camouflage-Inspired Path Planning Method for UAVs Based on Reinforcement Learning

Simultaneous Environment Sensing and Channel Knowledge Mapping for Cellular-Connected UAV.

Autonomous Navigation for Cellular-Connected UAV in Highly Dynamic Environments: A Deep Reinforcement Learning Approach

Learning-Based UAV Trajectory Optimization with Collision Avoidance and Connectivity Constraints

Joint Design of Access Point Selection and Path Planning for UAV-Assisted Cellular Networks

Reinforcement Learning for a Cellular Internet of UAVs: Protocol Design, Trajectory Control, and Resource Management

Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

Cellular-Connected UAVs over 5G: Deep Reinforcement Learning for Interference Management

3D Global Path Planning Optimization for Cellular-Connected UAVs under Link Reliability Constraint

Connectivity-Aware UAV Path Planning with Aerial Coverage Maps

Cellular Coverage-Aware Path Planning for UAVs

Deep Reinforcement Learning based Running-Track Path Design for Fixed-Wing UAV Assisted Mobile Relaying Network

Safety Constrained Trajectory Optimization for Completion Time Minimization for UAV Communications

Learning-Based UAV Coverage-Aware Path Planning in Large-scale Urban Environments

Cooperative Internet of UAVs: Distributed Trajectory Design by Multi-Agent Deep Reinforcement Learning.