Abstract:Unmanned Ariel Vehicle (UAV) services with 5G connectivity is an emerging field with numerous applications. Operator-controlled UAV flights and manual static flight configurations are major limitations for the wide adoption of scalability of UAV services. Several services depend on excellent UAV connectivity with a cellular network and maintaining it is challenging in predetermined flight paths. This paper addresses these limitations by proposing a Deep Reinforcement Learning (DRL) framework for UAV path planning with assured connectivity (DUPAC). During UAV flight, DUPAC determines the best route from a defined source to the destination in terms of distance and signal quality. The viability and performance of DUPAC are evaluated under simulated real-world urban scenarios using the Unity framework. The results confirm that DUPAC achieves an autonomous UAV flight path similar to base method with only 2% increment while maintaining an average 9% better connection quality throughout the flight.

What problem does this paper attempt to address?

The paper primarily addresses the challenges faced by Unmanned Aerial Vehicles (UAVs) in path planning within dense urban environments, particularly how to maintain stable communication connectivity while ensuring efficient flight paths. Specifically, the paper tackles the following key issues: 1. **Automated Efficient Flight Path Planning**: Traditionally, UAV flight paths need to be manually configured or controlled by operators, which limits the flexibility and scalability of the service. Therefore, one of the goals of the paper is to achieve autonomous and efficient flight path planning. 2. **Uninterrupted High-Quality Communication Connectivity**: Many UAV services rely on stable and high-quality communication connections with ground stations. However, maintaining such connections along predetermined flight paths is very challenging, especially in dense urban environments. Thus, another goal is to ensure stable communication connectivity during the flight. To address these challenges, the paper proposes a method based on Deep Reinforcement Learning (DRL) called Deep UAV Path Planning with Assured Connectivity (DUPAC). The main features of DUPAC include: - **Balancing Flight Efficiency and Communication Quality**: DUPAC aims to find a balance between the shortest flight distance and the optimal communication quality, ensuring that the UAV can quickly reach its destination while maintaining good signal quality during the flight. - **Continuous Action Space**: Unlike previous studies that used discrete action spaces, DUPAC transforms the action space into a continuous form, thereby improving decision-making capabilities and significantly enhancing the precision and flexibility of UAV movements. - **Real-World Environment Simulation**: To evaluate the effectiveness of DUPAC, the researchers constructed a realistic 3D urban environment under the Unity framework and validated the method's effectiveness and performance through simulation experiments. Through the above methods, DUPAC can achieve efficient path planning for UAVs from the starting point to the destination while ensuring good communication connectivity with ground stations. Experimental results show that compared to benchmark methods, DUPAC can improve communication connectivity quality by an average of 9% with only a 2% increase in flight distance. This indicates that DUPAC successfully balances flight efficiency and communication quality.

Deep UAV Path Planning with Assured Connectivity in Dense Urban Setting

Connectivity-Aware 3D UAV Path Design With Deep Reinforcement Learning

Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

Connectivity-Aware UAV Path Planning with Aerial Coverage Maps

A Lightweight Reinforcement Learning-Based Real-Time Path Planning Method for Unmanned Aerial Vehicles

A 3D REM-Guided UAV Path Planning Method under Communication Connectivity Constraints

Deep Reinforcement Learning Based Placement for Integrated Access Backhauling in UAV-Assisted Wireless Networks

Learning-Based UAV Coverage-Aware Path Planning in Large-scale Urban Environments

Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks

Joint AP Selection and Task Offloading Based on Deep Reinforcement Learning for Urban-Micro Cell-Free UAV Network

Joint optimization of UAV communication connectivity and obstacle avoidance in urban environments using a double-map approach

RL-Based Cargo-UAV Trajectory Planning and Cell Association for Minimum Handoffs, Disconnectivity, and Energy Consumption

Joint Design of Access Point Selection and Path Planning for UAV-Assisted Cellular Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

Deep Reinforcement Learning based Path Planning for UAV-assisted Edge Computing Networks

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

A deep reinforcement learning approach to assess the low-altitude airspace capacity for urban air mobility

Federated Learning for Cellular-connected UAVs: Radio Mapping and Path Planning

Cellular Coverage-Aware Path Planning for UAVs

Learning-based User Association and Dynamic Resource Allocation in Multi-Connectivity Enabled Unmanned Aerial Vehicle Networks