Abstract:Unmanned aerial vehicles (UAVs) are envisioned to complement the 5G communication infrastructure in future smart cities. Hot spots easily appear in road intersections, where effective communication among vehicles is challenging. UAVs may serve as relays with the advantages of low price, easy deployment, line-of-sight links, and flexible mobility. In this paper, we study a UAV-assisted vehicular network where the UAV jointly adjusts its transmission control (power and channel) and 3D flight to maximize the total throughput. First, we formulate a Markov decision process (MDP) problem by modeling the mobility of the UAV/vehicles and the state transitions. Secondly, we solve the target problem using a deep reinforcement learning method, namely, the deep deterministic policy gradient (DDPG), and propose three solutions with different control objectives. Deep reinforcement learning methods obtain the optimal policy through the interactions with the environment without knowing the environment variables. Considering that environment variables in our problem are unknown and unmeasurable, we choose a deep reinforcement learning method to solve it. Moreover, considering the energy consumption of 3D flight, we extend the proposed solutions to maximize the total throughput per unit energy. To encourage or discourage the UAV's mobility according to its prediction, the DDPG framework is modified, where the UAV adjusts its learning rate automatically. Thirdly, in a simplified model with small state space and action space, we verify the optimality of proposed algorithms. Comparing with two baseline schemes, we demonstrate the effectiveness of proposed algorithms in a realistic model.

Deep Reinforcement Learning Based Placement for Integrated Access Backhauling in UAV-Assisted Wireless Networks

Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks

Autonomous Navigation and Configuration of Integrated Access Backhauling for UAV Base Station Using Reinforcement Learning

Deep Reinforcement Learning-based UAV Control for Optimized Energy Efficiency and Throughput in UAV-assisted Communication

Deep Reinforcement Learning-enabled Dynamic UAV Deployment and Power Control in Multi-UAV Wireless Networks

Joint Multi-UAV Deployment and Resource Allocation Based on Personalized Federated Deep Reinforcement Learning.

QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning

When UAVs Meet Cognitive Radio: Offloading Traffic under Uncertain Spectrum Environment Via Deep Reinforcement Learning

Reinforcement Learning Placement Algorithm for Optimization of UAV Network in Wireless Communication

An Intelligent Coexistence Strategy for Embb/urllc Traffic in Multi-UAV Relay Networks Via Deep Reinforcement Learning

Joint UAV Deployment and Resource Allocation: a Personalized Federated Deep Reinforcement Learning Approach

Enabling Urban MmWave Communications with UAV-Carried IRS Via Deep Reinforcement Learning

Deep-EERA: DRL-Based Energy-Efficient Resource Allocation in UAV-Empowered Beyond 5G Networks

Traffic-Aware UAV Placement Using a Generalizable Deep Reinforcement Learning Methodology

Deep UAV Path Planning with Assured Connectivity in Dense Urban Setting

Deep Reinforcement Learning-Based Content Placement and Trajectory Design in Urban Cache-Enabled UAV Networks

Deep Reinforcement Learning to Enhance the Energy-efficient Performance of Unmanned Aerial Vehicles-enabled Fog Radio Access Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Learning-Enabled Radar-Assisted Predictive Beamforming for UAV-Aided Networks

Joint Topology Construction and Power Adjustment for UAV Networks: A Deep Reinforcement Learning Based Approach

Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning