Abstract:Integrating unmanned aerial vehicles (UAVs) into existing cellular networks encounters lots of challenges, among which one of the most striking concerns is how to achieve harmonious coexistence of aerial transceivers, inter alia, UAVs, and terrestrial user equipments (UEs). In this paper, a cellular-connected UAV network is focused, where multiple UAVs receive messages from base stations (BSs) in the down-link, while BSs are serving ground UEs in their cells. For effectively managing inter-cell interferences (ICIs) among UEs due to intense reuse of time-frequency resource block (RB) resource, a first $p$-tier based RB coordination criterion is proposed and adopted. Then, to enhance wireless transmission quality for UAVs while protecting terrestrial UEs from being interfered by ground-to-air (G2A) transmissions, a radio resource management (RRM) problem of joint dynamic RB coordination and time-varying beamforming design minimizing UAV's ergodic outage duration (EOD) is investigated. To cope with conventional optimization techniques' inefficiency in solving the formulated RRM problem, a deep reinforcement learning (DRL)-aided solution is initiated, where deep double duelling Q network (D3QN) and twin delayed deep deterministic policy gradient (TD3) are invoked to deal with RB coordination in discrete action domain and beamforming design in continuous action regime, respectively. The hybrid D3QN-TD3 solution is trained via interacting with the considered outer and inner environments in an online centralized manner so that it can then help achieve the suboptimal EOD minimization performance during its offline decentralized exploitation phase. Simulation results have illustrated the effectiveness of the proposed hybrid D3QN-TD3 algorithm, compared to several representative baselines.

QoE and Cost-Aware Resource and Interference Management in Aerial-Terrestrial Networks for Vehicular Applications

A Thorough Analysis of Radio Resource Assignment for UAV-Enhanced Vehicular Sidelink Communications

Energy-Efficient Resource Allocation for UAV-Assisted Vehicular Networks with Spectrum Sharing

Optimal Trajectory and Downlink Power Control for Multi-Type UAV Aerial Base Stations

Trajectories and Resource Management of Flying Base Stations for C-V2X

Joint Deployment and Resource Allocation for Service Provision in Multi-UAV-Assisted Wireless Networks

Joint Sub-carrier and Power Allocation for Efficient Communication of Cellular UAVs

Density-aware deployment with multi-layer UAV-V2X communication networks

Network Resource Allocation for eMBB Payload and URLLC Control Information Communication Multiplexing in a Multi-UAV Relay Network

Two-Tier Efficient QoE Optimization for Partitioning and Resource Allocation in UAV-Assisted MEC

URLLC-Aware Proactive UAV Placement in Internet of Vehicles

3D position deployment and performance optimization of mmWave UAV-assisted HetIoT under jamming condition

A Flexible Load Balancing Scheme in Multi-UAV-Enabled Wireless Networks

Performance Analysis and Optimization for V2V-assisted UAV Communications in Vehicular Networks

Radio Resource Management for Cellular-Connected UAV: A Learning Approach

Resource Allocation and 3-D Placement for UAV-Enabled Energy-Efficient IoT Communications

Joint Resource Allocation and Trajectory Control for UAV-Enabled Vehicular Communications

Line-of-Sight-Based Coordinated Channel Resource Allocation Management in UAV-Assisted Vehicular Ad Hoc Networks

UAV Virtual Antenna Array Deployment for Uplink Interference Mitigation in Data Collection Networks

QoE-Based Resource Allocation for Heterogeneous Multi-Radio Communication in Software-Defined Vehicle Networks