Abstract:As an aerial base station, unmanned aerial vehicle (UAV) has been considered as a promising technology to assist future wireless communications due to its flexible, swift and low cost features, where resource allocation is the basis for ensuring energy-efficient UAV-assisted networks. This paper formulates a joint optimization problem of user association, UAV trajectory design and power control to maximize the channel capacity among all ground users at a limited power level in a downlink transmission. To tackle the mixed-integer non-linear programming problem, this paper proposes a clustering-aided reinforcement learning approach consisting of three consecutive stages. Firstly, modified expectation-maximization unsupervised learning algorithm is investigated to cluster the ground users, which reduces the dimensions and hence, the association complexity is reduced as well. Then, Kuhn-Munkres algorithm is incorporated for user association, which associates a UAV with the ground users via matching to the cluster, and assigns the UAVs to the centroid of the matching cluster for pre-placement, with the aim of speeding up the convergence of the following deep reinforcement learning algorithm. Finally, a multi-agent twin delayed deep deterministic (MATD3) policy gradient is proposed to solve the non-convex sub-problem, which determines the transmit power and designs the fine-tuned trajectory of UAVs. By incorporating low-bias value estimation technique, the reward of the proposed MATD3 algorithm is improved. Simulation results have demonstrated that our proposed approach achieves higher reward as well as converging faster than existing reinforcement algorithms. Besides, the clustering-aided reinforcement learning has lower computational complexity than the benchmark schemes.

Demand Learning and Cooperative Deployment of UAV Networks

Communication and Trajectory Design in UAV-enabled Flying Network.

Dynamic Pricing and Capacity Allocation of UAV-provided Mobile Services

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

Learning to Deployment: Data-Driven On-Demand UAV Placement for Throughput Maximization

Predictive Deployment of UAV Base Stations in Wireless Networks: Machine Learning Meets Contract Theory

QoE‐driven multi‐UAV deployment scheme for emergency communication networks

Location Optimization For Unmanned Aerial Vehicles Assisted Mobile Networks

Joint Deployment and Resource Allocation for Service Provision in Multi-UAV-Assisted Wireless Networks

Adaptive Deployment for UAV-Aided Communication Networks

UAV Deployment Optimization in UAV-assisted Wireless Communications

Learning in the Sky: An Efficient 3D Placement of UAVs

Deployment Algorithms for UAV Airborne Networks Toward On-Demand Coverage

Deep Q-Network Based Dynamic Movement Strategy in a UAV-Assisted Network

Cooperative Offloading and Resource Management for UAV-Enabled Mobile Edge Computing in Power IoT System

On-Demand Deployment of Multiple Aerial Base Stations for Traffic Offloading and Network Recovery

Fair Communications in UAV Networks for Rescue Applications

Multi-agent Cooperation for Computing Power Scheduling in UAVs Empowered Aerial Computing Systems

A Flexible Load Balancing Scheme in Multi-UAV-Enabled Wireless Networks

Dynamic Trajectory and Power Control in Ultra-Dense UAV Networks: A Mean-Field Reinforcement Learning Approach

Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach