Abstract:As an aerial base station, unmanned aerial vehicle (UAV) has been considered as a promising technology to assist future wireless communications due to its flexible, swift and low cost features, where resource allocation is the basis for ensuring energy-efficient UAV-assisted networks. This paper formulates a joint optimization problem of user association, UAV trajectory design and power control to maximize the channel capacity among all ground users at a limited power level in a downlink transmission. To tackle the mixed-integer non-linear programming problem, this paper proposes a clustering-aided reinforcement learning approach consisting of three consecutive stages. Firstly, modified expectation-maximization unsupervised learning algorithm is investigated to cluster the ground users, which reduces the dimensions and hence, the association complexity is reduced as well. Then, Kuhn-Munkres algorithm is incorporated for user association, which associates a UAV with the ground users via matching to the cluster, and assigns the UAVs to the centroid of the matching cluster for pre-placement, with the aim of speeding up the convergence of the following deep reinforcement learning algorithm. Finally, a multi-agent twin delayed deep deterministic (MATD3) policy gradient is proposed to solve the non-convex sub-problem, which determines the transmit power and designs the fine-tuned trajectory of UAVs. By incorporating low-bias value estimation technique, the reward of the proposed MATD3 algorithm is improved. Simulation results have demonstrated that our proposed approach achieves higher reward as well as converging faster than existing reinforcement algorithms. Besides, the clustering-aided reinforcement learning has lower computational complexity than the benchmark schemes.

On Collaborative Air-Ground Replenishment of Combined UAVs for Live Broadcast.

On Energy Cyclic Replenishment of Combined UAV for Live Broadcast

UAV Resource Cooperation Based on Reinforcement Learning.

An Energy-Efficient UAV Recharging and Reshuffling Strategy for Seamless Coverage.

Aerial Refueling: Scheduling Wireless Energy Charging for UAV Enabled Data Collection

Wireless Resources Cooperation of Assembled Small UAVs for Data Collections of IoT

Learning-Based Aerial Charging Scheduling for UAV-Based Data Collection

Joint Speed Control and Energy Replenishment Optimization for UAV-assisted IoT Data Collection with Deep Reinforcement Transfer Learning

Multi-Task Transfer Deep Reinforcement Learning for Timely Data Collection in Rechargeable-UAV-aided IoT Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Deep Reinforcement Learning-enabled Dynamic UAV Deployment and Power Control in Multi-UAV Wireless Networks

Three-Dimensional Trajectory and Resource Allocation Optimization in Multi-Unmanned Aerial Vehicle Multicast System: A Multi-Agent Reinforcement Learning Method

Deep Reinforcement Learning for Online Routing of Unmanned Aerial Vehicles with Wireless Power Transfer

QoE Optimization for Live Video Streaming in UAV-to-UAV Communications via Deep Reinforcement Learning

Multi-UAV Collaborative Surveillance Network Recovery Via Deep Reinforcement Learning

A Near-Optimal UAV-Aided Radio Coverage Strategy for Dense Urban Areas

Cooperative Planning of Multi-Uav Logistics Delivery by Multi-Graph Reinforcement Learning

Deep reinforcement learning for unmanned aerial vehicles cluster task allocation

Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach

Joint AP Selection and Task Offloading Based on Deep Reinforcement Learning for Urban-Micro Cell-Free UAV Network

Collaborative Coverage Path Planning of UAV Cluster based on Deep Reinforcement Learning