Abstract:As an aerial base station, unmanned aerial vehicle (UAV) has been considered as a promising technology to assist future wireless communications due to its flexible, swift and low cost features, where resource allocation is the basis for ensuring energy-efficient UAV-assisted networks. This paper formulates a joint optimization problem of user association, UAV trajectory design and power control to maximize the channel capacity among all ground users at a limited power level in a downlink transmission. To tackle the mixed-integer non-linear programming problem, this paper proposes a clustering-aided reinforcement learning approach consisting of three consecutive stages. Firstly, modified expectation-maximization unsupervised learning algorithm is investigated to cluster the ground users, which reduces the dimensions and hence, the association complexity is reduced as well. Then, Kuhn-Munkres algorithm is incorporated for user association, which associates a UAV with the ground users via matching to the cluster, and assigns the UAVs to the centroid of the matching cluster for pre-placement, with the aim of speeding up the convergence of the following deep reinforcement learning algorithm. Finally, a multi-agent twin delayed deep deterministic (MATD3) policy gradient is proposed to solve the non-convex sub-problem, which determines the transmit power and designs the fine-tuned trajectory of UAVs. By incorporating low-bias value estimation technique, the reward of the proposed MATD3 algorithm is improved. Simulation results have demonstrated that our proposed approach achieves higher reward as well as converging faster than existing reinforcement algorithms. Besides, the clustering-aided reinforcement learning has lower computational complexity than the benchmark schemes.

DNN-Aided Distributed Direct Position Determination for UAV Cluster

A Drone Localization System Based On Multiple Time Delays Fusion

A Computational Efficient Maximum Likelihood Direct Position Determination Approach for Multiple Emitters Using Angle and Doppler Measurements

An Energy Balance and Mobility Prediction Clustering Algrithm for Large-Scale UAV Ad Hoc Networks

Joint Neural Network for Trajectory and Communication Design in Multi-DAV Systems

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

A Multi-Sources DOA Localization Method Based on UAV Cluster Systems

UAV-Assisted Multi-Cluster Over-the-Air Computation

Novel Robust Dynamic Distributed Drone-Deployment Strategy for Channel-Capacity Optimization for Three-Dimensional UAV-Aided Ad Hoc Networks

Distributed 3D Relative Localization of UAVs

Distributed and Collaborative Localization for Swarming UAVs

Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach

Online Distributed Relative Positioning Utilizing Multiple Cooperative Autonomous Agents

ClusterFusion: Real-time Relative Positioning and Dense Reconstruction for UAV Cluster

Vehicle Positioning With Deep-Learning-Based Direction-of-Arrival Estimation of Incoherently Distributed Sources

DDPG-based Aerial Secure Data Collection

Direction Estimation in 3D Outdoor Air-Air Wireless Channels through Machine Learning

Sustainable and Low-AoI Cooperative Data Acquisition in UAV-Aided Sensor Networks

Deep Learning for Channel Tracking in IRS-Assisted UAV Communication Systems

Research on optimal deep learning‐based formation flight positioning of UAV

Two-Way Aerial Secure Communications via Distributed Collaborative Beamforming under Eavesdropper Collusion