Abstract:Unmanned Aerial Vehicles (UAVs) can be deployed as aerial wireless base stations which dynamically cover the wireless communication networks for Ground Users (GUs). The most challenging problem is how to control multi-UAVs to achieve on-demand coverage of wireless communication networks while maintaining connectivity among them. In this paper, the cooperative trajectory optimization of UAVs is studied to maximize the communication efficiency in the dynamic deployment of UAVs for emergency communication scenarios. We transform the problem into a Markov game problem and propose a distributed trajectory optimization algorithm, Double-Stream Attention multi-agent Actor-Critic (DSAAC), based on Multi-Agent Deep Reinforcement Learning (MADRL). The throughput, safety distance, and power consumption of UAVs are comprehensively taken into account for designing a practical reward function. For complex emergency communication scenarios, we design a double data stream network structure that provides a capacity for the Actor network to process state changes. Thus, UAVs can sense the movement trends of the GUs as well as other UAVs. To establish effective cooperation strategies for UAVs, we develop a hierarchical multi-head attention encoder in the Critic network. This encoder can reduce the redundant information through the attention mechanism, which resolves the problem of the curse of dimensionality as the number of both UAVs and GUs increases. We construct a simulation environment for emergency networks with multi-UAVs and compare the effects of the different numbers of GUs and UAVs on algorithms. The DSAAC algorithm improves communication efficiency by 56.7%, throughput by 71.2%, energy saving by 19.8%, and reduces the number of crashes by 57.7%.

An Energy-Efficient Continuous Deployment Scheme for UAV-D2D Networks.

Towards 3D Deployment of UAV Base Stations in Uneven Terrain.

UAV Deployment Optimization in UAV-assisted Wireless Communications

Energy-Efficient Resource Allocation for Secure D2D Communications Underlaying UAV-Enabled Networks

Robust Resource Allocation Algorithm for Energy-Harvesting-Based D2D Communication Underlaying UAV-Assisted Networks

An Energy-Efficient UAV Recharging and Reshuffling Strategy for Seamless Coverage.

A Near-Optimal UAV-Aided Radio Coverage Strategy for Dense Urban Areas

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

Adaptive Deployment for UAV-Aided Communication Networks

UAV-Mounted RIS-Aided Mobile Edge Computing System: A DDQN-Based Optimization Approach

UAV Trajectory and Energy Efficiency Optimization in RIS-Assisted Multi-User Air-to-Ground Communications Networks

Energy Efficiency Optimization of UAV-Assisted Wireless Powered Systems for Dependable Data Collections in Internet of Things

Joint Energy and AoI Optimization in UAV-assisted MEC-WET Systems

D2D Communications Underlaying UAV-Assisted Access Networks.

Aerial Small Cells Using Coordinated Multiple UAVs: an Energy Efficiency Optimization Perspective

Energy Efficient D2D Communications Using Multiple UAV Relays

Deployment Optimization of Dual-functional UAVs for Integrated Localization and Communication

Energy-Efficient UAV Deployment with Flexible Functional Split Selection

Joint Deployment and Resource Allocation for Service Provision in Multi-UAV-Assisted Wireless Networks

Delay-Tolerant UAV-Assisted Communication: Online Trajectory Design and User Association

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks