Abstract:Unmanned Aerial Vehicles (UAVs) can be deployed as aerial wireless base stations which dynamically cover the wireless communication networks for Ground Users (GUs). The most challenging problem is how to control multi-UAVs to achieve on-demand coverage of wireless communication networks while maintaining connectivity among them. In this paper, the cooperative trajectory optimization of UAVs is studied to maximize the communication efficiency in the dynamic deployment of UAVs for emergency communication scenarios. We transform the problem into a Markov game problem and propose a distributed trajectory optimization algorithm, Double-Stream Attention multi-agent Actor-Critic (DSAAC), based on Multi-Agent Deep Reinforcement Learning (MADRL). The throughput, safety distance, and power consumption of UAVs are comprehensively taken into account for designing a practical reward function. For complex emergency communication scenarios, we design a double data stream network structure that provides a capacity for the Actor network to process state changes. Thus, UAVs can sense the movement trends of the GUs as well as other UAVs. To establish effective cooperation strategies for UAVs, we develop a hierarchical multi-head attention encoder in the Critic network. This encoder can reduce the redundant information through the attention mechanism, which resolves the problem of the curse of dimensionality as the number of both UAVs and GUs increases. We construct a simulation environment for emergency networks with multi-UAVs and compare the effects of the different numbers of GUs and UAVs on algorithms. The DSAAC algorithm improves communication efficiency by 56.7%, throughput by 71.2%, energy saving by 19.8%, and reduces the number of crashes by 57.7%.

UAV-Assisted Emergency Communications: an Extended Multi-Armed Bandit Perspective

Optimization of Multi-UAV-Aided Wireless Networking over a Ray-Tracing Channel Model

UAV Trajectory Optimization in a Post-Disaster Area Using Dual Energy-Aware Bandits

An Improved Virtual Force Approach for UAV Deployment and Resource Allocation in Emergency Communications

Trajectory Planning for Multi-UAV Assisted Wireless Networks in Post-Disaster Scenario

Joint Resource Allocation and Trajectory Optimization for UAV-Aided Relay Networks

Joint Deployment and Trajectory Planning of Multiple UAVs for Emergency Communications

Adaptive Resource Allocation for Emergency Communications with Unmanned Aerial Vehicle-Assisted Free Space Optical/Radio Frequency Relay System

A Combinatorial Bandit Approach to UAV-aided Edge Computing

Learning-Based Cooperative Aerial and Ground Vehicle Routing for Emergency Communications

UAV-Assisted Emergency Networks in Disasters

A Near-Optimal UAV-Aided Radio Coverage Strategy for Dense Urban Areas

Optimizing Drone Energy Use for Emergency Communications in Disasters via Deep Reinforcement Learning

LEO satellite assisted UAV distribution using combinatorial bandit with fairness and budget constraints

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

UAV-Based Intelligent Transportation System for Emergency Reporting in Coverage Holes of Wireless Networks

Joint Resource Allocation and Trajectory Design for Resilient Multi-UAV Communication Networks

Path-optimization Method for UAV-aided Relay Broadcast Communication System

Trajectory and Power Optimization for Multi-UAV Enabled Emergency Wireless Communications Networks

Fair Communications in UAV Networks for Rescue Applications

Joint Design of Access Point Selection and Path Planning for UAV-Assisted Cellular Networks