Abstract:Unmanned Aerial Vehicles (UAVs) can be deployed as aerial wireless base stations which dynamically cover the wireless communication networks for Ground Users (GUs). The most challenging problem is how to control multi-UAVs to achieve on-demand coverage of wireless communication networks while maintaining connectivity among them. In this paper, the cooperative trajectory optimization of UAVs is studied to maximize the communication efficiency in the dynamic deployment of UAVs for emergency communication scenarios. We transform the problem into a Markov game problem and propose a distributed trajectory optimization algorithm, Double-Stream Attention multi-agent Actor-Critic (DSAAC), based on Multi-Agent Deep Reinforcement Learning (MADRL). The throughput, safety distance, and power consumption of UAVs are comprehensively taken into account for designing a practical reward function. For complex emergency communication scenarios, we design a double data stream network structure that provides a capacity for the Actor network to process state changes. Thus, UAVs can sense the movement trends of the GUs as well as other UAVs. To establish effective cooperation strategies for UAVs, we develop a hierarchical multi-head attention encoder in the Critic network. This encoder can reduce the redundant information through the attention mechanism, which resolves the problem of the curse of dimensionality as the number of both UAVs and GUs increases. We construct a simulation environment for emergency networks with multi-UAVs and compare the effects of the different numbers of GUs and UAVs on algorithms. The DSAAC algorithm improves communication efficiency by 56.7%, throughput by 71.2%, energy saving by 19.8%, and reduces the number of crashes by 57.7%.

Energy-Efficient UAV Communications under Stochastic Trajectory: A Markov Decision Process Approach

A Probabilistic Scheduling Policy for Energy Efficient UAV Communications with Delay Constraints.

Delay-Tolerant UAV-Assisted Communication: Online Trajectory Design and User Association

Energy Tradeoff in Ground-to-UAV Communication Via Trajectory Design

Optimal Transmission Control and Learning-Based Trajectory Design for UAV-Assisted Detection and Communication

Energy Trade-off in Ground-to-UAV Communication via Trajectory Design

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

Trajectory Design for Energy Minimization in UAV-enabled Wireless Communications with Latency Constraints

An Efficient Solution for Joint Power and Trajectory Optimization in UAV-Enabled Wireless Network.

Energy-Efficient UAV Communications in the Presence of Wind: 3D Modeling and Trajectory Design

Cellular-Connected Multi-UAV MEC Networks: an Online Stochastic Optimization Approach

Efficient Trajectory Planning and Dynamic Resource Allocation for UAV-Enabled MEC System

Trajectory Design and Resource Allocation for Multi-UAV-Assisted Sensing, Communication, and Edge Computing Integration

Energy- and Cost-Efficient Transmission Strategy for UAV Trajectory Tracking Control: A Deep Reinforcement Learning Approach

UAV Trajectory Planning from a Comprehensive Energy Efficiency Perspective in Harsh Environments

Unmanned Aerial Vehicle-Aided Communications: Joint Transmit Power and Trajectory Optimization.

Energy-Efficient UAV-Enabled MEC System: Bits Allocation Optimization and Trajectory Design

Joint Power-Trajectory-Scheduling Optimization in A Mobile UAV-Enabled Network Via Alternating Iteration

Multi-UAV Trajectory Planning for Energy-Efficient Content Coverage: A Decentralized Learning-Based Approach

Energy Management and Trajectory Optimization for UAV-Enabled Legitimate Monitoring Systems

Energy Efficient Trajectory Optimization and Resource Allocation for HAP-Assisted UAV Wireless Networks.