Abstract:Unmanned Aerial Vehicles (UAVs) can be deployed as aerial wireless base stations which dynamically cover the wireless communication networks for Ground Users (GUs). The most challenging problem is how to control multi-UAVs to achieve on-demand coverage of wireless communication networks while maintaining connectivity among them. In this paper, the cooperative trajectory optimization of UAVs is studied to maximize the communication efficiency in the dynamic deployment of UAVs for emergency communication scenarios. We transform the problem into a Markov game problem and propose a distributed trajectory optimization algorithm, Double-Stream Attention multi-agent Actor-Critic (DSAAC), based on Multi-Agent Deep Reinforcement Learning (MADRL). The throughput, safety distance, and power consumption of UAVs are comprehensively taken into account for designing a practical reward function. For complex emergency communication scenarios, we design a double data stream network structure that provides a capacity for the Actor network to process state changes. Thus, UAVs can sense the movement trends of the GUs as well as other UAVs. To establish effective cooperation strategies for UAVs, we develop a hierarchical multi-head attention encoder in the Critic network. This encoder can reduce the redundant information through the attention mechanism, which resolves the problem of the curse of dimensionality as the number of both UAVs and GUs increases. We construct a simulation environment for emergency networks with multi-UAVs and compare the effects of the different numbers of GUs and UAVs on algorithms. The DSAAC algorithm improves communication efficiency by 56.7%, throughput by 71.2%, energy saving by 19.8%, and reduces the number of crashes by 57.7%.

Cooperative Intelligence-Based UAV Swarm for Establishing Emergency Communication

Disaster Resilient Emergency Communication With Intelligent Air-Ground Cooperation

QoE‐driven multi‐UAV deployment scheme for emergency communication networks

UAV Swarms for Joint Data Ferrying and Dynamic Cell Coverage via Optimal Transport Descent and Quadratic Assignment

Enhanced Emergency Communication Services for Post–Disaster Rescue: Multi-IRS Assisted Air-Ground Integrated Data Collection

Air-to-Ground Communications Beyond 5G: UAV Swarm Formation Control and Tracking

A UAV-Swarm-Communication Model Using a Machine-Learning Approach for Search-and-Rescue Applications

An Unmanned Air Combat System Based on Swarm Intelligence

UAV Swarm-enabled Collaborative Secure Relay Communications with Time-domain Colluding Eavesdropper

An Improved Virtual Force Approach for UAV Deployment and Resource Allocation in Emergency Communications

Swarm UAVs Communication

Coordinated flight control of miniature fixed-wing UAV swarms: methods and experiments

Energy-Efficient Multi-UAVs Cooperative Trajectory Optimization for Communication Coverage: An MADRL Approach

Research on Low-Energy-consumption Deployment of Emergency UAV Network for Integrated Communication-Navigating-sensing

UAV-Assisted Emergency Networks in Disasters

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Long-term area coverage and radio relay positioning using swarms of UAVs

Energy-Efficient UAV Swarm Assisted MEC with Dynamic Clustering and Scheduling

Finite State Machines-Based Path-Following Collaborative Computing Strategy for Emergency UAV Swarms

Joint Deployment and Trajectory Planning of Multiple UAVs for Emergency Communications

Multi-UAV Distributed Collaborative Coverage for Target Search Using Heuristic Strategy