Abstract:To address the challenges posed by a large number of disaster-waiver-affected users and the complexities of scaling centralized algorithms for rapidly restoring emergency communication services, the paper proposes a distributed intent-based optimization architecture based on multi-agent reinforcement learning. This approach aims to mitigate service discrepancies and dynamics among users. In the network feature layer, a distributed K-sums clustering algorithm considers variations in user services. Each UAV base station autonomously and minimally adjusts the local network structure based on user requirements. It selects user features from the cluster center as input states for the multi-agent reinforcement learning neural network. In the trajectory regulation layer, the paper introduces a multi-agent maximum entropy reinforcement learning (MASAC) algorithm. The UAV base station, acting as an intelligent node, governs its flight trajectory within the framework of "distributed training – distributed execution." The paper incorporates techniques such as integrated learning and curriculum learning to enhance training stability and convergence speed. Simulation results demonstrate the effectiveness of our distributed K-sums clustering algorithm in terms of load efficiency and cluster balance, outperforming the traditional K-means algorithm. Additionally, the UAV base station trajectory control algorithm based on MASAC significantly reduces communication interruptions, enhances network spectral efficiency, and surpasses existing reinforcement learning methods.

Resilient UAV Swarm Communications With Graph Convolutional Neural Network

Multi-hop Differential Topology based Algorithms for Resilient Network of UAV Swarm

Multi-hop Diffused Graph Convolution for Resilient UAV Swarm Networks.

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Unmanned Aerial Vehicle Cooperative Data Dissemination Based on Graph Neural Networks

Multi-UAV Collaborative Surveillance Network Recovery Via Deep Reinforcement Learning

Knowledge graph completion assisted graph neural network for spectrum resource optimization of UAV swarm

A Multistate Network Approach for Resilience Analysis of UAV Swarm considering Information Exchange Capacity

Advancing UAV Sensor Fault Diagnosis Based on Prior Knowledge and Graph Convolutional Network

Multidimensional Trajectory Prediction of UAV Swarms Based on Dynamic Graph Neural Network

GNN-Enabled Optimization of Placement and Transmission Design for UAV Communications

Graph-Based Multi-agent Reinforcement Learning for Large-Scale UAVs Swarm System Control

Anti-Jamming Path Planning Using GCN for Multi-UAV

Disaster Resilient Emergency Communication With Intelligent Air-Ground Cooperation

Graph Convolutional Multi-Agent Reinforcement Learning For Uav Coverage Control

Fault-tolerant cooperative navigation of networked UAV swarms for forest fire monitoring

Learning-Based UAV Trajectory Optimization with Collision Avoidance and Connectivity Constraints

Scheduling UAV Swarm with Attention-based Graph Reinforcement Learning for Ground-to-air Heterogeneous Data Communication

Deployment of Unmanned Aerial Vehicles in Next-Generation Wireless Communication Network Using Multi-Agent Reinforcement Learning

Research on UAV Swarm Network Modeling and Resilience Assessment Methods

Research on Low-Energy-consumption Deployment of Emergency UAV Network for Integrated Communication-Navigating-sensing