Abstract:Unmanned Aerial Vehicles (UAVs), due to their low cost and high flexibility, have been widely used in various scenarios to enhance network performance. However, the optimization of UAV trajectories in unknown areas or areas without sufficient prior information, still faces challenges related to poor planning performance and low distributed execution. These challenges arise when UAVs rely solely on their own observation information and the information from other UAVs within their communicable range, without access to global information. To address these challenges, this paper proposes the Qedgix framework, which combines graph neural networks (GNNs) and the QMIX algorithm to achieve distributed optimization of the Age of Information (AoI) for users in unknown scenarios. The framework utilizes GNNs to extract information from UAVs, users within the observable range, and other UAVs within the communicable range, thereby enabling effective UAV trajectory planning. Due to the discretization and temporal features of AoI indicators, the Qedgix framework employs QMIX to optimize distributed partially observable Markov decision processes (Dec-POMDP) based on centralized training and distributed execution (CTDE) with respect to mean AoI values of users. By modeling the UAV network optimization problem in terms of AoI and applying the Kolmogorov-Arnold representation theorem, the Qedgix framework achieves efficient neural network training through parameter sharing based on permutation invariance. Simulation results demonstrate that the proposed algorithm significantly improves convergence speed while reducing the mean AoI values of users. The code is available at <a class="link-external link-https" href="https://github.com/UNIC-Lab/Qedgix" rel="external noopener nofollow">this https URL</a>.

Mixed-initiative Manned-unmanned Teamwork Using Coactive Design and Graph Neural Network

Heterogeneous multi-agent task allocation based on graph neural network ant colony optimization algorithms

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Applying vision-guided graph neural networks for adaptive task planning in dynamic human robot collaborative scenarios

Joint Neural Network for Trajectory and Communication Design in Multi-DAV Systems

GNN-Empowered Effective Partial Observation MARL Method for AoI Management in Multi-UAV Network

A stacked graph neural network with self-exciting process for robotic cognitive strategy reasoning in proactive human-robot collaborative assembly

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

End-to-end decentralized formation control using a graph neural network-based learning method

Graph Neural Networks with Model-based Reinforcement Learning for Multi-agent Systems

Graph-Based Multi-agent Reinforcement Learning for Large-Scale UAVs Swarm System Control

Graph Attention-based Reinforcement Learning for Trajectory Design and Resource Assignment in Multi-UAV Assisted Communication

Multilevel Graph Reinforcement Learning for Consistent Cognitive Decision-making in Heterogeneous Mixed Autonomy

Collaborative Decision-Making Using Spatiotemporal Graphs in Connected Autonomy

Graph MADDPG with RNN for multiagent cooperative environment

Graph Neural Network for Decentralized Multi-Robot Goal Assignment

Graph Convolutional Multi-Agent Reinforcement Learning For Uav Coverage Control

Mean policy-based proximal policy optimization for maneuvering decision in multi-UAV air combat

Cooperative Trajectory Design of Multiple UAV Base Stations With Heterogeneous Graph Neural Networks

Cooperative Planning of Multi-Uav Logistics Delivery by Multi-Graph Reinforcement Learning

G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks