Abstract:Exploiting highly maneuverable unmanned aerial vehicles (UAVs) has been considered as an efficient way to assist wireless systems, e.g., for applications of data collection. However, several challenges remain to be addressed in the design of such UAV-assisted networks, including multi-UAV joint trajectory determination, data privacy protection, and adaption to the complex channel environment particularly with mobile ground devices (GDs). In this paper, we study a multi-UAV assisted data collection system where UAVs collect data locally from mobile GDs. The aim is to minimize the whole operation time cost via jointly optimizing the UAVs' three-dimensional (3D) trajectory together with the GDs' communication scheduling, while satisfying the constraints of no-fly zones (NFZs) and collision avoidance. With a nonconvex feasible set (due to the NFZs), the established problem is nonconvex. Moreover, the randomness of GDs movements significantly reduces the performance of a typical redesign, i.e., determining the UAVs' trajectory and users' scheduling before starting the data collection task. To tackle these issues, we first transform the established problem into a Markov decision one, and then propose a multi-agent federated reinforcement learning (MAFRL)-based approach to optimize the dynamic long-term objective via jointly determining UAVs' 3D trajectory and GD's communication scheduling. A multi-step propagation technique and a dueling network architecture are adopted to enhance the neural network utilized to train agents, i.e., to accelerate the convergence rate of the proposed method and improve its overall stability. Finally, experimental results reveal the effectiveness of our proposed method in the considered practical scenario.

Model-aided Federated Reinforcement Learning for Multi-UAV Trajectory Planning in IoT Networks

Federated deep reinforcement learning based trajectory design for UAV-assisted networks with mobile ground devices

Multi - Agent Reinforcement Learning for Backscattering Data Collection in Multi-UAV IoT

Dense Multi-Agent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks

Reinforcement Learning Assisted Multi-UAV Task Allocation and Path Planning for IIoT

Semi-Distributed Resource Management in UAV-Aided MEC Systems: A Multi-Agent Federated Reinforcement Learning Approach

Joint UAV trajectory and communication design with heterogeneous multi-agent reinforcement learning

On collaborative multi-UAV trajectory planning for data collection

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Graph Convolutional Multi-Agent Reinforcement Learning For Uav Coverage Control

Multi-Agent Reinforcement Learning-Based Resource Sharing in Multi-UAV Wireless Networks

GAN-powered heterogeneous multi-agent reinforcement learning for UAV-assisted task offloading

Autonomous and cooperative control of UAV cluster with multi-agent reinforcement learning

Model-aided Deep Reinforcement Learning for Sample-efficient UAV Trajectory Design in IoT Networks

Multi-Agent Reinforcement Learning for Offloading Cellular Communications with Cooperating UAVs

Joint Multi-UAV Deployment and Resource Allocation Based on Personalized Federated Deep Reinforcement Learning.

Multi-UAV Cooperative Search in Multi-Layered Aerial Computing Networks: A Multi-Agent Deep Reinforcement Learning Approach

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

Multi-UAV-Assisted Federated Learning for Energy-Aware Distributed Edge Training