Abstract:The dynamic position deployment and resource allocation of the unmanned aerial vehicle (UAV) communication networks has great significance in terms of interference management, coverage enhancement, and capacity improvement. Since the transmission power and energy resources of the UAVs are limited and the actual communication environment is complex and time-varying, it is challenging for the multiple UAVs to dynamically make decisions to ensure the communication performance of the system. Meanwhile, the centralized architecture may generate a certain degree of communication delay and affect communication efficiency. Facing this challenge, a resource allocation algorithm for the UAV networks based on multi-agent collaborative environment learning is proposed. This method is based on a distributed architecture. Each UAV is modeled as an independent agent, which improves the utility of the UAV networks through the dynamic selection decisions of its deployment position, transmission power, and occupied sub-channels. Each UAV learns the mapping of the network information to the position deployment and resource selection decisions based on the reinforcement learning algorithm according to partial of the state information it can observe. For the overall network, a multi-agent reinforcement learning method based on federated learning is designed on the purpose of realizing information interaction and combined dispatching of the UAVs. In the multi-agent system, the framework of federated learning is introduced to realize the sharing of non-privacy data among the UAVs. Simulation results indicate that the proposed method can effectively improve the network utility compared with the multi-agent deep reinforcement learning algorithm without information interaction.

Multi-Agent Planning in Heterogeneous Networks

Position Optimization and Resource Allocation for Cooperative Heterogeneous Aerial Networks.

Position Optimization and Resource Management for UAV-Assisted Wireless Sensor Networks

Distributed Cooperative Control for Deployment and Task Allocation of Unmanned Aerial Vehicle Networks

Multi Mobile Agent Itinerary Planning Based on Network Coverage and Multi-Objective Discrete Social Spider Optimization Algorithm

Multi-region Coverage Path Planning for Heterogeneous Unmanned Aerial Vehicles Systems

Deep Reinforcement Learning-Based UAV Path Planning for Energy-Efficient Multitier Cooperative Computing in Wireless Sensor Networks

A Multi-Agent Collaborative Environment Learning Method for UAV Deployment and Resource Allocation

Distributed Cooperative Planning for Multiple UAVs Based on Agent Negotiation

Multi-agent Cooperation for Computing Power Scheduling in UAVs Empowered Aerial Computing Systems

Research on UAV-Aided WSNs Node Positioning Task Planning in Field Environment

A Multi-Agent Collaboration Scheme for Energy-Efficient Task Scheduling in a 3D UAV-MEC Space

Energy-efficient multi-UAV coverage deployment in UAV networks: A game-theoretic framework

Multi-task Planning for Cooperative UAVs with Integrated Radio Frequency System

Optimizing Communication and Computation for Multi-UAV Information Gathering Applications

Multi-UAV Collaborative Edge Computing Algorithm for Joint Task Offloading and Channel Resource Allocation

An Integrated Mission Planning Framework for Sensor Allocation and Path Planning of Heterogeneous Multi-UAV Systems

Multi-agent Resource Allocation Strategy for UAV Swarm-Based Cooperative Sensing

Energy-efficient Cooperative Multi-UAV Coverage Scheme with Limited Wireless Backhaul.

Joint Deployment and Resource Allocation for Service Provision in Multi-UAV-Assisted Wireless Networks

Multi-Agent Itinerary Planning for Wireless Sensor Networks