Abstract:The dynamic position deployment and resource allocation of the unmanned aerial vehicle (UAV) communication networks has great significance in terms of interference management, coverage enhancement, and capacity improvement. Since the transmission power and energy resources of the UAVs are limited and the actual communication environment is complex and time-varying, it is challenging for the multiple UAVs to dynamically make decisions to ensure the communication performance of the system. Meanwhile, the centralized architecture may generate a certain degree of communication delay and affect communication efficiency. Facing this challenge, a resource allocation algorithm for the UAV networks based on multi-agent collaborative environment learning is proposed. This method is based on a distributed architecture. Each UAV is modeled as an independent agent, which improves the utility of the UAV networks through the dynamic selection decisions of its deployment position, transmission power, and occupied sub-channels. Each UAV learns the mapping of the network information to the position deployment and resource selection decisions based on the reinforcement learning algorithm according to partial of the state information it can observe. For the overall network, a multi-agent reinforcement learning method based on federated learning is designed on the purpose of realizing information interaction and combined dispatching of the UAVs. In the multi-agent system, the framework of federated learning is introduced to realize the sharing of non-privacy data among the UAVs. Simulation results indicate that the proposed method can effectively improve the network utility compared with the multi-agent deep reinforcement learning algorithm without information interaction.

A Research on Collaborative UAVs Intelligent Decision Optimization for AoI-driven Federated Learning

Non-orthogonal Multiple Access Assisted Federated Learning for UAV Swarms: an Approach of Latency Minimization

A Multi-Agent Collaborative Environment Learning Method for UAV Deployment and Resource Allocation

Energy-Efficient Federated Learning Through UAV Edge under Location Uncertainties

Enhancing the Efficiency of UAV Swarms Communication in 5G Networks Through a Hybrid Split and Federated Learning Approach.

Multiple Dual-Function UAVs Cooperative Computation Offloading in Hybrid Mobile Edge Computing Systems

Privacy-Preserving Federated Learning for UAV-Enabled Networks: Learning-Based Joint Scheduling and Resource Management

Multi-UAV-Assisted Federated Learning for Energy-Aware Distributed Edge Training

A Federated Learning Latency Minimization Method for UAV Swarms Aided by Communication Compression and Energy Allocation

Optimizing Data-Driven Federated Learning in UAV Networks

Joint UAV Location and Resource Allocation for Air-Ground Integrated Federated Learning

Fed4UL: A Cloud–Edge–End Collaborative Federated Learning Framework for Addressing the Non-IID Data Issue in UAV Logistics

Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning

Joint Trajectory and Communication Optimization for UAV-Assisted Over-The-Air Federated Learning.

Asynchronous Federated Learning for Resource Allocation in Software Defined Internet of UAVs

Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

Federated Deep Reinforcement Learning-Based Intelligent Dynamic Services in UAV-Assisted MEC

Deep Reinforcement Learning-Based Resource Allocation for UAV-Enabled Federated Edge Learning

The Data Value Based Asynchronous Federated Learning for UAV Swarm under Unstable Communication Scenarios