Abstract:In this paper, we present a novel method to enhance the sum-rate effectiveness in full-duplex unmanned aerial vehicle (UAV)-assisted communication networks. Existing approaches often couple uplink and downlink associations, resulting in suboptimal performance, particularly in dynamic environments where user demands and network conditions are unpredictable. To overcome these limitations, we propose a decoupling of uplink and downlink associations for ground-based users (GBUs), significantly improving network efficiency. We formulate a comprehensive optimization problem that integrates UAV trajectory design and user association, aiming to maximize the overall sum-rate efficiency of the network. Due to the problem's non-convexity, we reformulate it as a Partially Observable Markov Decision Process (POMDP), enabling UAVs to make real-time decisions based on local observations without requiring complete global information. Our framework employs multi-agent deep reinforcement learning (MADRL), specifically the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm, which balances centralized training with distributed execution. This allows UAVs to efficiently learn optimal user associations and trajectory controls while dynamically adapting to local conditions. The proposed solution is particularly suited for critical applications such as disaster response and search and rescue missions, highlighting the practical significance of utilizing UAVs for rapid network deployment in emergencies. By addressing the limitations of existing centralized and distributed solutions, our hybrid model combines the benefits of centralized training with the adaptability of distributed inference, ensuring optimal UAV operations in real-time scenarios.

Matching combined multi-agent reinforcement learning for uav secure data dissemination

Mean-Field Multi-Agent Reinforcement Learning for UAV Assisted Secure Data Dissemination.

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Secure UAV Communications

Cooperative Secure Communication in UAV Assisted Networks with Dynamic Role Switching.

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

Deep Reinforcement Learning for UAV-Assisted Covert Data Dissemination.

Air-Ground Coordination Communication by Multi-Agent Deep Reinforcement Learning

UAV-assisted fair communications for multi-pair users: A multi-agent deep reinforcement learning method

Delay-Tolerant Multi-Agent DRL for Trajectory Planning and Transmission Control in UAV-Assisted Wireless Networks

Multi-Agent Reinforcement Learning-Based Resource Sharing in Multi-UAV Wireless Networks

Distributed UAV-BSs Trajectory Optimization for User-Level Fair Communication Service with Multi-Agent Deep Reinforcement Learning

Joint UAV trajectory and communication design with heterogeneous multi-agent reinforcement learning

Multi‐agent Reinforcement Learning Based Transmission Scheme for IRS‐assisted Multi‐uav Systems

Maximizing UAV Coverage in Maritime Wireless Networks: A Multiagent Reinforcement Learning Approach

Joint Optimization of Multi-UAV Deployment and User Association Via Deep Reinforcement Learning for Long-Term Communication Coverage

Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment

Three-Dimensional Trajectory and Resource Allocation Optimization in Multi-Unmanned Aerial Vehicle Multicast System: A Multi-Agent Reinforcement Learning Method

Dense Multi-Agent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks

Multi-objective Aerial Collaborative Secure Communication Optimization via Generative Diffusion Model-enabled Deep Reinforcement Learning