Abstract:Unmanned aerial vehicles (UAVs) are increasingly deployed to provide wireless connectivity to static and mobile ground users in situations of increased network demand or points of failure in existing terrestrial cellular infrastructure. However, UAVs are energy-constrained and experience the challenge of interference from nearby UAV cells sharing the same frequency spectrum, thereby impacting the system's energy efficiency (EE). Recent approaches focus on optimising the system's EE by optimising the trajectory of UAVs serving only static ground users and neglecting mobile users. Several others neglect the impact of interference from nearby UAV cells, assuming an interference-free network environment. Despite growing research interest in decentralised control over centralised UAVs' control, direct collaboration among UAVs to improve coordination while optimising the systems' EE has not been adequately explored. To address this, we propose a direct collaborative communication-enabled multi-agent decentralised double deep Q-network (CMAD-DDQN) approach. The CMAD-DDQN is a collaborative algorithm that allows UAVs to explicitly share their telemetry via existing 3GPP guidelines by communicating with their nearest neighbours. This allows the agent-controlled UAVs to optimise their 3D flight trajectories by filling up knowledge gaps and converging to optimal policies. Simulation results show that the proposed approach outperforms existing baselines in terms of maximising the systems' EE without degrading coverage performance in the network. The CMAD-DDQN approach outperforms the MAD-DDQN that neglects direct collaboration among UAVs, the multi-agent deep deterministic policy gradient (MADDPG) and random policy approaches that consider a 2D UAV deployment design while neglecting interference from nearby UAV cells by about 15%, 65% and 85%, respectively.

Deep neural network based UAV deployment and dynamic power control for 6G-Envisioned intelligent warehouse logistics system

On Designing Multi-UAV aided Wireless Powered Dynamic Communication via Hierarchical Deep Reinforcement Learning

Energy-Efficient Coverage and Capacity Enhancement With Intelligent UAV-BSs Deployment in 6G Edge Networks

Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

Joint Power and 3D Trajectory Optimization for UAV-enabled Wireless Powered Communication Networks with Obstacles

Bandwidth Allocation and Power Control Optimization for Multi-UAVs Enabled 6G Network

Power Control in UAV-Supported Ultra Dense Networks: Communications, Caching, and Energy Transfer

Toward Smart Traffic Management With 3D Placement Optimization in UAV-Assisted NOMA IIoT Networks

UAVs as an Intelligent Service: Boosting Edge Intelligence for Air-Ground Integrated Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

Double Deep Q-Network Method for Energy Efficiency and Throughput in a UAV-Assisted Terrestrial Network

Energy-optimal DNN model placement in UAV-enabled edge computing networks

UAV Assisted Traffic Offloading in Air Ground Integrated Networks With Mixed User Traffic

Intelligent Path Planning for AGV-UAV Transportation in 6G Smart Warehouse

Communication-Enabled Deep Reinforcement Learning to Optimise Energy-Efficiency in UAV-Assisted Networks

UAV-Assisted Wireless-Powered Secure Communications: Integration of Optimization and Deep Learning

A Novel Network Optimization Scheme Based on Anti-Flocking and Improved Nash Equilibrium Algorithm

Novel Robust Dynamic Distributed Drone-Deployment Strategy for Channel-Capacity Optimization for Three-Dimensional UAV-Aided Ad Hoc Networks

Multi-objective Aerial Collaborative Secure Communication Optimization via Generative Diffusion Model-enabled Deep Reinforcement Learning

Deep Q-Network Based Resource Allocation for UAV-assisted Ultra-Dense Networks