Abstract:Unmanned aerial vehicles (UAVs) are increasingly deployed to provide wireless connectivity to static and mobile ground users in situations of increased network demand or points of failure in existing terrestrial cellular infrastructure. However, UAVs are energy-constrained and experience the challenge of interference from nearby UAV cells sharing the same frequency spectrum, thereby impacting the system's energy efficiency (EE). Recent approaches focus on optimising the system's EE by optimising the trajectory of UAVs serving only static ground users and neglecting mobile users. Several others neglect the impact of interference from nearby UAV cells, assuming an interference-free network environment. Despite growing research interest in decentralised control over centralised UAVs' control, direct collaboration among UAVs to improve coordination while optimising the systems' EE has not been adequately explored. To address this, we propose a direct collaborative communication-enabled multi-agent decentralised double deep Q-network (CMAD-DDQN) approach. The CMAD-DDQN is a collaborative algorithm that allows UAVs to explicitly share their telemetry via existing 3GPP guidelines by communicating with their nearest neighbours. This allows the agent-controlled UAVs to optimise their 3D flight trajectories by filling up knowledge gaps and converging to optimal policies. Simulation results show that the proposed approach outperforms existing baselines in terms of maximising the systems' EE without degrading coverage performance in the network. The CMAD-DDQN approach outperforms the MAD-DDQN that neglects direct collaboration among UAVs, the multi-agent deep deterministic policy gradient (MADDPG) and random policy approaches that consider a 2D UAV deployment design while neglecting interference from nearby UAV cells by about 15%, 65% and 85%, respectively.

UAV 5G: enabled wireless communications using enhanced deep learning for edge devices

UAV Deployment Optimization in UAV-assisted Wireless Communications

Energy-Efficient Coverage and Capacity Enhancement With Intelligent UAV-BSs Deployment in 6G Edge Networks

Dynamic Trajectory Design and Bandwidth Adjustment for Energy-Efficient UAV-Assisted Relaying with Deep Reinforcement Learning in MEC IoT System

An Energy-Efficient Selection Mechanism of Relay and Edge Computing in UAV-Assisted Cellular Networks

Green Offloading and Trajectory Scheduling of Rechargeable UAVs in Aerial Edge Networks

Communication-Enabled Deep Reinforcement Learning to Optimise Energy-Efficiency in UAV-Assisted Networks

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Digital Twin-Empowered Offloading Optimisation and Resource Allocation for UAV-Assisted IoT Network Systems

Resource Allocation for Aerial Assisted Digital Twin Edge Mobile Network

Battery-constrained Federated Edge Learning in UAV-enabled IoT for B5G/6G Networks

5G-enabled UAVs for energy-efficient opportunistic networking

Double Deep Q-Network Method for Energy Efficiency and Throughput in a UAV-Assisted Terrestrial Network

Energy Efficient for UAV-enabled Mobile Edge Computing Networks: Intelligent Task Prediction and Offloading.

Multi-objective Aerial Collaborative Secure Communication Optimization via Generative Diffusion Model-enabled Deep Reinforcement Learning

Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach

Transfer Learning Empowered Resource Scheduling in Aerial Edge Networks.

Deep-EERA: DRL-Based Energy-Efficient Resource Allocation in UAV-Empowered Beyond 5G Networks

Energy-optimal DNN model placement in UAV-enabled edge computing networks

Blind reconfigurable intelligent surfaces for dynamic offloading in fixed-NOMA mobile edge networks

An UAV-assisted mobile edge computing offloading strategy for minimizing energy consumption