Abstract:This paper investigates the multi-Unmanned Aerial Vehicle (UAV)-assisted wireless-powered Mobile Edge Computing (MEC) system, where UAVs provide computation and powering services to mobile terminals. We aim to maximize the number of completed computation tasks by jointly optimizing the offloading decisions of all terminals and the trajectory planning of all UAVs. The action space of the system is extremely large and grows exponentially with the number of UAVs. In this case, single-agent learning will require an overlarge neural network, resulting in insufficient exploration. However, the offloading decisions and trajectory planning are two subproblems performed by different executants, providing an opportunity for problem-solving. We thus adopt the idea of decomposition and propose a 2-Tiered Multi-agent Soft Actor-Critic (2T-MSAC) algorithm, decomposing a single neural network into multiple small-scale networks. In the first tier, a single agent is used for offloading decisions, and an online pretrained model based on imitation learning is specially designed to accelerate the training process of this agent. In the second tier, UAVs utilize multiple agents to plan their trajectories. Each agent exerts its influence on the parameter update of other agents through actions and rewards, thereby achieving joint optimization. Simulation results demonstrate that the proposed algorithm can be applied to scenarios with various location distributions of terminals, outperforming existing benchmarks that perform well only in specific scenarios. In particular, 2T-MSAC increases the number of completed tasks by 45.5% in the scenario with uneven terminal distributions. Moreover, the pretrained model based on imitation learning reduces the convergence time of 2T-MSAC by 58.2%.

Secure Transmission for Multi-UAV-Assisted Mobile Edge Computing Based on Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Semi-Distributed Resource Management in UAV-Aided MEC Systems: A Multi-Agent Federated Reinforcement Learning Approach

Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks

Modeling on Resource Allocation for Age-Sensitive Mobile Edge Computing Using Federated Multi-Agent Reinforcement Learning

Multi-UAV Mobile Edge Computing and Path Planning Platform based on Reinforcement Learning

Intelligent ubiquitous computing for future UAV-enabled MEC network systems

A security optimization scheme for data security transmission in UAV-assisted edge networks based on Federal Learning

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

Online Edge Learning Offloading and Resource Management for UAV-Assisted MEC Secure Communications

Reinforcement Learning with UAV Assistance for Optimized Computation Offloading in Mobile Edge Computing

Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Distributed Offloading for Multi-UAV Swarms in MEC-Assisted 5G Heterogeneous Networks

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

Multi-objective Deep Reinforcement Learning for Computation offloading in UAV-Assisted Multi-Access Edge Computing

Multi-agent Deep Reinforcement Learning-based Trajectory Design for UAV-aided Edge Computing System.

Decomposition-based learning in drone-assisted wireless-powered mobile edge computing networks