Abstract:This paper investigates the multi-Unmanned Aerial Vehicle (UAV)-assisted wireless-powered Mobile Edge Computing (MEC) system, where UAVs provide computation and powering services to mobile terminals. We aim to maximize the number of completed computation tasks by jointly optimizing the offloading decisions of all terminals and the trajectory planning of all UAVs. The action space of the system is extremely large and grows exponentially with the number of UAVs. In this case, single-agent learning will require an overlarge neural network, resulting in insufficient exploration. However, the offloading decisions and trajectory planning are two subproblems performed by different executants, providing an opportunity for problem-solving. We thus adopt the idea of decomposition and propose a 2-Tiered Multi-agent Soft Actor-Critic (2T-MSAC) algorithm, decomposing a single neural network into multiple small-scale networks. In the first tier, a single agent is used for offloading decisions, and an online pretrained model based on imitation learning is specially designed to accelerate the training process of this agent. In the second tier, UAVs utilize multiple agents to plan their trajectories. Each agent exerts its influence on the parameter update of other agents through actions and rewards, thereby achieving joint optimization. Simulation results demonstrate that the proposed algorithm can be applied to scenarios with various location distributions of terminals, outperforming existing benchmarks that perform well only in specific scenarios. In particular, 2T-MSAC increases the number of completed tasks by 45.5% in the scenario with uneven terminal distributions. Moreover, the pretrained model based on imitation learning reduces the convergence time of 2T-MSAC by 58.2%.

Transfer Learning for Distributed Intelligence in Aerial Edge Networks

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Predictive UAV Base Station Deployment and Service Offloading With Distributed Edge Learning

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Efficient Edge Intelligence under Clustering for UAV Swarm Networks

UAVs as an Intelligent Service: Boosting Edge Intelligence for Air-Ground Integrated Networks

Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks

Secure Transmission for Multi-UAV-Assisted Mobile Edge Computing Based on Reinforcement Learning

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Two-Layer Edge Intelligence for Task Offloading and Computing Capacity Allocation with UAV Assistance in Vehicular Networks

Multi-UAV-Assisted Federated Learning for Energy-Aware Distributed Edge Training

FlexEdge: Digital Twin-Enabled Task Offloading for UAV-Aided Vehicular Edge Computing

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Mobile-Aware Service Offloading for UAV-Assisted IoVs: A Multi-Agent Tiny Distributed Learning Approach

Cloud-Edge Collaborative Optimization Based on Distributed UAV Network

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Decomposition-based learning in drone-assisted wireless-powered mobile edge computing networks

Intelligent task offloading and collaborative computation in multi-UAV-enabled mobile edge computing

Empowering Edge Intelligence by Air-Ground Integrated Federated Learning

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing