Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

DeepHop on Edge: Hop-by-hop Routing Bydistributed Learning with Semantic Attention.

RTHop: Real-Time Hop-by-Hop Mobile Network Routing by Decentralized Learning With Semantic Attention

DeepCC: Multi-Agent Deep Reinforcement Learning Congestion Control for Multi-Path TCP Based on Self-Attention

Hierarchical Multi-Agent Deep Reinforcement Learning for Energy-Efficient Hybrid Computation Offloading

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

A Multi-agent Reinforcement Learning Based Offloading Strategy for Multi-access Edge Computing

Hierarchical Multi-Agent Deep Reinforcement Learning for Backscatter-aided Data Offloading

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

DeepSCJD: An Online Deep Learning-Based Model for Secure Collaborative Job Dispatching in Edge Computing.

Task Computation Offloading for Multi-Access Edge Computing Via Attention Communication Deep Reinforcement Learning.

Backscatter-Aided Hybrid Data Offloading for Mobile Edge Computing via Deep Reinforcement Learning

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Experience-based Computation Offloading by Deep Reinforcement Learning for Multi-access Edge Computing Network.

Fair and Efficient Distributed Edge Learning with Hybrid Multipath TCP

A Multi-update Deep Reinforcement Learning Algorithm for Edge Computing Service Offloading

Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Deep Reinforcement Learning Based Computation Offloading for Mobility-Aware Edge Computing.

Distributed Task Offloading Based on Multi-Agent Deep Reinforcement Learning.