Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

RAOA: A Relay-assisted Offloading Approach in Edge Computing Environment

D2D-Based Multi-relay-Assisted Computation Offloading in Edge Computing Network.

A Density-Based Offloading Strategy for IoT Devices in Edge Computing Systems

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Efficient Resource Allocation for Relay-Assisted Computation Offloading in Mobile Edge Computing

Relay-Assisted Edge Computing Framework for Dynamic Resource Allocation and Multiple-Access Tasks Processing in Digital Divide Regions

A Mobility-Aware Cross-Edge Computation Offloading Framework for Partitionable Applications

Collaborative Offloading Strategy for Dependent Tasks in Mobile Edge Computing

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

CooCo: A Collaborative Offloading and Resource Configuration Algorithm in Edge Networks

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Dependent task offloading mechanism for cloud–edge-device collaboration

Algorithmics of Cost-Driven Computation Offloading in the Edge-Cloud Environment

Edge Cloud Offloading Algorithms: Issues, Methods, and Perspectives

An efficient computational offloading framework using HAA optimization-based deep reinforcement learning in edge-based cloud computing architecture

A relay-assisted parallel offloading strategy for multi-source tasks in internet of vehicles

Online Computation Offloading for Deadline-Aware Tasks in Edge Computing

Echo: An Edge-Centric Code Offloading System with Quality of Service Guarantee