Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Decentralized Edge Intelligence-Driven Network Resource Orchestration Mechanism

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Dynamic Resource Management in MEC Powered by Edge Intelligence for Smart City Internet of Things

Cost-effective Service Deployment and Balanced Traffic Management on Edge

Multi-Agent Driven Resource Allocation and Interference Management for Deep Edge Networks

Relay-Assisted Edge Computing Framework for Dynamic Resource Allocation and Multiple-Access Tasks Processing in Digital Divide Regions

Dynamic Offloading Method for Mobile Edge Computing of Internet of Vehicles Based on Multi-Vehicle Users and Multi-MEC Servers

Multi-Layer Computation Offloading in Distributed Heterogeneous Mobile Edge Computing Networks

An intelligent approach of task offloading for dependent services in Mobile Edge Computing

Energy-efficient edge intelligence for task-dependency MEC power grid networks

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Energy-effective artificial internet-of-things application deployment in edge-cloud systems

Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network

Improved DDPG Based Two-Timescale Multi-Dimensional Resource Allocation for Multi-Access Edge Computing Networks

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Multi-Service Edge Computing Management With Multi-Stage Coalition Game Task Offloading

Edge Intelligence-driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things

Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning

Identifier-Driven Resource Orchestration With Quantum Computing for Differentiated Services in IoT-MMEC Networks

Age-of-Information-Based Computation Offloading and Transmission Scheduling in Mobile-Edge-Computing-Enabled IoT Networks

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks