Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

OSCA: Online User-managed Server Selection and Configuration Adaptation for Interactive MAR.

Joint Computation Offloading and Resource Allocation for MEC-Enabled IoT Systems with Imperfect CSI

Reinforcement Learning-based Mobile Edge Computing and Transmission Scheduling for Video Surveillance

Video Surveillance on Mobile Edge Networks—A Reinforcement-Learning-Based Approach

Online Learning Algorithms for Offloading Augmented Reality Requests with Uncertain Demands in MECs

An Adaptive User Service Deployment Strategy for Mobile Edge Computing

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Offloading Tasks to Unknown Edge Servers: A Contextual Multi-Armed Bandit Approach.

Look-Ahead Task Offloading for Multi-User Mobile Augmented Reality in Edge-Cloud Computing

Adaptive Configuration Selection and Bandwidth Allocation for Edge-Based Video Analytics

NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Age-of-Information-Aware Distributed Task Offloading and Resource Allocation in Mobile Edge Computing Networks

Reconfigurable Intelligent Surface Assisted Mobile Edge Computing With Heterogeneous Learning Tasks

Joint Multi-User DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligence

OsmoticGate: Adaptive Edge-Based Real-Time Video Analytics for the Internet of Things

Online Multi-Task Offloading for Semantic-Aware Edge Computing Systems

Deep Reinforcement Learning-Based Video Offloading and Resource Allocation in NOMA-Enabled Networks

Dynamic Multi-time Scale User Admission and Resource Allocation for Semantic Extraction in MEC Systems

Dynamic Computation Offloading and Server Deployment for UAV-Enabled Multi-Access Edge Computing

SARS: A Resource Selection Algorithm for Autonomous Driving Tasks in Heterogeneous Mobile Edge Computing