Abstract:With the arrival of 5G technology and the popularization of the Internet of Things (IoT), mobile edge computing (MEC) has great potential in handling delay-sensitive and compute-intensive (DSCI) applications. Meanwhile, the need for reduced latency and improved energy efficiency in terminal devices is becoming urgent increasingly. However, the users are affected by channel conditions and bursty computational demands in dynamic MEC environments, which can lead to longer task correspondence times. Therefore, finding an efficient task offloading method in stochastic systems is crucial for optimizing system energy consumption. Additionally, the delay due to frequent user-MEC interactions cannot be overlooked. In this article, we initially frame the task offloading issue as a dynamic optimization issue. The goal is to minimize the system's long-term energy consumption while ensuring the task queue's stability over the long term. Using the Lyapunov optimization technique, the task processing deadline problem is converted into a stability control problem for the virtual queue. Then, a novel Lyapunov-guided deep reinforcement learning (DRL) for delay-aware offloading algorithm (LyD2OA) is designed. LyD2OA can figure out the task offloading scheme online, and adaptively offload the task with better network quality. Meanwhile, it ensures that deadlines are not violated when offloading tasks in poor communication environments. In addition, we perform a rigorous mathematical analysis of the performance of Ly2DOA and prove the existence of upper bounds on the virtual queue. It is theoretically proven that LyD2OA enables the system to realize the trade-off between energy consumption and delay. Finally, extensive simulation experiments verify that LyD2OA has good performance in minimizing energy consumption and keeping latency low.

Lyapunov-guided Deep Reinforcement Learning for service caching and task offloading in Mobile Edge Computing

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Mobile Edge Computing Networks: Online Low-Latency and Fresh Service Provisioning

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Joint optimization of service chain caching and task offloading in mobile edge computing

Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Lyapunov-guided deep reinforcement learning for delay-aware online task offloading in MEC systems

Task Graph offloading via Deep Reinforcement Learning in Mobile Edge Computing

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

Energy-latency tradeoffs for edge caching and dynamic service migration based on DQN in mobile edge computing

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Joint Optimization of Task Caching and Computation Offloading for Multiuser Multitasking in Mobile Edge Computing

Joint Optimization of Service Caching and Task Offloading for Customer Application in MEC: A Hybrid SAC Scheme