Abstract:With the arrival of 5G technology and the popularization of the Internet of Things (IoT), mobile edge computing (MEC) has great potential in handling delay-sensitive and compute-intensive (DSCI) applications. Meanwhile, the need for reduced latency and improved energy efficiency in terminal devices is becoming urgent increasingly. However, the users are affected by channel conditions and bursty computational demands in dynamic MEC environments, which can lead to longer task correspondence times. Therefore, finding an efficient task offloading method in stochastic systems is crucial for optimizing system energy consumption. Additionally, the delay due to frequent user-MEC interactions cannot be overlooked. In this article, we initially frame the task offloading issue as a dynamic optimization issue. The goal is to minimize the system's long-term energy consumption while ensuring the task queue's stability over the long term. Using the Lyapunov optimization technique, the task processing deadline problem is converted into a stability control problem for the virtual queue. Then, a novel Lyapunov-guided deep reinforcement learning (DRL) for delay-aware offloading algorithm (LyD2OA) is designed. LyD2OA can figure out the task offloading scheme online, and adaptively offload the task with better network quality. Meanwhile, it ensures that deadlines are not violated when offloading tasks in poor communication environments. In addition, we perform a rigorous mathematical analysis of the performance of Ly2DOA and prove the existence of upper bounds on the virtual queue. It is theoretically proven that LyD2OA enables the system to realize the trade-off between energy consumption and delay. Finally, extensive simulation experiments verify that LyD2OA has good performance in minimizing energy consumption and keeping latency low.

Intelligent and Stable Resource Allocation for Delay-Sensitive MEC in 6G Networks.

Resource allocation algorithm for MEC based on Deep Reinforcement Learning

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

Joint Optimization Of Computation Offloading And Ul/Dl Resource Allocation In Mec Systems

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Stochastic Resource Allocation and Delay Analysis for Mobile Edge Computing Systems

Lyapunov-guided deep reinforcement learning for delay-aware online task offloading in MEC systems

Deep Reinforcement Learning Based Task Offloading and Resource Allocation in Small Cell MEC

Edge Intelligence-driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things

A Hybrid DQN and Optimization Approach for Strategy and Resource Allocation in MEC Networks

Intelligent Hybrid Resource Allocation in MEC-assisted RAN Slicing Network

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

Priority-Aware Resource Allocation for RIS-assisted Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach

Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach

IRS-Based MEC for Delay-Constrained QoS Over RF-Powered 6G Mobile Wireless Networks

Towards Decentralized Task Offloading and Resource Allocation in User-Centric Mobile Edge Computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Dynamic Offloading for Multiuser Muti-CAP MEC Networks: A Deep Reinforcement Learning Approach

Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach

DRL-Assisted Resource Allocation for NOMA-MEC Offloading with Hybrid SIC