Abstract:The trend of massive connectivity pushes forward the explosive growth of end devices. The emergence of various applications has prompted a demand for pervasive connectivity and more efficient computing paradigms. On the other hand, the lack of computational capacity of the end devices restricts the implementation of the intelligent applications, and becomes a bottleneck of the multiple access for supporting massive connectivity. Mobile cloud computing (MCC) and mobile edge computing (MEC) techniques enable end devices to offload local computation-intensive tasks to servers by networks. In this paper, we consider the cloud-edge-end collaborative networks to utilize distributed computing resources. Furthermore, we apply task-oriented semantic communications to tackle the fast-varying channel between the end devices and MEC servers and reduce the communication cost. To minimize long-term energy consumption on constraints queue stability and computational delay, a Lyapunov-guided deep reinforcement learning hybrid (DRLH) framework is proposed to solve the mixed integer non-linear programming (MINLP) problem. The long-term energy consumption minimization problem is transformed into the deterministic problem in each time frame. The DRLH framework integrates a model-free deep reinforcement learning algorithm with a model-based mathematical optimization algorithm to mitigate computational complexity and leverage the scenario information, so that improving the convergence performance. Numerical results demonstrate that the proposed DRLH framework achieves near-optimal performance on energy consumption while stabilizing all queues.

Computation Cost-Driven Offloading Strategy Based On Reinforcement Learning for Consumer Devices

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Deep reinforcement learning-based online task offloading in mobile edge computing networks

Cooperative Computation Offloading and Dynamic Task Scheduling in Edge Computing

Dynamic Task Offloading in Edge Computing based on Dependency-aware Reinforcement Learning

A computational offloading optimization scheme based on deep reinforcement learning in perceptual network

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks

Online Computation Offloading and Resource Scheduling in Mobile-Edge Computing

Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

Intelligent Delay-Aware Partial Computing Task Offloading for Multi-User Industrial Internet of Things through Edge Computing

Computation Offloading In Energy Harvesting Systems Via Continuous Deep Reinforcement Learning

Task-Offloading Strategy of Mobile Edge Computing for WBANs