Abstract:The Internet of Medical Things (IoMT) is regarded as a critical technology for intelligent healthcare in the foreseeable 6G era. Nevertheless, due to the limited computing power capability of edge devices and task-related coupling relationships, IoMT faces unprecedented challenges. Considering the associative connections among tasks, this paper proposes a computing offloading policy for multiple-user devices (UDs) considering device-to-device (D2D) communication and a multi-access edge computing (MEC) technique under the scenario of IoMT. Specifically, to minimize the total delay and energy consumption concerning the requirement of IoMT, we first analyze and model the detailed local execution, MEC execution, D2D execution, and associated tasks offloading exchange model. Consequently, the associated tasks' offloading scheme of multi-UDs is formulated as a mixed-integer nonconvex optimization problem. Considering the advantages of deep reinforcement learning (DRL) in processing tasks related to coupling relationships, a Double DQN based associative tasks computing offloading (DDATO) algorithm is then proposed to obtain the optimal solution, which can make the best offloading decision under the condition that tasks of UDs are associative. Furthermore, to reduce the complexity of the DDATO algorithm, the cache-aided procedure is intentionally introduced before the data training process. This avoids redundant offloading and computing procedures concerning tasks that previously have already been cached by other UDs. In addition, we use a dynamic ε — greedy strategy in the action selection section of the algorithm, thus preventing the algorithm from falling into a locally optimal solution. Simulation results demonstrate that compared with other existing methods for associative task models concerning different structures in the IoMT network, the proposed algorithm can lower the total cost more effectively and efficiently while also providing a tradeoff between delay and energy consumption tolerance.

An Advanced Deep Reinforcement Learning Algorithm for Three-layer D2D-Edge-Cloud Computing Architecture for Efficient Task Offloading in Internet of Things

DRL-Based Distributed Task Offloading Framework in Edge-Cloud Environment

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT

A Novel Offloading Mechanism Leveraging Fuzzy Logic and Deep Reinforcement Learning to Improve IoT Application Performance in a Three-Layer Architecture Within the Fog-Cloud Environment

Associative tasks computing offloading scheme in Internet of medical things with deep reinforcement learning

Task offloading and resource allocation algorithm based on deep reinforcement learning for distributed AI execution tasks in IoT edge computing environments

QoE-Based Task Offloading With Deep Reinforcement Learning in Edge-Enabled Internet of Vehicles

Deep reinforcement learning‐based multitask hybrid computing offloading for multiaccess edge computing

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Intelligent Delay-Aware Partial Computing Task Offloading for Multi-User Industrial Internet of Things through Edge Computing

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT

Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning

Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems

Edge Collaborative Online Task Offloading Method Based on Reinforcement Learning

DRL‐based computing offloading approach for large‐scale heterogeneous tasks in mobile edge computing

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Dynamic Task Offloading for Internet of Things in Mobile Edge Computing Via Deep Reinforcement Learning