Abstract:Introduction: Increased deployment of heterogeneous and complex Industrial Internet of Things (IIoT) applications such as predictive maintenance and asset tracking places a substantial strain on the limited computational and communication resources. To cater to the rigorous demands of these applications, it is imperative to devise an adaptive online resource allocation method to enhance the efficiency of the current network operations. Multiaccess edge computing (MEC) and digital twins (DTs) are promising solutions that facilitate the realization of edge intelligence and find applications in various industrial applications. Yet, little is known about the advantage the two technologies offer to IIoT networks. Objective: This study presents a joint optimization of offloading and resource allocation approach where MEC-server DT is created at the edge, and nonorthogonal multiple access (NOMA) communication is considered between IIoT devices and the industrial gateways (IGWs) for spectral efficiency. Our proposed framework is tailored to reduce mean task completion latency and enhance overall IIoT network throughput. Method: To achieve our objective, we jointly optimize the computation resource allocation (RA), subchannel assignment (SA), and offloading decisions (OD). Given the inherent complexity of the problem, we further divide it into RA and SA/OD sub-problems. Employing Deep Reinforcement Learning (DRL), we have formulated a solution delineating the most efficient RA strategy and leveraged DT for optimal SA/OD strategies. Results: Simulation results demonstrate the superior efficiency of our framework, realizing up to 92 % of the efficiency of the exhaustive search method while reducing computation and action decision time. Conclusion: In light of system dynamics considered for our work, the proposed framework perfomance showcase its robustness and potential application in real-world IIoT networks.

Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks

Digital Twin Enabled Task Offloading for IoVs: A Learning-Based Approach

Learning Based Task Offloading in Digital Twin Empowered Internet of Vehicles

Energy-Delay Joint Optimization for Task Offloading in Digital Twin-Assisted Internet of Vehicles

ODTRA-Based Task Offload Optimization for Industrial Internet of Things: Improving Efficiency and Performance With Digital Twins and Metaheuristic Optimization

Twin delayed deep deterministic policy gradient-based intelligent computation offloading for IoT

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network

Distributed Deep Reinforcement Learning for Resource Allocation in Digital Twin Networks

Edge Computing Empowered Digital Twin: an End-to-End Computing Task Scheduling Approach

Optimizing Synchronization Delay for Digital Twin over Wireless Networks

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning

Deep Reinforcement Learning for Resource Demand Prediction and Virtual Function Network Migration in Digital Twin Network

Digital Twin and Meta RL Empowered Fast-Adaptation of Joint User Scheduling and Task Offloading for Mobile Industrial IoT

Maximizing throughput in NOMA-enable industrial IoT networks using digital twin and reinforcement learning

Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

Service Offloading With Deep Q-Network for Digital Twinning-Empowered Internet of Vehicles in Edge Computing

Towards a Partial Computation offloading in In-networking Computing-Assisted MEC: A Digital Twin Approach

Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning

OSTTD: Offloading of Splittable Tasks With Topological Dependence in Multi-Tier Computing Networks