Abstract:Introduction: Increased deployment of heterogeneous and complex Industrial Internet of Things (IIoT) applications such as predictive maintenance and asset tracking places a substantial strain on the limited computational and communication resources. To cater to the rigorous demands of these applications, it is imperative to devise an adaptive online resource allocation method to enhance the efficiency of the current network operations. Multiaccess edge computing (MEC) and digital twins (DTs) are promising solutions that facilitate the realization of edge intelligence and find applications in various industrial applications. Yet, little is known about the advantage the two technologies offer to IIoT networks. Objective: This study presents a joint optimization of offloading and resource allocation approach where MEC-server DT is created at the edge, and nonorthogonal multiple access (NOMA) communication is considered between IIoT devices and the industrial gateways (IGWs) for spectral efficiency. Our proposed framework is tailored to reduce mean task completion latency and enhance overall IIoT network throughput. Method: To achieve our objective, we jointly optimize the computation resource allocation (RA), subchannel assignment (SA), and offloading decisions (OD). Given the inherent complexity of the problem, we further divide it into RA and SA/OD sub-problems. Employing Deep Reinforcement Learning (DRL), we have formulated a solution delineating the most efficient RA strategy and leveraged DT for optimal SA/OD strategies. Results: Simulation results demonstrate the superior efficiency of our framework, realizing up to 92 % of the efficiency of the exhaustive search method while reducing computation and action decision time. Conclusion: In light of system dynamics considered for our work, the proposed framework perfomance showcase its robustness and potential application in real-world IIoT networks.

Self-Renewal Machine Learning Approach for Fast Wireless Network Optimization

Learning to Branch: Accelerating Resource Allocation in Wireless Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Utilizing Machine Learning as a Prediction Scheme for Network Performance Metrics of Self-Clocked Congestion Control Algorithm

Deep Reinforcement Learning for Energy Efficiency Maximization in SWIPT-Based Over-the-Air Federated Learning

Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Long-Term Throughput Maximization in Wireless Powered Communication Networks: A Multi-Task DRL Approach

Transfer Learning for Mixed-Integer Resource Allocation Problems in Wireless Networks

Reinforcement Learning for Improved Random Access in Delay-Constrained Heterogeneous Wireless Networks

Thirty Years of Machine Learning: the Road to Pareto-Optimal Wireless Networks

Maximizing throughput in NOMA-enable industrial IoT networks using digital twin and reinforcement learning

Frame Size Optimization Using a Machine Learning Approach in WLAN Downlink MU-MIMO Channel

Machine-Learning-Based Parallel Genetic Algorithms for Multi-Objective Optimization in Ultra-Reliable Low-Latency WSNs

AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?

Efficient Federated Meta-Learning Over Multi-Access Wireless Networks

Machine Learning for Large-Scale Optimization in 6G Wireless Networks

D2PG: deep deterministic policy gradient based for maximizing network throughput in clustered EH-WSN

Meta-Gating Framework for Fast and Continuous Resource Optimization in Dynamic Wireless Environments

Toward Safe and Accelerated Deep Reinforcement Learning for Next-Generation Wireless Networks

Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks.