Abstract:Edge computing has become increasingly important to fulfill the diversified quality of service (QoS) or quality of experience (QoE) demands for industrial internet of things (IIoT) applications, such as machine condition monitoring, fault diagnosis, intelligent production scheduling, and production quality control. Due to the heterogeneity of IIoT systems, it is of urgent necessity to concentrate on the cloud-edge-end cooperative partial task offloading and resource allocation (CPTORA) problem for realizing workload balancing, efficient resource utilization, and better QoS/QoE of IIoT applications. However, the challenge lies in how to make real-time, accurate, decentralized task offloading and resource allocation decisions for dynamic and device-intensive IIoT. Therefore, this work examines the CPTORA problem for IIoT, aiming at minimizing its long-run overall delay and energy costs. To lower the problem complexity, this problem is decomposed into the task offloading subproblem and the resource allocation subproblem. Then, an improved soft actor-critic-based decentralized multi-agent deep reinforcement learning (MADRL) algorithm is proposed to address the task offloading subproblem, where each IIoT device can learn its globally optimal policy and make its decisions independently. This algorithm innovatively combines the divergence regularization, the distributional reinforcement learning, and the value function decomposition methods to improve convergence speed and accuracy of the existing MADRL methods. After receiving the task offloading decisions of every IIoT device, every edge server employs the Lagrange multiplier method and Karush-Kuhn-Tucker condition to solve its resource allocation subproblem. The experimental results show that the proposed algorithm decreases the overall delay and energy costs more effectively, compared to the other state-of-the-art MADRL approaches.

Hierarchical Collaboration Dynamic Resource Scheduling for Edge-Enabled Industrial IoT

Two-stage Scheduling of Stream Computing for Industrial Cloud-edge Collaboration

A Decomposition-Based Approach for Multitask Scheduling with Execution Uncertainty in Industrial Internet of Things

An effective resource scheduling model for edge cloud oriented AIoT

Resource Allocation and Load Balancing Based on Edge Computing in Industrial Networks.

Cloud-Edge Collaboration in Industrial Internet of Things: A Joint Offloading Scheme based on Resource Prediction

Pioneering Deterministic Scheduling and Network Structure Optimization for Time-Critical Computing Tasks in Industrial IoT

Software-Defined Collaborative Scheduling of Computing and Network Resources

Hierarchical Collaborative Resource Scheduling in Industrial Internet of Things Based on Graph Neural Networks and Deep Reinforcement Learning

Cloud-Edge Collaboration with Green Scheduling and Deep Learning for Industrial Internet of Things

Deep Reinforcement Learning Based Cooperative Partial Task Offloading and Resource Allocation for IIoT Applications

Parallel Scheduling of Large-Scale Tasks for Industrial Cloud-Edge Collaboration

QoS-Driven Distributed Cooperative Data Offloading and Heterogeneous Resource Scheduling for IIoT

Hierarchical Computing Network Collaboration Architecture for Industrial Internet of Things.

Cross-domain Task Offloading and Computing Resource Allocation for Edge Computation in Industrial Internet of Things

Incentive-Driven Task Allocation for Collaborative Edge Computing in Industrial Internet of Things

Multi-objective Cross-layer Resource Scheduling for Internet of Things in Edge-Cloud Computing

Task-Offloading and Resource Allocation Strategy in Multidomain Cooperation for IIoT

Cooperative Partial Task Offloading and Resource Allocation for IIoT Based on Decentralized Multi-Agent Deep Reinforcement Learning

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things

Study on Edge-Cloud Collaborative Production Scheduling Based on Enterprises with Multi-Factory