Abstract:Edge computing has become increasingly important to fulfill the diversified quality of service (QoS) or quality of experience (QoE) demands for industrial internet of things (IIoT) applications, such as machine condition monitoring, fault diagnosis, intelligent production scheduling, and production quality control. Due to the heterogeneity of IIoT systems, it is of urgent necessity to concentrate on the cloud-edge-end cooperative partial task offloading and resource allocation (CPTORA) problem for realizing workload balancing, efficient resource utilization, and better QoS/QoE of IIoT applications. However, the challenge lies in how to make real-time, accurate, decentralized task offloading and resource allocation decisions for dynamic and device-intensive IIoT. Therefore, this work examines the CPTORA problem for IIoT, aiming at minimizing its long-run overall delay and energy costs. To lower the problem complexity, this problem is decomposed into the task offloading subproblem and the resource allocation subproblem. Then, an improved soft actor-critic-based decentralized multi-agent deep reinforcement learning (MADRL) algorithm is proposed to address the task offloading subproblem, where each IIoT device can learn its globally optimal policy and make its decisions independently. This algorithm innovatively combines the divergence regularization, the distributional reinforcement learning, and the value function decomposition methods to improve convergence speed and accuracy of the existing MADRL methods. After receiving the task offloading decisions of every IIoT device, every edge server employs the Lagrange multiplier method and Karush-Kuhn-Tucker condition to solve its resource allocation subproblem. The experimental results show that the proposed algorithm decreases the overall delay and energy costs more effectively, compared to the other state-of-the-art MADRL approaches.

Multiagent RL Aided Task Offloading and Resource Management in Wi-Fi 6 and 5G Coexisting Industrial Wireless Environment

Joint Computation Offloading and Resource Allocation for MEC-Enabled IoT Systems with Imperfect CSI

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Edge Intelligence-driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Energy-Efficient Task Transfer in Wireless Computing Power Networks

Multi-agent DRL for joint completion delay and energy consumption with queuing theory in MEC-based IIoT

Cooperative Partial Task Offloading and Resource Allocation for IIoT Based on Decentralized Multi-Agent Deep Reinforcement Learning

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Research on task offloading optimization strategies for vehicular networks based on game theory and deep reinforcement learning

A Multi-Agent RL Algorithm for Dynamic Task Offloading in D2D-MEC Network with Energy Harvesting

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning

Multi-Agent Reinforcement Learning Based Cooperative Multitype Task Offloading Strategy for Internet of Vehicles in B5G/6G Network

Intelligent Delay-Aware Partial Computing Task Offloading for Multi-User Industrial Internet of Things through Edge Computing

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Towards Decentralized Task Offloading and Resource Allocation in User-Centric Mobile Edge Computing

Deep Reinforcement Learning-Based Energy Minimization Task Offloading and Resource Allocation for Air Ground Integrated Heterogeneous Networks

NOMA Assisted Multi-Task Multi-Access Mobile Edge Computing via Deep Reinforcement Learning for Industrial Internet of Things

Mobility-Aware Computation Offloading with Adaptive Load Balancing in Small-Cell MEC

Resource Optimization for Semantic-Aware Networks with Task Offloading