Abstract:The rapid development of cloud computing and the Internet of Things (IoT) have facilitated near real-time optimization of the group distributed manufacturing systems. Currently, the most common technique to accomplish near-real-time optimization is cloud–edge cooperation for offloading optimization tasks. The tasks are partially offloaded to the cloud to be completed, and the remaining are kept at the edge. Due to the complexity of task offloading, such as capacity restrictions of cloud and edge computing resources, or task deadlines, unbalanced or insufficient tasks are offloaded to cloud and edge, causing time delay. To address the imbalance and insufficiency in the task offloading process, a mixed-integer programming model was developed to reduce the latency of task calculation. The task offloading problem is decomposed into two sub-problems: 1) Defining priorities for the tasks in near real-time. 2) Determining if the task is offloaded to the cloud. A multi-agent deep reinforcement learning with attention mechanism (MaDRLAM) framework is proposed to solve the two-step decision problem. The MaDRLAM framework consists of two agents, and each agent corresponds to a sub-problem. Each agent comprises an encoder and a decoder, and the two agents cooperate in devising an offloading strategy for the tasks. The Encoder and Decoder built for each agent are based on the Transformer structure. Unlike the traditional Transformer, we added the Pointer networks to the Transformer to solve the proposed decision problem. Besides, an improved multi-actor and single-critic strategy based on the REINFORCE algorithm is designed to train the proposed MaDRLAM. Finally, Extensive computational experiments are conducted on instances with a varying number of tasks, different task data sizes, and different cloud computing capacities. Computational results show that the proposed framework can find a solution with a GAP value of less than 1% within 1 s for each instance. The proposed framework is competitive in both solution accuracy and solution time compared with other offloading strategies.

A Multi-Agent DRL-Based Computation Offloading and Resource Allocation Method with Attention Mechanism in MEC-Enabled IIoT

Deep Reinforcement Learning Aided Computation Offloading and Resource Allocation for IoT

Multi-agent DRL for joint completion delay and energy consumption with queuing theory in MEC-based IIoT

Deep Reinforcement Learning-Based Computation Offloading and Optimal Resource Allocation in Industrial Internet of Things with NOMA

Deep Reinforcement Learning Based Cooperative Partial Task Offloading and Resource Allocation for IIoT Applications

Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Industrial IoT in MEC Federation System

Cooperative Partial Task Offloading and Resource Allocation for IIoT Based on Decentralized Multi-Agent Deep Reinforcement Learning

Cooperative Multiagent Deep Reinforcement Learning for Computation Offloading: A Mobile Network Operator Perspective

Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things

Computation Offloading in Resource-Constrained Multi-Access Edge Computing

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Intelligent Delay-Aware Partial Computing Task Offloading for Multiuser Industrial Internet of Things Through Edge Computing

Multi-agent Reinforcement Learning for Task Offloading with Hybrid Decision Space in Multi-Access Edge Computing

Multiagent Deep Reinforcement Learning for Vehicular Computation Offloading in IoT

Multi-Agent Deep Reinforcement Learning for Computation Offloading in Multi-IRS Assisted Mobile Edge Computing Networks

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

Multi-agent deep reinforcement learning for task offloading in group distributed manufacturing systems

Dual-attention Assisted Deep Reinforcement Learning Algorithm for Energy-Efficient Resource Allocation in Industrial Internet of Things

Deep Reinforcement Learning for Time-Energy Tradeoff Online Offloading in MEC-Enabled Industrial Internet of Things

DMRO: A Deep Meta Reinforcement Learning-Based Task Offloading Framework for Edge-Cloud Computing

Intelligent Delay-Aware Partial Computing Task Offloading for Multi-User Industrial Internet of Things through Edge Computing