Abstract:The rapid development of cloud computing and the Internet of Things (IoT) have facilitated near real-time optimization of the group distributed manufacturing systems. Currently, the most common technique to accomplish near-real-time optimization is cloud–edge cooperation for offloading optimization tasks. The tasks are partially offloaded to the cloud to be completed, and the remaining are kept at the edge. Due to the complexity of task offloading, such as capacity restrictions of cloud and edge computing resources, or task deadlines, unbalanced or insufficient tasks are offloaded to cloud and edge, causing time delay. To address the imbalance and insufficiency in the task offloading process, a mixed-integer programming model was developed to reduce the latency of task calculation. The task offloading problem is decomposed into two sub-problems: 1) Defining priorities for the tasks in near real-time. 2) Determining if the task is offloaded to the cloud. A multi-agent deep reinforcement learning with attention mechanism (MaDRLAM) framework is proposed to solve the two-step decision problem. The MaDRLAM framework consists of two agents, and each agent corresponds to a sub-problem. Each agent comprises an encoder and a decoder, and the two agents cooperate in devising an offloading strategy for the tasks. The Encoder and Decoder built for each agent are based on the Transformer structure. Unlike the traditional Transformer, we added the Pointer networks to the Transformer to solve the proposed decision problem. Besides, an improved multi-actor and single-critic strategy based on the REINFORCE algorithm is designed to train the proposed MaDRLAM. Finally, Extensive computational experiments are conducted on instances with a varying number of tasks, different task data sizes, and different cloud computing capacities. Computational results show that the proposed framework can find a solution with a GAP value of less than 1% within 1 s for each instance. The proposed framework is competitive in both solution accuracy and solution time compared with other offloading strategies.

Dependency-Aware Task Offloading and Resource Allocation for Maritime Ultrareliable Applications

Computation Offloading for Uncertain Marine Tasks by Cooperation of UAVs and Vessels

Federated Multi-Agent Actor-Critic Learning Task Offloading in Intelligent Logistics

Joint Computation Offloading and Resource Allocation for Maritime MEC With Energy Harvesting

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Multi-agent deep reinforcement learning for task offloading in group distributed manufacturing systems

Dynamic Task Offloading in Edge Computing based on Dependency-aware Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

AI-Enabled Task Offloading for Improving Quality of Computational Experience in Ultra Dense Networks

Distance-aware Multi-Agent Reinforcement Learning for Task Offloading in MEC Network.

Dependency Tasks Offloading and Communication Resource Allocation in Collaborative UAV Networks: A Metaheuristic Approach

Dependency Tasks Offloading and Communication Resource Allocation in Collaborative UAVs Networks: A Meta-Heuristic Approach

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Com-DDPG: A Multiagent Reinforcement Learning-based Offloading Strategy for Mobile Edge Computing

Decentralized and Fault-Tolerant Task Offloading for Enabling Network Edge Intelligence

Latency Minimization Oriented Hybrid Offshore and Aerial-based Multi-access Computation Offloading for Marine Communication Networks

A Multi-Agent RL Algorithm for Dynamic Task Offloading in D2D-MEC Network with Energy Harvesting

Large-Scale Computation Offloading Using a Multi-Agent Reinforcement Learning in Heterogeneous Multi-access Edge Computing

An optimized task offloading strategy based on deep reinforcement learning combined with channel reliability prediction

Task Offloading in MEC-Aided Satellite-Terrestrial Networks: A Reinforcement Learning Approach.

Research on task offloading optimization strategies for vehicular networks based on game theory and deep reinforcement learning