Abstract:The rapid development of cloud computing and the Internet of Things (IoT) have facilitated near real-time optimization of the group distributed manufacturing systems. Currently, the most common technique to accomplish near-real-time optimization is cloud–edge cooperation for offloading optimization tasks. The tasks are partially offloaded to the cloud to be completed, and the remaining are kept at the edge. Due to the complexity of task offloading, such as capacity restrictions of cloud and edge computing resources, or task deadlines, unbalanced or insufficient tasks are offloaded to cloud and edge, causing time delay. To address the imbalance and insufficiency in the task offloading process, a mixed-integer programming model was developed to reduce the latency of task calculation. The task offloading problem is decomposed into two sub-problems: 1) Defining priorities for the tasks in near real-time. 2) Determining if the task is offloaded to the cloud. A multi-agent deep reinforcement learning with attention mechanism (MaDRLAM) framework is proposed to solve the two-step decision problem. The MaDRLAM framework consists of two agents, and each agent corresponds to a sub-problem. Each agent comprises an encoder and a decoder, and the two agents cooperate in devising an offloading strategy for the tasks. The Encoder and Decoder built for each agent are based on the Transformer structure. Unlike the traditional Transformer, we added the Pointer networks to the Transformer to solve the proposed decision problem. Besides, an improved multi-actor and single-critic strategy based on the REINFORCE algorithm is designed to train the proposed MaDRLAM. Finally, Extensive computational experiments are conducted on instances with a varying number of tasks, different task data sizes, and different cloud computing capacities. Computational results show that the proposed framework can find a solution with a GAP value of less than 1% within 1 s for each instance. The proposed framework is competitive in both solution accuracy and solution time compared with other offloading strategies.

Solving multi-task manufacturing cloud service allocation problems via bee colony optimizer with transfer learning

Improved bee colony algorithm based on opposition-based learning and Levy flight

Multi-objective artificial bee colony algorithm for multi-stage resource leveling problem in sharing logistics network

Collaborative optimization of manufacturing service allocation via multi-task transfer learning evolutionary approach

An effective collaboration evolutionary algorithm for multi-robot task allocation and scheduling in a smart farm

Heterogeneous multi-agent task allocation based on graph neural network ant colony optimization algorithms

Knowledge-aware manufacturing services collaboration: A comprehensive study of evolutionary transfer optimization approaches

Solving many-task optimization problems via online intertask learning

A Multi-Agent Reinforcement Learning Driven Artificial Bee Colony Algorithm with the Central Controller

An adaptive artificial bee colony with reinforcement learning for distributed three-stage assembly scheduling with maintenance

Optimization of Multitask in Real-Time Control Based on Artificial Bee Colony Algorithm

Solving multi-objective Flexible Job Shop Scheduling with transportation constraints using a micro artificial bee colony algorithm

Multitasking Evolutionary Algorithm Based on Adaptive Seed Transfer for Combinatorial Problem

Fog-Edge Collaborative Task Offloading Strategy Based on Chaotic Teaching and Learning Particle Swarm Optimization

An Adaptive Multi-Strategy Artificial Bee Colony Algorithm for Integrated Process Planning and Scheduling

Multi-agent deep reinforcement learning for task offloading in group distributed manufacturing systems

Grid-based artificial bee colony algorithm for multi-objective job shop scheduling with manual loading and unloading tasks

Adaptive Group Collaborative Artificial Bee Colony Algorithm

Hybrid flow-shop scheduling in collaborative manufacturing with a multi-crossover-operator genetic algorithm

Hybrid Hierarchical Particle Swarm Optimization with Evolutionary Artificial Bee Colony Algorithm for Task Scheduling in Cloud Computing

Bee optimization based random double adaptive whale optimization model for task scheduling in cloud computing environment