Abstract:Cloud manufacturing is a manufacturing model that aims to deliver on-demand manufacturing services to consumers. Scheduling is an important problem that needs to be addressed carefully and effectively for cloud manufacturing to achieve that aim. Cloud manufacturing allows consumers to submit their requirements to the cloud platform simultaneously and therefore requires cloud manufacturing scheduling systems to be able to handle multiple tasks effectively. It is further complicated when multiple composite tasks are submitted to the system and to be addressed. A vast majority of existing studies have proposed various algorithms, including meta-heuristics, heuristics, and reinforcement learning algorithms, to address cloud manufacturing scheduling (CMfg-Sch) problems, but only a very small fraction of them deal with scheduling of multiple composition tasks with deep reinforcement learning. In this work, we leverage DRL coupled with sequence generation for addressing CMfg-Sch problems. Different from all existing works, we first propose two sequence generation algorithms for generating scheduling sequences of multiple composite tasks prior to scheduling. Coupled with this a Deep Q-Networks (DQN) and a Double DQN-based scheduling algorithms are proposed, respectively. Performance of the proposed algorithms is compared against seven baseline algorithms using makespan, cost, and reliability as evaluation metrics. Comparison indicates that sequence generation algorithm II (SGA-II) overall has a greater advantage over algorithm I (SGA-I), especially in terms of the makespan, and the Double DQN-based scheduling algorithm outperforms the DQN-based algorithm, which in turn performs better than other baseline algorithms.

A Framework For Scheduling In Cloud Manufacturing With Deep Reinforcement Learning

Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning

Logistics-involved task scheduling in cloud manufacturing with offline deep reinforcement learning

An improved deep reinforcement learning-based scheduling approach for dynamic task scheduling in cloud manufacturing

Deep Reinforcement Learning-Based Multi-Task Scheduling in Cloud Manufacturing under Different Task Arrival Modes

Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learning

Enterprise and service−level scheduling of robot production services in cloud manufacturing with deep reinforcement learning

Hybrid Task Scheduling in Cloud Manufacturing with Sparse-Reward Deep Reinforcement Learning

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

Online simulation task scheduling in cloud manufacturing with cross attention and deep reinforcement learning

Cloud–edge Collaboration Task Scheduling in Cloud Manufacturing: an Attention-Based Deep Reinforcement Learning Approach

Federated Deep Reinforcement Learning for Dynamic Job Scheduling in Cloud-Edge Collaborative Manufacturing Systems

Task scheduling based on deep reinforcement learning in a cloud manufacturing environment

Distributed Real-Time Scheduling in Cloud Manufacturing by Deep Reinforcement Learning

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

Sequence generation for multi-task scheduling in cloud manufacturing with deep reinforcement learning

Deep Reinforcement Learning-Based Dynamic Scheduling in Smart Manufacturing

Logistics-involved QoS-aware service composition in cloud manufacturing with deep reinforcement learning

Dynamic scheduling of tasks in cloud manufacturing with multi-agent reinforcement learning

Multi-agent Deep Reinforcement Learning for Dynamic Reconfigurable Shop Scheduling Considering Batch Processing and Worker Cooperation

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things