Abstract:Cloud computing is undeniably becoming the main computing and storage platform for today's major workloads. From Internet of things and Industry 4.0 workloads to big data analytics and decision‐making jobs, cloud systems daily receive a massive number of tasks that need to be simultaneously and efficiently mapped onto the cloud resources. Therefore, deriving an appropriate task scheduling mechanism that can both minimize tasks' execution delay and cloud resources utilization is of prime importance. Recently, the concept of cloud automation has emerged to reduce the manual intervention and improve the resource management in large‐scale cloud computing workloads. In this article, we capitalize on this concept and propose four deep and reinforcement learning‐based scheduling approaches to automate the process of scheduling large‐scale workloads onto cloud computing resources, while reducing both the resource consumption and task waiting time. These approaches are: reinforcement learning (RL), deep Q networks, recurrent neural network long short‐term memory (RNN‐LSTM), and deep reinforcement learning combined with LSTM (DRL‐LSTM). Experiments conducted using real‐world datasets from Google Cloud Platform revealed that DRL‐LSTM outperforms the other three approaches. The experiments also showed that DRL‐LSTM minimizes the CPU usage cost up to 67% compared with the shortest job first (SJF), and up to 35% compared with both the round robin (RR) and improved particle swarm optimization (PSO) approaches. Moreover, our DRL‐LSTM solution decreases the RAM memory usage cost up to 72% compared with the SJF, up to 65% compared with the RR, and up to 31.25% compared with the improved PSO.

Enterprise and service−level scheduling of robot production services in cloud manufacturing with deep reinforcement learning

Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning

Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learning

A Framework For Scheduling In Cloud Manufacturing With Deep Reinforcement Learning

Deep Reinforcement Learning-Based Multi-Task Scheduling in Cloud Manufacturing under Different Task Arrival Modes

Logistics-involved task scheduling in cloud manufacturing with offline deep reinforcement learning

An improved deep reinforcement learning-based scheduling approach for dynamic task scheduling in cloud manufacturing

Distributed Real-Time Scheduling in Cloud Manufacturing by Deep Reinforcement Learning

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

Logistics-involved QoS-aware service composition in cloud manufacturing with deep reinforcement learning

Task scheduling based on deep reinforcement learning in a cloud manufacturing environment

Sequence generation for multi-task scheduling in cloud manufacturing with deep reinforcement learning

Cloud–edge Collaboration Task Scheduling in Cloud Manufacturing: an Attention-Based Deep Reinforcement Learning Approach

Hybrid Task Scheduling in Cloud Manufacturing with Sparse-Reward Deep Reinforcement Learning

Online simulation task scheduling in cloud manufacturing with cross attention and deep reinforcement learning

Dynamic scheduling of tasks in cloud manufacturing with multi-agent reinforcement learning

Federated Deep Reinforcement Learning for Dynamic Job Scheduling in Cloud-Edge Collaborative Manufacturing Systems

Resource Management in Cloud Based on Deep Reinforcement Learning

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

Deep and reinforcement learning for automated task scheduling in large‐scale cloud computing systems

Multi-D3QN: A Multi-strategy Deep Reinforcement Learning for Service Composition in Cloud Manufacturing.