Abstract:Nowadays, more and more workflows with different computing requirements are migrated to clouds and executed with cloud resources. In this work, we study the problem of stochastic multi-workflows scheduling in clouds and formalize this problem as an optimization problem that is NP-hard. To solve this problem, an efficient stochastic multi-workflows dynamic scheduling algorithm called SMWDSA is designed to schedule multi-workflows with deadline constraints for optimizing multi-workflows scheduling cost. The proposed SMWDSA consists of three stages including multi-workflows preprocessing, multi-workflow scheduling and scheduling feedback. In SMWDSA, a novel task sub-deadlines assignment stretagy is design to assign the task sub-deadlines to each task of multi-workflows for meeting workflow deadline constraints. Then, we propose a task scheduling method based on the minimal time slot availability to execution task for minimizing workflow scheduling cost while meetingt workflow deadlines. Finally, a scheduling feedback strategy is adopted to update the priorities and sub-deadlines of unscheduled tasks, for further minimizing workflow scheduling cost. We conduct the experiments using both synthetic data and real-world data to evaluate SMWDSA. The results demonstrate the superiority of SMWDSA as compared with the state-of-the-art algorithms. Note to Practitioners-Workflow scheduling in clouds is significantly challenging due to not only the large scale of workflows but also the elasticity and heterogeneity of cloud resources. Moreover, minimizing workflow scheduling cost and satisfying workflow deadlines are two critical issues in scheduling with cloud resources, especially the uncertainty of workflow arrive time and task execution time are considered. To meet workflow deadlines, it is an effective strategy to decompose workflow deadline constraints into task sub-deadline constraints. To minimize the workflow scheduling cost, each task in a workflow needs to be assigned to their most suitable VMs for execution. This article presents a novel workflow scheduling algorithm to schedule stochastic multi-workflows in clouds for optimizing multi-workflows scheduling cost and meeting workflows deadlines. This algorithm obtains the task sub-deadline constraints based on the characteristics of workflows for meeting the worklfow deadline constraint. Under the premise of meeting task deadlines, it schedules tasks to a VM with minimum the slot time, for minimizing the cost. Case studies based on well-known real-world workflows data sets suggest that it outperforms traditional ones in terms of success and cost of multi-workflows scheduling. It can thus aid the design and optimization of multi-workflows scheduling in a cloud environment. It can help practitioners better manage the scheduling cost and performance of real-world applications built upon cloud services.

A Novel Reinforcement-Learning-Based Approach to Workflow Scheduling Upon Infrastructure-as-a-Service Clouds

A Reinforcement Learning Based Workflow Application Scheduling Approach in Dynamic Cloud Environment.

Cost-Efficient Scheduling of Workflow Applications with Deadline Constraint on IaaS Clouds

Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning.

A Multi-stage Dynamic Game-Theoretic Approach for Multi-Workflow Scheduling on Heterogeneous Virtual Machines from Multiple Infrastructure-as-a-Service Clouds.

A Hybrid Algorithm for Multi-Objective Scientific Workflow Scheduling in IaaS Cloud.

Weighted Double Deep Q-network Based Reinforcement Learning for Bi-Objective Multi-Workflow Scheduling in the Cloud

A Fault-tolerant and Cost-efficient Workflow Scheduling Approach Based on Deep Reinforcement Learning for IT Operation and Maintenance.

Evolutionary Multi-Objective Workflow Scheduling in Cloud

A Cost-Aware Scheduling Algorithm for Reliable Workflow in IaaS Clouds

Knowledge Transfer Enabled Diverse Task Scheduling for Individualized Requirements in Industrial Cloud Platform

A novel deep reinforcement learning scheme for task scheduling in cloud computing

Workflow Scheduling Based on Deep Reinforcement Learning in the Cloud Environment

A Novel Cloud Workflow Scheduling Algorithm Based on Stable Matching Game Theory

A Novel Approach to Scheduling Workflows Upon Cloud Resources with Fluctuating Performance

An Intelligent Cloud Workflow Scheduling System with Time Estimation and Adaptive Ant Colony Optimization

A Reinforcement Learning-Based Mixed Job Scheduler Scheme for Grid or IaaS Cloud

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

Fluctuation-Aware And Predictive Workflow Scheduling In Cost-Effective Infrastructure-As-A-Service Clouds

A Deep Reinforcement Learning Approach for Cost Optimized Workflow Scheduling in Cloud Computing Environments

Dynamic Scheduling Stochastic Multiworkflows With Deadline Constraints in Clouds