Abstract:In recent years, more and more large-scale data processing and computing workflow applications run on heterogeneous clouds. Such cloud applications with precedence-constrained tasks are usually deadline-constrained and their scheduling is an essential problem faced by cloud providers. Moreover, minimizing the workflow execution cost based on cloud billing periods is also a complex and challenging problem for clouds. In realizing this, we first model the workflow applications as I/O Data-aware Directed Acyclic Graph (DDAG), according to clouds with global storage systems. Then, we mathematically state this deadline-constrained workflow scheduling problem with the goal of minimum execution financial cost. We also prove that the time complexity of this problem is NP-hard by deducing from a multidimensional multiple-choice knapsack problem. Third, we propose a heuristic cost-efficient task scheduling strategy called CETSS, which includes workflow DDAG model building, task subdeadline initialization, greedy workflow scheduling algorithm, and task adjusting method. The greedy workflow scheduling algorithm mainly consists of dynamical task renting billing period sharing method and unscheduled task subdeadline relax technique. We perform rigorous simulations on some synthetic randomly generated applications and real-world applications, such as Epigenomics, CyberShake, and LIGO. The experimental results clearly demonstrate that our proposed heuristic CETSS outperforms the existing algorithms and can effective save the total workflow execution cost. In particular, CETSS is very suitable for large workflow applications.

Scheduling and Fair Cost-Optimizing Methods for Concurrent Multiple DAGs with Deadline Sharing Resources

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Optimizing Schedule Length for DAG Type Applications with Energy Consumption Constraint in Heterogeneous Computing Systems

Evaluating DAG Scheduling Algorithms for Maximum Parallelism.

Throughput Maximization Scheduling Method for Multiple Workflows With Deadlines Sharing Finite Resources

Deadline Division-Based Heuristic for Cost Optimization in Workflow Scheduling

Directed Acyclic Task Graph Scheduling for Heterogeneous Computing Systems by Dynamic Critical Path Duplication Algorithm

Dag-Based Parallel Real Time Task Scheduling Algorithm On A Cluster

DAG Scheduling and Analysis on Multiprocessor Systems: Exploitation of Parallelism and Dependency.

Decomposition-based scheduling for parallel real-time tasks on multiprocessors

A New Federated Scheduling Algorithm for Arbitrary-Deadline DAG Tasks

A Fluid Scheduling Algorithm for DAG Tasks with Constrained or Arbitrary Deadlines

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

Multiple DAGs Scheduling Based on Lowest Transportation and Completion Time Algorithm on the Cloud

Hybrid Scheduling Deadline-Constrained Multi-DAGs Based on Reverse HEFT

An Enhanced Priority-Based Scheduling Heuristic for DAG Applications with Temporal Unpredictability in Task Execution and Data Transmission.

Directed acyclic graph application scheduling strategy based on critical path cut on cloud platform

Multiple Objective Fairness Scheduling Optimization Algorithms Based on Multiple DAGs in Heterogeneous Edge Computing.

Evolutionary algorithm towards resource allocation of concurrent scheduling multiple DAGs in clouds

Real-Time Scheduling of DAG Tasks with Arbitrary Deadlines.

Parallel Path Progression DAG Scheduling