Abstract:Recently, cloud computing has emerged as a promising computing infrastructure for performing scientific workflows by providing on-demand resources. Meanwhile, it is convenient for scientific collaboration since different cloud environments used by the researchers are connected through Internet. However, the significant latency arising from frequent access to large datasets and the corresponding data movements across geo-distributed data centers has been an obstacle to hinder the efficient execution of data-intensive scientific workflows. In this paper, we propose a novel graph-cut based data and task co scheduling strategy for minimizing the data transfer across geo-distributed data centers. Specifically, a dependency graph is firstly constructed from workflow provenance and cut into sub graphs according to the datasets which must appear in fixed data centers by a multiway cut algorithm. Then, the sub graphs might be recursively cut into smaller ones by a minimum cut algorithm referring to data correlation rules until all of them can well fit the capacity constraints of the data centers where the fixed location datasets reside. In this way, the datasets and tasks are distributed into target data centers while the total amount of data transfer between them is minimized. Additionally, a runtime scheduling algorithm is exploited to dynamically adjust the data placement during execution to prevent the data centers from overloading. Simulation results demonstrate that the total volume of data transfer across different data centers can be significantly reduced and the cost of performing scientific workflows on the clouds will be accordingly saved.

Cost-Driven Scheduling Strategy for Scientific Workflow under Multi-cloud Environment

Cost-Driven Scheduling For Deadline-Constrained Workflow On Multi-Clouds

Cost-Driven Scheduling for Deadline-Based Workflow Across Multiple Clouds.

Minimizing Monetary Costs for Deadline Constrained Workflows in Cloud Environments

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

Cost-Efficient Scheduling of Workflow Applications with Deadline Constraint on IaaS Clouds

A Deadline-Constrained Scheduling Algorithm for Scientific Workflows in Clouds

Cost-effective Approaches for Deadline-Constrained Workflow Scheduling in Clouds

Cost Optimization for Scheduling Scientific Workflows on Clouds under Deadline Constraints.

Scheduling Strategy for Science Workflow with Deadline Constraint on Multi-Cloud

Online Optimization Scheduling for Scientific Workflows with Deadline Constraint on Hybrid Clouds

Cost and makespan-aware workflow scheduling in hybrid clouds.

Budget-deadline Constrained Approach for Scientific Workflows Scheduling in a Cloud Environment

A Dynamic Scheduling Workflow Algorithm Based On Critical Path

Graph-Cut Based Coscheduling Strategy Towards Efficient Execution of Scientific Workflows in Collaborative Cloud Environments

A Clustering Based Coscheduling Strategy for Efficient Scientific Workflow Execution in Cloud Computing.

A Pretreatment Workflow Scheduling Approach for Big Data Applications in Multicloud Environments

A Security and Cost Aware Scheduling Algorithm for Heterogeneous Tasks of Scientific Workflow in Clouds

A Fully Hybrid Algorithm for Deadline Constrained Workflow Scheduling in Clouds

Multi-objective Scheduling for Scientific Workflow in Multicloud Environment

A task backfill based scientific workflow scheduling strategy on cloud platform