Abstract:In recent years, more and more large-scale data processing and computing workflow applications run on heterogeneous clouds. Such cloud applications with precedence-constrained tasks are usually deadline-constrained and their scheduling is an essential problem faced by cloud providers. Moreover, minimizing the workflow execution cost based on cloud billing periods is also a complex and challenging problem for clouds. In realizing this, we first model the workflow applications as I/O Data-aware Directed Acyclic Graph (DDAG), according to clouds with global storage systems. Then, we mathematically state this deadline-constrained workflow scheduling problem with the goal of minimum execution financial cost. We also prove that the time complexity of this problem is NP-hard by deducing from a multidimensional multiple-choice knapsack problem. Third, we propose a heuristic cost-efficient task scheduling strategy called CETSS, which includes workflow DDAG model building, task subdeadline initialization, greedy workflow scheduling algorithm, and task adjusting method. The greedy workflow scheduling algorithm mainly consists of dynamical task renting billing period sharing method and unscheduled task subdeadline relax technique. We perform rigorous simulations on some synthetic randomly generated applications and real-world applications, such as Epigenomics, CyberShake, and LIGO. The experimental results clearly demonstrate that our proposed heuristic CETSS outperforms the existing algorithms and can effective save the total workflow execution cost. In particular, CETSS is very suitable for large workflow applications.

Energy-Aware Cloud Workflow Applications Scheduling With Geo-Distributed Data

Energy-aware intelligent scheduling for deadline-constrained workflows in sustainable cloud computing

An energy-aware scheduling of dynamic workflows using big data similarity statistical analysis in cloud computing

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

Battery-Assisted Online Operation of Distributed Data Centers With Uncertain Workload and Electricity Prices

Energy-efficient workflow scheduling based on workflow structures under deadline and budget constraints in the cloud

Workload-Aware Scheduling of Real-Time Jobs in Cloud Computing to Minimize Energy Consumption

Scheduling Real-Time Parallel Applications in Cloud to Minimize Energy Consumption

Energy-aware application scheduling based on genetic algorithm.

Multi-objective approach for energy-aware workflow scheduling in cloud computing environments

Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds.

Geographical Job Scheduling in Data Centers with Heterogeneous Demands and Servers

Energy and Network Aware Workload Management for Geographically Distributed Data Centers

Fault-tolerant scheduling and data placement for scientific workflow processing in geo-distributed clouds

Energy-Minimized Scheduling of Real-Time Parallel Workflows on Heterogeneous Distributed Computing Systems

Energy Efficient Geographical Load Balancing via Dynamic Deferral of Workload

Cost-Efficient Task Scheduling for Geo-distributed Data Analytics.

Workload-Aware Scheduling Across Geo-Distributed Data Centers

Big Data Processing Workflows Oriented Real-Time Scheduling Algorithm using Task-Duplication in Geo-Distributed Clouds

Energy and cost aware workflow scheduling in clouds with deadline constraint

Energy and Cost-Aware Workflow Scheduling in Cloud Computing Data Centers Using a Multi-objective Optimization Algorithm