Abstract:Energy consumption and performance metrics have become critical issues for scheduling parallel task-based applications in high-performance computing systems such as cloud datacenters. The duplication and clustering strategy, as well as Dynamic Voltage Frequency Scaling (DVFS) technique, have separately been concentrated on reducing energy consumption and optimizing performance parameters such as throughput and makespan. In this paper, a dual-phase algorithm called EATSDCD which is an energy efficient time aware has been proposed. The algorithm uses the combination of duplication and clustering strategies to schedule the precedence-constrained task graph on datacenter processors through DVFS. The first phase focuses on a smart combination of duplication and clustering strategy to reduce makespan and energy consumed by processors in an effort to execute Directed Acyclic Graph (DAG) while satisfying the throughput constraint. The main idea behind EATSDCD intended to minimize energy consumption in the second phase. After determining the critical path and specifying a set of dependent tasks in non-critical paths, the slack time for each task in non-critical paths was distributed among all dependent tasks in that path. Then, the frequency of DVFS-enabled processors is scaled down to execute non-critical tasks as well as idle and communication phases, without extending the execution time of tasks. Finally, a testbed is developed and different parameters are tested on the randomly generated DAG to evaluate and illustrate the effectiveness of EATSDCD. It was also compared against duplication and clustering-based algorithms and DVFS-based algorithms. In terms of energy consumption and makespan, the results show that our proposed algorithm can save up to 8.3% and 20% energy compared against Power Aware List-based Scheduling (PALS) and Power Aware Task Clustering (PATC) algorithms, respectively. Furthermore, there is 16% improvement over Parallel Pipeline Latency Optimization (PaPilo) algorithm with Encur = 1.2Enmin(G). In comparison with Reliability Aware Scheduling with Duplication (RASD) algorithm, the execution time has been reduced in heterogeneous environments.

A YARN-based Energy-Aware Scheduling Method for Big Data Applications under Deadline Constraints

An Energy-Aware Scheduling Algorithm for Big Data Applications in Spark

Virtual Machine Scheduling Considering Both Computing and Cooling Energy

Comparative Analysis of Energy-Efficient Scheduling Algorithms for Big Data Applications.

Energy-aware intelligent scheduling for deadline-constrained workflows in sustainable cloud computing

Online Energy-Aware Scheduling for Deadline-Constrained Applications in Distributed Heterogeneous Systems

An energy-aware scheduling of dynamic workflows using big data similarity statistical analysis in cloud computing

An Energy-Efficient Dynamic Scheduling Method of Deadline-Constrained Workflows in a Cloud Environment

Improving Scheduling Efficiency of Hadoop YARN Using AFSA Algorithm.

A predictive energy-aware scheduling strategy for scientific workflows in fog computing

Energy-Efficient Task Scheduling for CPU-Intensive Streaming Jobs on Hadoop.

A dynamic VM provisioning and de-provisioning based cost-efficient deadline-aware scheduling algorithm for Big Data workflow applications in a cloud environment

New Scheduling Algorithms for Improving Performance and Resource Utilization in Hadoop YARN Clusters

A new energy-aware tasks scheduling approach in fog computing using hybrid meta-heuristic algorithm

Energy-Aware Scheduling using Dynamic Voltage-Frequency Scaling

A Task Level-Aware Scheduling Algorithm for Energy Consumption Constrained Parallel Applications on Heterogeneous Computing Systems

EATSDCD: A green energy-aware scheduling algorithm for parallel task-based application using clustering, duplication and DVFS technique in cloud datacenters

Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds.

Energy-Aware Cloud Workflow Applications Scheduling With Geo-Distributed Data

Energy-Efficient Scheduling for Tasks with Deadline in Virtualized Environments

Energy-efficient Task Scheduling on Heterogeneous Computing Systems by Linear Programming