Abstract:Distributed heterogeneous systems have been widely adopted in industrial applications by providing high scalability and performance while keeping complexity and energy consumption under control. However, along with the increase in the number of computing nodes, the energy consumption of distributed heterogeneous systems dramatically grows and is extremely hard to predict. Energy-conscious task scheduling, which tries to assign appropriate priorities and processors to tasks such that the system energy requirement would be met, has received extensive attention in recent years. However, many approaches reduce energy consumption by extending the completion time. In this article, we focus on the scheduling problem of energy-conscious tasks in distributed heterogeneous computing systems and provide an efficient approach to mitigate energy consumption while minimizing the overall makespan of parallel applications. First, based on the heterogeneous earliest finish time, a fitness function is proposed to balance the makespan and energy consumption. Then, by improving the crossover and mutation operations of the traditional genetic algorithm, we proposed an efficient scheduling approach named energy-conscious genetic algorithm to optimize the priorities and processor allocation of tasks, with objectives of minimizing the system energy and makespan. Experiment results on real-world applications and simulations with randomly generated task graphs demonstrate that the proposed approach outperforms in energy-saving and makespan reducing.

Energy- and Locality-Efficient Multi-Job Scheduling Based on MapReduce for Heterogeneous Datacenter

Energy Utilization Task Scheduling for MapReduce in Heterogeneous Clusters

Energy Efficiency MapReduce Job Scheduling of Shuffle and Reduce Phases in Data Center.

MapReduce Task Scheduling in Heterogeneous Geo-Distributed Data Centers

An energy-aware bi-level optimization model for multi-job scheduling problems under cloud computing

An Energy and Data Locality Aware Bi-level Multiobjective Task Scheduling Model Based on MapReduce for Cloud Computing

Energy-efficient Multi-task Scheduling Based on MapReduce for Cloud Computing

A new multi-objective bi-level programming model for energy and locality aware multi-job scheduling in cloud computing.

An Efficiency-Aware Scheduling for Data-Intensive Computations on Mapreduce Clusters

An Efficient Job Scheduling for Map Reduce Clusters

An Energy-Aware Task Scheduling Algorithm for a Heterogeneous Data Center

Energy-Aware Task Scheduling of MapReduce Cluster

Task Scheduling for MapReduce in Heterogeneous Networks

Design and Implementation of Job Scheduling Algorithm for Multi-User MapReduce Clusters

Scheduling Energy-Conscious Tasks in Distributed Heterogeneous Computing Systems

A Dispatching-Rule-Based Task Scheduling Policy for MapReduce with Multi-type Jobs in Heterogeneous Environments

A Heuristic Energy-aware Scheduling Algorithm for Heterogeneous Clusters

Energy Efficiency Oriented Scheduling for Heterogeneous Cloud Systems

HMHS: Hybrid Multistage Heuristic Scheduling Algorithm for Heterogeneous MapReduce System

An energy-aware heuristic scheduling algorithm for heterogeneous clusters

Hadoop Scheduling Base On Data Locality