Abstract:Scheduling of processes onto processors of a parallel machine has always been an important and challenging area of research. The issue becomes even more crucial and difficult as we gradually progress to the use of off-the-shelf workstations, operating systems, and high bandwidth networks to build cost-effective clusters for demanding applications. Clusters are gaining acceptance not just in scientific applications that need supercomputing power, but also in domains such as databases, web service, and multimedia which place diverse Quality-of-Service (QoS) demands on the underlying system. Further, these applications have diverse characteristics in terms of their computation, communication, and I/O requirements, making conventional parallel scheduling solutions, such as space sharing or gang scheduling, unattractive. At the same time, leaving it to the native operating system of each node to make decisions independently can lead to ineffective use of system resources whenever there is communication. Instead, an emerging class of dynamic coscheduling mechanisms that attempt to take remedial actions to guide the system toward coscheduled execution without requiring explicit synchronization offers a lot of promise for cluster scheduling. Using a detailed simulator, this paper evaluates the pros and cons of different dynamic coscheduling alternatives while comparing their advantages over traditional gang scheduling (and not performing any coordinated scheduling at all). The impact of dynamic job arrivals, job characteristics, and different system parameters on these alternatives is evaluated in terms of several performance criteria. In addition, heuristics to enhance one of the alternatives even further are identified, classified, and evaluated. It is shown that these heuristics can significantly outperform the other alternatives over a spectrum of workload and system parameters and is thus a much better option for clusters than conventional gang scheduling.

A Dynamic Task Scheduling Method in Cluster of Workstations

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

A Policy of Task Allocation Base on Distributed Cluster Computing Towards Cloud

Communication-Efficient Task Scheduling for Real-Time Distributed Computing.

A DAG-based Partitioning-Reconfiguring Scheduling Algorithm in Network of Workstations

A Self-Adaptive Workload Balancing Algorithm on Gpu Clusters

Impact of Workload and System Parameters on Next Generation Cluster Scheduling Mechanisms

A Dynamic Scheduling Workflow Algorithm Based On Critical Path

A Simulation-Based Study of Scheduling Mechanisms for a Dynamic Cluster Environment.

Energy-Efficient Real-Time Task Allocation in a Data Center.

A heuristic method for data allocation and task scheduling on heterogeneous multiprocessor systems under memory constraints

Hypergraph-partitioning-based online joint scheduling of tasks and data

Energy-Minimized Scheduling of Real-Time Parallel Workflows on Heterogeneous Distributed Computing Systems

An Adaptive Immune-Based Algorithm for Independent Task Scheduling Problem on Heterogeneous Workstation Clusters

A Task Level-Aware Scheduling Algorithm for Energy Consumption Constrained Parallel Applications on Heterogeneous Computing Systems

Distributed dynamic load balancing for task parallel programming

Dynamic Load-Balancing and High Performance Communication in Jcluster

A Novel Heterogeneous Scheduling Algorithm with Improved Task Priority

Task Scheduling of Parallel Programs to Optimize Communications for Cluster of SMPs