Abstract:Scheduling of processes onto processors of a parallel machine has always been an important and challenging area of research. The issue becomes even more crucial and difficult as we gradually progress to the use of off-the-shelf workstations, operating systems, and high bandwidth networks to build cost-effective clusters for demanding applications. Clusters are gaining acceptance not just in scientific applications that need supercomputing power, but also in domains such as databases, web service, and multimedia which place diverse Quality-of-Service (QoS) demands on the underlying system. Further, these applications have diverse characteristics in terms of their computation, communication, and I/O requirements, making conventional parallel scheduling solutions, such as space sharing or gang scheduling, unattractive. At the same time, leaving it to the native operating system of each node to make decisions independently can lead to ineffective use of system resources whenever there is communication. Instead, an emerging class of dynamic coscheduling mechanisms that attempt to take remedial actions to guide the system toward coscheduled execution without requiring explicit synchronization offers a lot of promise for cluster scheduling. Using a detailed simulator, this paper evaluates the pros and cons of different dynamic coscheduling alternatives while comparing their advantages over traditional gang scheduling (and not performing any coordinated scheduling at all). The impact of dynamic job arrivals, job characteristics, and different system parameters on these alternatives is evaluated in terms of several performance criteria. In addition, heuristics to enhance one of the alternatives even further are identified, classified, and evaluated. It is shown that these heuristics can significantly outperform the other alternatives over a spectrum of workload and system parameters and is thus a much better option for clusters than conventional gang scheduling.

Gang Scheduling Extensions for I/O Intensive Workloads

A Deadline And Budget Constrained Cost-Time Optimization Algorithm For Scheduling Dependent Tasks In Grid Computing

A DAG-Based XCIGS Algorithm for Dependent Tasks in Grid Environments.

Impact of Workload and System Parameters on Next Generation Cluster Scheduling Mechanisms

Job Scheduling in High Performance Computing

Energy-aware application scheduling based on genetic algorithm.

Node-Based Job Scheduling for Large Scale Simulations of Short Running Jobs

Scheduling Energy-Conscious Tasks in Distributed Heterogeneous Computing Systems

Scheduling Best-Effort and Real-Time Pipelined Applications on Time-Shared Clusters.

Computing Field Scheduling: A Fully Decentralized Scheduling Approach for Grid Computing.

ESG: Pipeline-Conscious Efficient Scheduling of DNN Workflows on Serverless Platforms with Shareable GPUs

Scalable System Scheduling for HPC and Big Data

Load-Aware Hybrid Scheduling in Large Compute Clusters

A Dynamic Job Scheduling Algorithm for Computational Grid

An Application-Oriented On-Demand Scheduling Approach in the Computational Grid Environment

Efficient Data and Task Co-Scheduling for Scientific Workflow in Geo-Distributed Datacenters

Ordinal Optimized Scheduling of Scientific Workflows in Elastic Compute Clouds

A Runtime Scheduling Approach With Respect To Job Parallelism For Computational Grid

An Algorithm for Jobs Scheduling in Computational Grid Based on Time-Balancing Strategy

nOS-V: Co-Executing HPC Applications Using System-Wide Task Scheduling

A Gang Scheduling Computational Paradigm for Container Terminal Logistics with Processor Affinity.