Abstract:Existing work indicates that the commonly used “single queue of runnable tasks” approach to scheduling shared memory multiprocessors can perform very poorly in a multiprogrammed parallel processing environment. A more promising approach is the class of “two-level schedulers” in which the operating system deals solely with allocating processors to jobs while the individual jobs themselves perform task dispatching on those processors. In this paper we compare two basic varieties of two-level schedulers. Those of the first type, static, make a single decision per job regarding the number of processors to allocate to it. Once the job has received its allocation, it is guaranteed to have exactly that number of processors available to it whenever it is active. The other class of two-level scheduler, dynamic, allows each job to acquire and release processors during its execution. By responding to the varying parallelism of the jobs, the dynamic scheduler promises higher processor utilizations at the cost of potentially greater scheduling overhead and more complicated application level task control policies. Our results, obtained via simulation, highlight the tradeoffs between the static and dynamic approaches. We investigate how the choice of policy is affected by the cost of switching a processor from one job to another. We show that for a wide range of plausible overhead values, dynamic scheduling is superior to static scheduling. Within the class of static schedulers, we show that, in most cases, a simple “run to completion” scheme is preferable to a round-robin approach. Finally, we investigate different techniques for tuning the allocation decisions required by the dynamic policies and quantify their effects on performance. We believe our results are directly applicable to many existing shared memory parallel computers, which for the most part currently employ a simple “single queue of tasks” extension of basic sequential machine schedulers. We plan to validate our results in future work through implementation and experimentation on such a system.

QuickSched: Task-based parallelism with dependencies and conflicts

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

Criticality-Aware Dynamic Task Scheduling for Heterogeneous Architectures

A Graphical Tool for Automatic Parallelization and Scheduling of Programs on Multiprocessors

Automatic Parallelization and Scheduling of Programs on Multiprocessors Using CASCH

Building Real-Time Parallel Task Systems on Multi-Cores: A Hierarchical Scheduling Approach.

An EScheduler-Based Data Dependence Analysis and Task Scheduling for Parallel Circuit Simulation

Advanced List Scheduling Heuristic for Task Scheduling with Communication Contention for Parallel Embedded Systems

CASCH: A Software Tool for Automatic Parallelization and Scheduling of Programs on Message-Passing Multiprocessors

Scalpel: High Performance Contention-Aware Task Co-Scheduling for Shared Cache Hierarchy

Relaxed Schedulers Can Efficiently Parallelize Iterative Algorithms

Online Distributed Scheduling on a Fault-prone Parallel System

Mitigating Resource Contention on Multicore Systems Via Scheduling

nOS-V: Co-Executing HPC Applications Using System-Wide Task Scheduling

A Quick Algorithm for Independent Tasks Scheduling on Identical Parallel Processors

Scheduling Jobs with Work-Inefficient Parallel Solutions

Real-Time Scheduling and Analysis of Synchronous OpenMP Task Systems with Tied Tasks

Synch: A framework for concurrent data-structures and benchmarks

GPGPU-Based Parallel Algorithms for Scheduling Against Due Date.

Processor scheduling in shared memory multiprocessors

CRQ-based fair scheduling on composable multicore architectures.