Abstract:Existing work indicates that the commonly used “single queue of runnable tasks” approach to scheduling shared memory multiprocessors can perform very poorly in a multiprogrammed parallel processing environment. A more promising approach is the class of “two-level schedulers” in which the operating system deals solely with allocating processors to jobs while the individual jobs themselves perform task dispatching on those processors. In this paper we compare two basic varieties of two-level schedulers. Those of the first type, static, make a single decision per job regarding the number of processors to allocate to it. Once the job has received its allocation, it is guaranteed to have exactly that number of processors available to it whenever it is active. The other class of two-level scheduler, dynamic, allows each job to acquire and release processors during its execution. By responding to the varying parallelism of the jobs, the dynamic scheduler promises higher processor utilizations at the cost of potentially greater scheduling overhead and more complicated application level task control policies. Our results, obtained via simulation, highlight the tradeoffs between the static and dynamic approaches. We investigate how the choice of policy is affected by the cost of switching a processor from one job to another. We show that for a wide range of plausible overhead values, dynamic scheduling is superior to static scheduling. Within the class of static schedulers, we show that, in most cases, a simple “run to completion” scheme is preferable to a round-robin approach. Finally, we investigate different techniques for tuning the allocation decisions required by the dynamic policies and quantify their effects on performance. We believe our results are directly applicable to many existing shared memory parallel computers, which for the most part currently employ a simple “single queue of tasks” extension of basic sequential machine schedulers. We plan to validate our results in future work through implementation and experimentation on such a system.

An overview of dynamic resource scheduling on graphics processors

Efficient Multi-Processor Scheduling in Increasingly Realistic Models

DAG-based Scheduling with Resource Sharing for Multi-task Applications in a Polyglot GPU Runtime

Analysis of Dynamic Scheduling Strategies for Matrix Multiplication on Heterogeneous Platforms

Processor scheduling in shared memory multiprocessors

Evaluation of Selected Resource Allocation and Scheduling Methods in Heterogeneous Many-Core Processors and Graphics Processing Units

Representing and scheduling procedural generation using operator graphs

Parallel Path Progression DAG Scheduling

Real-Time Scheduling Upon a Host-Centric Acceleration Architecture with Data Offloading

Replication-Based Partial Dynamic Scheduling On Heterogeneous Network Processors

Energy-efficient Deadline Scheduling for Heterogeneous Systems.

Scheduling Best-Effort and Real-Time Pipelined Applications on Time-Shared Clusters.

Enhancement of Resource Scheduling on Gui Based Operating System

Novel Dynamic Real-Time Scheduling Algorithm for Homogeneous Multiprocessor Systems

Performance-effective and low-complexity task scheduling for heterogeneous computing

Criticality-Aware Dynamic Task Scheduling for Heterogeneous Architectures

On Multiprocessor System Scheduling

Scheduling Parallel Real-Time Tasks on Virtual Processors

Agglomerative Memory and Thread Scheduling for High-Performance Ray-Tracing on GPUs

Effective GPU Sharing Under Compiler Guidance

Impact of Workload and System Parameters on Next Generation Cluster Scheduling Mechanisms