Abstract:Existing work indicates that the commonly used “single queue of runnable tasks” approach to scheduling shared memory multiprocessors can perform very poorly in a multiprogrammed parallel processing environment. A more promising approach is the class of “two-level schedulers” in which the operating system deals solely with allocating processors to jobs while the individual jobs themselves perform task dispatching on those processors. In this paper we compare two basic varieties of two-level schedulers. Those of the first type, static, make a single decision per job regarding the number of processors to allocate to it. Once the job has received its allocation, it is guaranteed to have exactly that number of processors available to it whenever it is active. The other class of two-level scheduler, dynamic, allows each job to acquire and release processors during its execution. By responding to the varying parallelism of the jobs, the dynamic scheduler promises higher processor utilizations at the cost of potentially greater scheduling overhead and more complicated application level task control policies. Our results, obtained via simulation, highlight the tradeoffs between the static and dynamic approaches. We investigate how the choice of policy is affected by the cost of switching a processor from one job to another. We show that for a wide range of plausible overhead values, dynamic scheduling is superior to static scheduling. Within the class of static schedulers, we show that, in most cases, a simple “run to completion” scheme is preferable to a round-robin approach. Finally, we investigate different techniques for tuning the allocation decisions required by the dynamic policies and quantify their effects on performance. We believe our results are directly applicable to many existing shared memory parallel computers, which for the most part currently employ a simple “single queue of tasks” extension of basic sequential machine schedulers. We plan to validate our results in future work through implementation and experimentation on such a system.

Model of a System for Servicing Multiprocessor Tasks without a Queue

Performance Analysis of Scheduling Schemes in Multiserver Multiqueue Systems

Queueing Systems with Some Versions of Limited Processor Sharing Discipline

Processor scheduling in shared memory multiprocessors

Generalized Parallel-Server Fork-Join Queues with Dynamic Task Scheduling.

Queuing Models for Peer-to-peer Systems

Modeling Information Flow with a Multi-Stage Queuing Mode

Hierarchical Analyses Applied to Computer System Performance: Review and Call for Further Studies

Using queuing theory to describe adaptive mathematical models of computing systems with resource virtualization and its verification using a virtual server with a configuration similar to the configuration of a given model

Queueing-theoretic Solution Methods for Models of Parallel and Distributed Systems

Queuing Model with Customer Class Movement across Server Groups for Analyzing Virtual Machine Migration in Cloud Computing

Modeling and Performance Analysis of a Multiserver Multiqueue System on the Grid

Response time in a pair of processor sharing queues with Join-the-Shortest-Queue scheduling

Multiprocessor Simulator System Based on Multi-way Cluster Using Double-buffered Model

Approximating the Performance of a Batch Service Queue Using the ${\rm M/M}^{\rm K}/1$ Model

A hybrid approach to minimize state space explosion problem for the solution of two stage tandem queues

Queueing system with batch arrival of heterogeneous orders, flexible limited processor sharing and dynamical change of priorities

Parallel Models and Job Characterization for System Scheduling.

Reliability-Guaranteed Task Assignment and Scheduling for Heterogeneous Multiprocessors Considering Timing Constraint

Zero Queueing for Multi-Server Jobs

Queue Management for QoS Provision Build on Network Processor.