Abstract:To keep pace with Moore's law, chip designers have focused on increasing the number of cores per chip rather than single core performance. In turn, modern jobs are often designed to run on any number of cores. However, to effectively leverage these multi-core chips, one must address the question of how many cores to assign to each job. Given that jobs receive sublinear speedups from additional cores, there is an obvious tradeoff: allocating more cores to an individual job reduces the job's runtime, but in turn decreases the efficiency of the overall system. We ask how the system should schedule jobs across cores so as to minimize the mean response time over a stream of incoming jobs. To answer this question, we develop an analytical model of jobs running on a multi-core machine. We prove that EQUI, a policy which continuously divides cores evenly across jobs, is optimal when all jobs follow a single speedup curve and have exponentially distributed sizes. EQUI requires jobs to change their level of parallelization while they run. Since this is not possible for all workloads, we consider a class of "fixed-width" policies, which choose a single level of parallelization, k, to use for all jobs. We prove that, surprisingly, it is possible to achieve EQUI's performance without requiring jobs to change their levels of parallelization by using the optimal fixed level of parallelization, k*. We also show how to analytically derive the optimal k* as a function of the system load, the speedup curve, and the job size distribution. In the case where jobs may follow different speedup curves, finding a good scheduling policy is even more challenging. We find that policies like EQUI which performed well in the case of a single speedup function now perform poorly. We propose a very simple policy, GREEDY*, which performs near-optimally when compared to the numerically-derived optimal policy.

Runtime Incremental Parallel Scheduling (RIPS) for Large-Scale Parallel Computers

An Efficient Fault-Tolerant Scheduling Algorithm for Periodic Real-Time Tasks in Heterogeneous Platforms

An Incremental Parallel Scheduling Approach to Solving Dynamic and Irregular Problems.

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

Runtime Parallel Incremental Scheduling of DAGs

RISA: Round-Robin Intra-Rack Friendly Scheduling Algorithm for Disaggregated Datacenters

Improved Task and Resource Partitioning under the Resource-Oriented Partitioned Scheduling

Strategy and simulation of adaptive RID for distributed dynamic load balancing in parallel systems

Efficient Fault-Tolerant Scheduling on Multiprocessor Systems Via Replication and Deallocation

Criticality-Aware Dynamic Task Scheduling for Heterogeneous Architectures

PISCES: Optimizing Multi-Job Application Execution in MapReduce

IPPTS: an Efficient Algorithm for Scientific Workflow Scheduling in Heterogeneous Computing Systems.

A Runtime System for Dynamic DAG Programming

Resource allocation and aging priority-based scheduling of linear workflow applications with transient failures and selective imprecise computations

RTGPU: Real-Time GPU Scheduling of Hard Deadline Parallel Tasks With Fine-Grain Utilization

ROA-CONS: Raccoon Optimization for Job Scheduling

rDLB: A Novel Approach for Robust Dynamic Load Balancing of Scientific Applications with Parallel Independent Tasks

INSPIRIT: Optimizing Heterogeneous Task Scheduling through Adaptive Priority in Task-based Runtime Systems

Towards Optimality in Parallel Scheduling

Bi-level scheduling in high-end equipment R&D: when more algorithm strategies may not be better

Safe Self-Scheduling: A Parallel Loop Scheduling Scheme for Shared-Memory Multiprocessors