Abstract:The well-studied red-blue pebble game models the execution of an arbitrary computational DAG by a single processor over a two-level memory hierarchy. We present a natural generalization to a multiprocessor setting where each processor has its own limited fast memory, and all processors share unlimited slow memory. To our knowledge, this is the first thorough study that combines pebbling and DAG scheduling problems, capturing the computation of general workloads on multiple processors with memory constraints and communication costs. Our pebbling model enables us to analyze trade-offs between workload balancing, communication and memory limitations, and it captures real-world factors such as superlinear speedups due to parallelization. Our results include upper and lower bounds on the pebbling cost, an analysis of a greedy pebbling strategy, and an extension of NP-hardness results for specific DAG classes from simpler models. For our main technical contribution, we show two inapproximability results that already hold for the long-standing problem of standard red-blue pebbling: (i) the optimal I/O cost cannot be approximated to any finite factor, and (ii) the optimal total cost (I/O+computation) can only be approximated to a limited constant factor, i.e., it does not allow for a polynomial-time approximation scheme. These results also carry over naturally to our multiprocessor pebbling model.

What problem does this paper attempt to address?

The paper attempts to address the problem of optimizing computational task scheduling in a multiprocessor environment. Specifically, the study introduces a new model called the "Multiprocessor Red-Blue Pebbling Game (MPP)," which extends the classic Single-Processor Red-Blue Pebbling Game (SPP) to explore the trade-offs between time, communication, and memory constraints when exchanging data among multiple processors with limited fast memory. The main contributions of the paper include: 1. **Proposing the MPP Model**: The MPP model combines the pebbling game problem on a DAG (Directed Acyclic Graph) (single-processor computation with limited memory) and the DAG scheduling problem (multiprocessor computation but with unlimited memory). This model can capture computational costs, I/O costs due to memory limitations, and inter-processor communication costs, allowing for convenient exploration of the trade-offs among these factors. 2. **Basic Property Analysis**: The paper discusses the basic properties of MPP, including simple cost bounds, NP-hardness proofs for specific classes of DAGs, and an analysis of the effectiveness of a simple greedy strategy. 3. **Complexity Results**: The paper presents two complexity results regarding the difficulty of approximating optimal strategies. First, it proves that even in the single-processor case, minimizing the number of I/O steps cannot be approximated within any finite multiplicative or additive factor in polynomial time. Second, the minimum total cost (including I/O and computation steps) can only be approximated to a finite constant factor, meaning there is no Polynomial Time Approximation Scheme (PTAS). These two results naturally apply to the MPP model as well. Through the above work, the paper reveals the key challenges in efficiently executing computational tasks in a multiprocessor environment and provides a theoretical foundation to guide resource allocation and scheduling strategies in practical system design.

Red-Blue Pebbling with Multiple Processors: Time, Communication and Memory Trade-offs

On the Hardness of Red-Blue Pebble Games

I/O complexity and pebble games with partial computations

Efficient Multi-Processor Scheduling in Increasingly Realistic Models

On Maximizing the Throughput of Multiprocessor Tasks.

Worst-Case Performance Evaluation on Multiprocessor Task Scheduling with Resource Augmentation

New Tools for Peak Memory Scheduling

Hardness of Approximation in PSPACE and Separation Results for Pebble Games

Inapproximability of the Standard Pebble Game and Hard to Pebble Graphs

Tight Bounds on the Spooky Pebble Game: Recycling Qubits with Measurements

The DAG Visit approach for Pebbling and I/O Lower Bounds

DAG Scheduling in the BSP Model

Efficiently Scheduling Parallel DAG Tasks on Identical Multiprocessors

Reversible Simulation of Irreversible Computation by Pebble Games

Reducing Response-Time Bounds for DAG-Based Task Systems on Heterogeneous Multicore Platforms.

Decomposition-based scheduling for parallel real-time tasks on multiprocessors

Traffic-Aware and Memory-Aware Task Scheduling on Multi-Core Chips

Mapping Large Memory-constrained Workflows onto Heterogeneous Platforms

MemPool: A Scalable Manycore Architecture with a Low-Latency Shared L1 Memory

On Multiprocessor System Scheduling

A universal bound on the space complexity of Directed Acyclic Graph computations