Abstract:Designing and implementing efficient parallel priority schedulers is an active research area. An intriguing proposed design is the Multi-Queue: given n threads and m n distinct priority queues, task insertions are performed uniformly at random, while, to delete, a thread picks two queues uniformly at random, and removes the observed task of higher priority. This approach scales well, and has probabilistic rank guarantees: roughly, the rank of each task removed, relative to remaining tasks in all other queues, is O (m) in expectation. Yet, the performance of this pattern is below that of well-engineered schedulers, which eschew theoretical guarantees for practical efficiency. We investigate whether it is possible to design and implement a Multi-Queue-based task scheduler that is both highly-efficient and has analytical guarantees. We propose a new variant called the Stealing Multi-Queue (SMQ), a cache-efficient variant of the Multi-Queue, which leverages both queue affinity---each thread has a local queue, from which tasks are usually removed; but, with some probability, threads also attempt to steal higher-priority tasks from the other queues---and task batching, that is, the processing of several tasks in a single insert / remove step. These ideas are well-known for task scheduling without priorities; our theoretical contribution is showing that, despite relaxations, this design can still provide rank guarantees, which in turn implies bounds on total work performed. We provide a general SMQ implementation which can surpass state-of-the-art schedulers such as OBIM and PMOD in terms of performance on popular graph-processing benchmarks. Notably, the performance improvement comes mainly from the superior rank guarantees provided by our scheduler, confirming that analytically-reasoned approaches can still provide performance improvements for priority task scheduling. The full version of this paper is available in [24].

Mounds: Array-Based Concurrent Priority Queues

Multi-queues can be state-of-the-art priority schedulers

Weak heaps engineered

A Simple yet Exact Analysis of the MultiQueue

SmartPQ: An Adaptive Concurrent Priority Queue for NUMA Architectures

A rearrangement step with potential uses in priority queues

A Faster External Memory Priority Queue with DecreaseKeys

B-Queue: Efficient and Practical Queuing for Fast Core-to-Core Communication

Durable Queues: The Second Amendment

Quadboost: A Scalable Concurrent Quadtree

Modular Baskets Queue

Padovan heaps

A Complexity O(1) priority queue for event driven molecular dynamics simulations

I/O-Efficient Planar Range Skyline and Attrition Priority Queues

Dualheap Selection Algorithm: Efficient, Inherently Parallel and Somewhat Mysterious

A Scalable, Portable, and Memory-Efficient Lock-Free FIFO Queue

Montage: A General System for Buffered Durably Linearizable Data Structures

Improved and Partially-Tight Lower Bounds for Message-Passing Implementations of Multiplicity Queues

wCQ: A Fast Wait-Free Queue with Bounded Memory Usage

Poster Abstract: Neighbor-aware Queue-based Random Access

BBQ: A Block-based Bounded Queue for Exchanging Data and Profiling