Abstract:In this work, we are interested in the problem of satisfying multiple concurrent requests submitted to a computing server. Informally, there are users each sending a sequence of requests to the server. The requests consist of tasks linked by precedence constraints. Tasks may occur several times in the same sequence as well as in a request sequence of another user. The computing server has to execute tasks with variable processing times. The server owns a cache of limited size where intermediate results of the processing may be stored. If an intermediate result for a task is stored into the cache, no processing cost has to be paid and the result can directly be fetched from the cache. The goal of this work is to determine a schedule of the tasks such that an optimization function is minimized (the only objective studied up to now is the make span). This problem is a variant of caching which considers only one sequence of requests. We then extend the study to the minimization of the mean completion time of the request sequences. Two models are considered. In the first model, caching is forced whereas in the second model caching is optional and one can choose whether an intermediate result is stored in the cache or not. All combinations turn out to be NP-hard for fixed cache sizes and we provide a formulation as dynamic program as well as bounds for in approximation. We propose polynomial time approximation algorithms for some variants and analyze their approximation ratios. Finally, we also devise some heuristics and present experimental results. Tasks may occur several times in the same sequence as well as in a request sequence of another user. The computing server has to execute tasks with variable processing times. The server owns a cache of limited size where intermediate results of the processing may be stored. If an intermediate result for a task is stored into the cache, no processing cost has to be paid and the result can directly be fetched from the cache. The goal of this work is to determine a schedule of the tasks such that an optimization function is minimized (the only objective studied up to now is the make span). This problem is a variant of caching which considers only one sequence of requests. We then extend the study to the minimization of the mean completion time of the request sequences. Two models are considered. In the first model, caching is forced whereas in the second model caching is optional and one can choose whether an intermediate result is stored in the cache or not. All combinations turn out to be NP-hard for fixed cache sizes and we provide a formulation as dynamic program as well as bounds for in approximation. We propose polynomial time approximation algorithms for some variants and analyze their approximation ratios. Finally, we also devise some heuristics and present experimental results.

Single-Producer/Single-Consumer Queues on Shared Cache Multi-Core Systems

Offline Scheduling of Multi-threaded Request Streams on a Caching Server.

A Scalable, Portable, and Memory-Efficient Lock-Free FIFO Queue

wCQ: A Fast Wait-Free Queue with Bounded Memory Usage

Jiffy: A Fast, Memory Efficient, Wait-Free Multi-Producers Single-Consumer Queue

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

B-Queue: Efficient and Practical Queuing for Fast Core-to-Core Communication

Efficient shared cache management through sharing-aware replacement and streaming-aware insertion policy

Twenty Years After: Hierarchical Core-Stateless Fair Queueing

Reducing Shared Cache Contention by Scheduling Order Adjustment on Commodity Multi-cores

Processor scheduling in shared memory multiprocessors

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

Performance Analysis of Resource Allocation Algorithms Using Cache Technology for Pervasive Computing System

Optimal Symbiosis and Fair Scheduling in Shared Cache

Atomic Streaming: A Framework of On-Chip Data Supply System for Task-Parallel Mpsocs

Cache Sharing Management for Performance Fairness in Chip Multiprocessors

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

ROBUS: Fair Cache Allocation for Multi-tenant Data-parallel Workloads

CRQ-based fair scheduling on composable multicore architectures.

Quantum-Adaptive Scheduling for Multi-Core Network Processors.

An Empirical Study of Cache-Oblivious Priority Queues and their Application to the Shortest Path Problem