Abstract:Application programs that exhibit strong locality of reference lead to minimized cache misses and better performance in different architectures. However, to maximize the performance of multithreaded applications running on emerging manycore systems, data movement in on-chip network should also be minimized. Unfortunately, the way many multithreaded programs are written does not lend itself well to minimal data movement. Motivated by this observation, in this paper, we target task-based programs (which cover a large set of available multithreaded programs), and propose a novel compiler-based approach that consists of four complementary steps. First, we partition the original tasks in the target application into sub-tasks and build a data reuse graph at a sub-task granularity. Second, based on the intensity of temporal and spatial data reuses among sub-tasks, we generate new tasks where each such (new) task includes a set of sub-tasks that exhibit high data reuse among them. Third, we assign the newly-generated tasks to cores in an architecture-aware fashion with the knowledge of data location. Finally, we re-schedule the execution order of sub-tasks within new tasks such that sub-tasks that belong to different tasks but share data among them are executed in close proximity in time. The detailed experiments show that, when targeting a state of the art manycore system, our proposed compiler-based approach improves the performance of 10 multithreaded programs by 23.4% on average, and it also outperforms two state-of-the-art data access optimizations for all the benchmarks tested. Our results also show that the proposed approach i) improves the performance of multiprogrammed workloads, and ii) generates results that are close to maximum savings that could be achieved with perfect profiling information. Overall, our experimental results emphasize the importance of dividing an original set of tasks of an application into sub-tasks and constructing new tasks from the resulting sub-tasks in a data movement- and locality-aware fashion.

Optimal Symbiosis and Fair Scheduling in Shared Cache

Optimal Footprint Symbiosis In Shared Cache

Co-Optimizing Cache Partitioning and Multi-Core Task Scheduling: Exploit Cache Sensitivity or Not?

Optimal Cache Partition-Sharing.

L-QoCo: learning to optimize cache capacity overloading in storage systems

Approximation algorithms for scheduling on multi-core processor with shared speedup resources

Analysis and Approximation of Optimal Co-Scheduling on Chip Multiprocessors

Reducing Shared Cache Contention by Scheduling Order Adjustment on Commodity Multi-cores

Mitigating Resource Contention on Multicore Systems Via Scheduling

WCRT Optimization Scheme Based on Task Mapping and Cache Partitioning

Combining Process-Based Cache Partitioning and Pollute Region Isolation to Improve Shared Last Level Cache Utilization on Multicore Systems

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor

Cache Sharing Management for Performance Fairness in Chip Multiprocessors

Mix and Match: Reorganizing Tasks for Enhancing Data Locality

The Complexity of Optimal Job Co-Scheduling on Chip Multiprocessors and Heuristics-Based Solutions

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

Timing Analysis of Concurrent Programs Running on Shared Cache Multi-Cores

VM Co-scheduling: Approximation of Optimal Co-scheduling in Data Center

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

Analytical Modeling the Multi-Core Shared Cache Behavior with Considerations of Data-Sharing and Coherence

Share Memory Aware Scheduler