Abstract:Application programs that exhibit strong locality of reference lead to minimized cache misses and better performance in different architectures. However, to maximize the performance of multithreaded applications running on emerging manycore systems, data movement in on-chip network should also be minimized. Unfortunately, the way many multithreaded programs are written does not lend itself well to minimal data movement. Motivated by this observation, in this paper, we target task-based programs (which cover a large set of available multithreaded programs), and propose a novel compiler-based approach that consists of four complementary steps. First, we partition the original tasks in the target application into sub-tasks and build a data reuse graph at a sub-task granularity. Second, based on the intensity of temporal and spatial data reuses among sub-tasks, we generate new tasks where each such (new) task includes a set of sub-tasks that exhibit high data reuse among them. Third, we assign the newly-generated tasks to cores in an architecture-aware fashion with the knowledge of data location. Finally, we re-schedule the execution order of sub-tasks within new tasks such that sub-tasks that belong to different tasks but share data among them are executed in close proximity in time. The detailed experiments show that, when targeting a state of the art manycore system, our proposed compiler-based approach improves the performance of 10 multithreaded programs by 23.4% on average, and it also outperforms two state-of-the-art data access optimizations for all the benchmarks tested. Our results also show that the proposed approach i) improves the performance of multiprogrammed workloads, and ii) generates results that are close to maximum savings that could be achieved with perfect profiling information. Overall, our experimental results emphasize the importance of dividing an original set of tasks of an application into sub-tasks and constructing new tasks from the resulting sub-tasks in a data movement- and locality-aware fashion.

Optimal Footprint Symbiosis In Shared Cache

Optimal Symbiosis and Fair Scheduling in Shared Cache

Optimal Cache Partition-Sharing.

Building Expressive and Area-Efficient Directories with Hybrid Representation and Adaptive Multi-Granular Tracking

Co-Optimizing Cache Partitioning and Multi-Core Task Scheduling: Exploit Cache Sensitivity or Not?

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

Mix and Match: Reorganizing Tasks for Enhancing Data Locality

Combining Process-Based Cache Partitioning and Pollute Region Isolation to Improve Shared Last Level Cache Utilization on Multicore Systems

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

WCRT Optimization Scheme Based on Task Mapping and Cache Partitioning

Cache Hierarchy Optimization

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

Effective Cache Apportioning for Performance Isolation Under Compiler Guidance

Efficient shared cache management through sharing-aware replacement and streaming-aware insertion policy

Reducing Shared Cache Contention by Scheduling Order Adjustment on Commodity Multi-cores

Dynamic Cache Partitioning Based on Hot Page Migration

Minimizing Energy Consumption for Embedded Multicore Systems Using Cache Configuration and Task Mapping

Analysis and Approximation of Optimal Co-Scheduling on Chip Multiprocessors

Cluster Cache Monitor: Leveraging the Proximity Data in CMP

A Novel Cache Organization for Tiled Chip Multiprocessor