Abstract:Application programs that exhibit strong locality of reference lead to minimized cache misses and better performance in different architectures. However, to maximize the performance of multithreaded applications running on emerging manycore systems, data movement in on-chip network should also be minimized. Unfortunately, the way many multithreaded programs are written does not lend itself well to minimal data movement. Motivated by this observation, in this paper, we target task-based programs (which cover a large set of available multithreaded programs), and propose a novel compiler-based approach that consists of four complementary steps. First, we partition the original tasks in the target application into sub-tasks and build a data reuse graph at a sub-task granularity. Second, based on the intensity of temporal and spatial data reuses among sub-tasks, we generate new tasks where each such (new) task includes a set of sub-tasks that exhibit high data reuse among them. Third, we assign the newly-generated tasks to cores in an architecture-aware fashion with the knowledge of data location. Finally, we re-schedule the execution order of sub-tasks within new tasks such that sub-tasks that belong to different tasks but share data among them are executed in close proximity in time. The detailed experiments show that, when targeting a state of the art manycore system, our proposed compiler-based approach improves the performance of 10 multithreaded programs by 23.4% on average, and it also outperforms two state-of-the-art data access optimizations for all the benchmarks tested. Our results also show that the proposed approach i) improves the performance of multiprogrammed workloads, and ii) generates results that are close to maximum savings that could be achieved with perfect profiling information. Overall, our experimental results emphasize the importance of dividing an original set of tasks of an application into sub-tasks and constructing new tasks from the resulting sub-tasks in a data movement- and locality-aware fashion.

STLAC: A Spatial and Temporal Locality-Aware Cache and Network-on-chip Codesign for Tiled Many-Core Systems.

A Spatial and Temporal Locality-Aware Adaptive Cache Design with Network Optimization for Tiled Many-Core Architectures.

L-QoCo: learning to optimize cache capacity overloading in storage systems

Network caching for Chip Multiprocessors

Locality-Aware Work Stealing Based on Online Profiling and Auto-Tuning for Multisocket Multicore Architectures

Network Victim Cache: Leveraging Network-on-Chip for Managing Shared Caches in Chip Multiprocessors

Laws: Locality-Aware Work-Stealing For Multi-Socket Multi-Core Architectures

TADC: Thread-aware Divide-and-Conquer Policy to Manage Shared Cache

A Novel Cache Organization for Tiled Chip Multiprocessor

LA-LLC: Inter-Core Locality-Aware Last-Level Cache to Exploit Many-to-Many Traffic in GPGPUs

An Efficient Locality-Aware Task Assignment Algorithm for Minimizing Shared Cache Contention.

A Two-Level Cache Aware Adaptive Data Replication Mechanism for Shared LLC

Toward Multi-Programmed Workloads with Different Memory Footprints: a Self-Adaptive Last Level Cache Scheduling Scheme

Bayesian Theory Based Adaptive Proximity Data Accessing For Cmp Caches

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

Cache-Friendly Design for Complex Spatially-Variable Coefficient Stencils on Many-Core Architectures

Mix and Match: Reorganizing Tasks for Enhancing Data Locality

Optimal Placement of Cores, Caches and Memory Controllers in Network On-Chip

Adaptive Placement and Migration Policy for an STT-RAM-based Hybrid Cache

Reliability- and Performance-Driven Mapping for Regular 3D NoCs Using a Novel Latency Model and Simulated Allocation.

Behavior Aware Data Locality for Caches