Abstract:Application programs that exhibit strong locality of reference lead to minimized cache misses and better performance in different architectures. However, to maximize the performance of multithreaded applications running on emerging manycore systems, data movement in on-chip network should also be minimized. Unfortunately, the way many multithreaded programs are written does not lend itself well to minimal data movement. Motivated by this observation, in this paper, we target task-based programs (which cover a large set of available multithreaded programs), and propose a novel compiler-based approach that consists of four complementary steps. First, we partition the original tasks in the target application into sub-tasks and build a data reuse graph at a sub-task granularity. Second, based on the intensity of temporal and spatial data reuses among sub-tasks, we generate new tasks where each such (new) task includes a set of sub-tasks that exhibit high data reuse among them. Third, we assign the newly-generated tasks to cores in an architecture-aware fashion with the knowledge of data location. Finally, we re-schedule the execution order of sub-tasks within new tasks such that sub-tasks that belong to different tasks but share data among them are executed in close proximity in time. The detailed experiments show that, when targeting a state of the art manycore system, our proposed compiler-based approach improves the performance of 10 multithreaded programs by 23.4% on average, and it also outperforms two state-of-the-art data access optimizations for all the benchmarks tested. Our results also show that the proposed approach i) improves the performance of multiprogrammed workloads, and ii) generates results that are close to maximum savings that could be achieved with perfect profiling information. Overall, our experimental results emphasize the importance of dividing an original set of tasks of an application into sub-tasks and constructing new tasks from the resulting sub-tasks in a data movement- and locality-aware fashion.

Data layout optimization based on the spatio-temporal model of field access

ASLOP: A Field-Access Affinity-Based Structure Data Layout Optimizer

Global Data Access Optimization Via Load/Store Instruction Extension

A Spatial and Temporal Locality-Aware Adaptive Cache Design with Network Optimization for Tiled Many-Core Architectures.

Optimal data allocation algorithm for loop-centric applications on scratch-PAD memories

Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

Data Allocation Optimization for Hybrid Scratch Pad Memory with SRAM and Nonvolatile Memory

Effective File Data-Block Placement for Different Types of Page Cache on Hybrid Main Memory Architectures

Mix and Match: Reorganizing Tasks for Enhancing Data Locality

Optimizing Data Allocation for Loops on Embedded Systems with Scratch-Pad Memory

Fast Miss Ratio Curve Modeling For Storage Cache

Optimizing Data Distribution for Loops on Embedded Multicore with Scratch-Pad Memory.

Gaze into the Pattern: Characterizing Spatial Patterns with Internal Temporal Correlations for Hardware Prefetching

Optimal Data Placement for Memory Architectures with Scratch-Pad Memories

Improving In-Memory File System Reading Performance by Fine-Grained User-Space Cache Mechanisms

Optimal Data Allocation for Scratch-Pad Memory on Embedded Multi-core Systems

Optimizing Data Placement of Loops for Energy Minimization with Multiple Types of Memories

Fast Modeling L2 Cache Reuse Distance Histograms Using Combined Locality Information from Software Traces

Improving Memory Access Performance of In-Memory Key-Value Store Using Data Prefetching Techniques

An Efficient Memory Partitioning Approach for Multi-Pattern Data Access via Data Reuse

Optimizing Software Cache Performance of Packet Processing Applications