Abstract:Shared last level cache has been widely used in modern multicore processors. However, uncontrolled cache sharing on multicore leads to more serious cache pollution than that on single-core processor. A process with weak locality can evict strong locality data sets that belong to other concurrent ones. Processes in multiprocessing environment always affect each other on multicore systems with shared last level cache. Prior approaches either partition shared cache in process level to reduce inter-process cache contention, or isolate the non-temporal memory accesses in order to accelerate single application execution. Process-based cache partitioning may make intra-process cache pollution more serious and have great impact on single process performance. In this work, we take an alternative view to explore physical page layout optimization by combining process-based cache partitioning and pollute region isolation for improving the shared last level cache utilization on multicore systems. Our proposed approach includes three steps. The first step determines the cache sizes of co-scheduled applications and the second step recognizes weak-locality regions of each application on different cache size configurations. Lastly, the third step customizes the physical page layout to partition cache space among concurrent processes and set up global pollute buffer for mapping pollute regions into a small slice of shared last level cache. Our approach is directly used in commercial multicore systems without any additional hardware requirement. Our experimental results show that in comparison with default Linux memory management scheme, our approach improves performance by 26.73% on average. Even compared to the process-based cache partitioning RapidMRC, our approach further eliminates the harmful effect of non-reusable data, and system performance is also improved by 5.63% on average.

Optimization method for multi-core last level Cache considering the memory access modes

Online Cache Modeling for Commodity Multicore Processors

Cache Miss Reduction Through Hardware-Assisted Loop Optimization

Memory System Design for a Multi-core Processor

An Energy-Efficient Last Level Cache Design Using Software and Hardware Collaborative Region-based Management

Prefetch Structure of L2 Cache for Multi-Core Multi-Thread Pocessor

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

Improving the Performance of Heterogeneous Multi-Core Processors by Modifying the Cache Coherence Protocol

A Memory Access Scheduling Method for Multi-core Processor

Performance Optimization by Dynamically Altering Cache Replacement Algorithm in CPU-GPU Heterogeneous Multi-Core Architecture.

Combining Process-Based Cache Partitioning and Pollute Region Isolation to Improve Shared Last Level Cache Utilization on Multicore Systems

Partitioning The Last Level Cache To Improve Performance

A Cache Utility Monitor for Multi-core Processor

A Prefetching Coordinate Algorithm Which Can Be Used in Multi-core Processors

Management of the Last Level Cache for Multimedia Application System

Optimization Strategies of Data Processing Algorithms under Multi-Core Architecture

Abstract: Shared L2 Cache Management in Multicore Real-Time System

Analytical Modeling the Multi-Core Shared Cache Behavior with Considerations of Data-Sharing and Coherence

An Adjustable Fine-Grain Cache Assignment Scheduling Algorithm Based on Multi-core Architecture

Design and Optimization of Memory Access Structure for Multicore-SoC Based on SPM

The Design of Reconfigurable Cache Scheme in Multi-core Processor