Abstract:Shared last level cache has been widely used in modern multicore processors. However, uncontrolled cache sharing on multicore leads to more serious cache pollution than that on single-core processor. A process with weak locality can evict strong locality data sets that belong to other concurrent ones. Processes in multiprocessing environment always affect each other on multicore systems with shared last level cache. Prior approaches either partition shared cache in process level to reduce inter-process cache contention, or isolate the non-temporal memory accesses in order to accelerate single application execution. Process-based cache partitioning may make intra-process cache pollution more serious and have great impact on single process performance. In this work, we take an alternative view to explore physical page layout optimization by combining process-based cache partitioning and pollute region isolation for improving the shared last level cache utilization on multicore systems. Our proposed approach includes three steps. The first step determines the cache sizes of co-scheduled applications and the second step recognizes weak-locality regions of each application on different cache size configurations. Lastly, the third step customizes the physical page layout to partition cache space among concurrent processes and set up global pollute buffer for mapping pollute regions into a small slice of shared last level cache. Our approach is directly used in commercial multicore systems without any additional hardware requirement. Our experimental results show that in comparison with default Linux memory management scheme, our approach improves performance by 26.73% on average. Even compared to the process-based cache partitioning RapidMRC, our approach further eliminates the harmful effect of non-reusable data, and system performance is also improved by 5.63% on average.

A Low-power Oriented Dynamic Hybrid Cache Partitioning for Chip Multi-processor

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

Access Adaptive and Thread-Aware Cache Partitioning in Multicore Systems

Study on the Low Power Cache Design Technique

Dynamic Partitioning of Scalable Cache Memory for SMT Architectures

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

Design Scheme of Directory-based Cooperative Cache in CMP

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

DPA: Demand-Based Partition and Data Allocation for Hybrid On-Chip Memory

Performance Study of Partitioned Caches in Asymmetric Multi-Core Processors

Management Policies Analysis for Multi-core Shared Caches

Combining Process-Based Cache Partitioning and Pollute Region Isolation to Improve Shared Last Level Cache Utilization on Multicore Systems

Dynamic Cache Partitioning Based on Hot Page Migration

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

An Application-Specific Memory Partitioning Method for Low Power

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

Predictable Sharing of Last-level Cache Partitions for Multi-core Safety-critical Systems

PASCMP: A Novel Cache Framework for Data Mining Application

CMP Thread Assignment Based on Group Sharing L2 Cache