Abstract:As the number of concurrently running applications on the chip multiprocessors (CMPs) is increasing, efficient management of the shared last-level cache (LLC) is crucial to guarantee overall performance. Recent studies have shown that cache partitioning can provide benefits in throughput, fairness and quality of service. Most prior arts apply true Least Recently Used (LRU) as the underlying cache replacement policy and rely on its stack property to work properly. However, in commodity processors, pseudo-LRU policies without stack property are commonly used instead of LRU for their simplicity and low storage overhead. Therefore, this study sets out to understand whether LRU-based cache partitioning techniques can be applied to commodity processors. In this work, we instead propose a cache partitioning mechanism for two popular pseudo-LRU policies: Not Recently Used (NRU) and Binary Tree (BT). Without the help of true LRU's stack property, we propose a profiling logic that applies curve approximation methods to derive the hit curve (hit counts under varied way allocations) for an application. We then propose a hybrid partitioning mechanism, which mitigates the gap between the predicted hit curve and the actual statistics. Simulation results demonstrate that our proposal can improve throughput by 15.3% on average and outperforms the stack-estimate proposal by 12.6% on average. Similar results can be achieved in weighted speedup. For the cache configurations under study, it requires less than 0.5% storage overhead compared to the last-level cache. In addition, we also show that profiling mechanism with only one true LRU ATD achieves comparable performance and can further reduce the hardware cost by nearly two thirds compared with the hybrid mechanism.

Access Adaptive and Thread-Aware Cache Partitioning in Multicore Systems

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

Energy-Aware Cache Partition Based on Way-Adaptable in CMP

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

TADC: Thread-aware Divide-and-Conquer Policy to Manage Shared Cache

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

A Phase Behavior Aware Dynamic Cache Partitioning Scheme for CMPs.

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

Cache Matching: Thread Scheduling to Maximize Data Reuse

A Low-power Oriented Dynamic Hybrid Cache Partitioning for Chip Multi-processor

Dynamic Cache Reservation to Maximize Efficiency in Shared Cache Multicores

ARP :An Adaptive Runtime Mechanism to Partition Shared Cache in SMT Architecture

PACP: A Prefetch-aware Multi-core Shared Cache Partitioning Strategy

CMP Thread Assignment Based on Group Sharing L2 Cache

WCRT Optimization Scheme Based on Task Mapping and Cache Partitioning

Power Consumption of the Shared L2 Cache Dynamic Partition in CMP

Dynamic Partitioning of Scalable Cache Memory for SMT Architectures

A Heterogeneity-Aware Replacement Policy for the Partitioned Cache on Asymmetric Multi-Core Architectures

Optimization method for multi-core last level Cache considering the memory access modes

Performance Study of Partitioned Caches in Asymmetric Multi-Core Processors