Abstract:As the number of concurrently running applications on the chip multiprocessors (CMPs) is increasing, efficient management of the shared last-level cache (LLC) is crucial to guarantee overall performance. Recent studies have shown that cache partitioning can provide benefits in throughput, fairness and quality of service. Most prior arts apply true Least Recently Used (LRU) as the underlying cache replacement policy and rely on its stack property to work properly. However, in commodity processors, pseudo-LRU policies without stack property are commonly used instead of LRU for their simplicity and low storage overhead. Therefore, this study sets out to understand whether LRU-based cache partitioning techniques can be applied to commodity processors. In this work, we instead propose a cache partitioning mechanism for two popular pseudo-LRU policies: Not Recently Used (NRU) and Binary Tree (BT). Without the help of true LRU's stack property, we propose a profiling logic that applies curve approximation methods to derive the hit curve (hit counts under varied way allocations) for an application. We then propose a hybrid partitioning mechanism, which mitigates the gap between the predicted hit curve and the actual statistics. Simulation results demonstrate that our proposal can improve throughput by 15.3% on average and outperforms the stack-estimate proposal by 12.6% on average. Similar results can be achieved in weighted speedup. For the cache configurations under study, it requires less than 0.5% storage overhead compared to the last-level cache. In addition, we also show that profiling mechanism with only one true LRU ATD achieves comparable performance and can further reduce the hardware cost by nearly two thirds compared with the hybrid mechanism.

Approximate analysis of LRU in the case of short term correlations

Limited History Based Multi-LRU Web Cache Replacement Algorithm

On the Convergence of the TTL Approximation for an LRU Cache under Independent Stationary Request Processes

Network cache design under stationary requests: Exact analysis and Poisson approximation

A novel cache replacement policy for Web content delivery

Prr: A Low-Overhead Cache Replacement Algorithm for Embedded Processors

The LCD interconnection of LRU caches and its analysis

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies

Spatial Multi-LRU Caching for Wireless Networks with Coverage Overlaps

Computing the Hit Rate of Similarity Caching

Spatial multi-LRU: Distributed Caching for Wireless Networks with Coverage Overlaps

Dynamic Access Distance Driven Cache Replacement

A Novel Cache Replacement Policy Via Dynamic Adaptive Insertion And Re-Reference Prediction

A Cache Replacement Policy Using Adaptive Insertion and Re-reference Prediction

Fast Miss Ratio Curve Modeling For Storage Cache

LRU Cache under Stationary Requests

Learning Cache Replacement with CACHEUS

On the Analysis of Cache Invalidation With LRU Replacement

Performance Model for Similarity Caching

On Resource Pooling and Separation for LRU Caching

Kinetic Modeling Of Data Eviction In Cache