Abstract:As the number of concurrently running applications on the chip multiprocessors (CMPs) is increasing, efficient management of the shared last-level cache (LLC) is crucial to guarantee overall performance. Recent studies have shown that cache partitioning can provide benefits in throughput, fairness and quality of service. Most prior arts apply true Least Recently Used (LRU) as the underlying cache replacement policy and rely on its stack property to work properly. However, in commodity processors, pseudo-LRU policies without stack property are commonly used instead of LRU for their simplicity and low storage overhead. Therefore, this study sets out to understand whether LRU-based cache partitioning techniques can be applied to commodity processors. In this work, we instead propose a cache partitioning mechanism for two popular pseudo-LRU policies: Not Recently Used (NRU) and Binary Tree (BT). Without the help of true LRU's stack property, we propose a profiling logic that applies curve approximation methods to derive the hit curve (hit counts under varied way allocations) for an application. We then propose a hybrid partitioning mechanism, which mitigates the gap between the predicted hit curve and the actual statistics. Simulation results demonstrate that our proposal can improve throughput by 15.3% on average and outperforms the stack-estimate proposal by 12.6% on average. Similar results can be achieved in weighted speedup. For the cache configurations under study, it requires less than 0.5% storage overhead compared to the last-level cache. In addition, we also show that profiling mechanism with only one true LRU ATD achieves comparable performance and can further reduce the hardware cost by nearly two thirds compared with the hybrid mechanism.

Aap And Aapm: Improved Prefetching Structures Of The L2 Cache

Tolerating Memory Latency: L2 Cache Actively Push Structure

New Prefetch Technique Design for L2 Cache

Tolerating Memory Latency Using a Hardware-Based Active-Pushing Technique

A Prefetching Coordinate Algorithm Which Can Be Used in Multi-core Processors

NewPrefetch Technique Design Forl2cache

Prefetch Structure of L2 Cache for Multi-Core Multi-Thread Pocessor

PACP: A Prefetch-aware Multi-core Shared Cache Partitioning Strategy

A Sharing-Aware Active Pushing Cache Technology on Chip-Multiprocessor

CPF: A Cross-Layer Prefetching Framework for High-Density Flash-Based Storage

Evaluating the Memory System Performance of Software-Initiated Inter-core LLC Prepushing

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

Memory system prefetching for multi-core and Multi-Threading architecture

A sharing-aware actively pushing cache on CMP

An Application-Oriented Cache Allocation and Prefetching Method for Long-Running Applications in Distributed Storage Systems

A New Hardware Prefetch Method and Its Effect on System Performance

An Improved Architecture for Multi-Core Prefetching

ASEP: an Adaptive Sequential Prefetching Scheme for Second-level Storage System

CHAM: Improving Prefetch Efficiency Using a Composite Hierarchy-Aware Method

CPpf: a prefetch aware LLC partitioning approach

Improving Cache Partitioning Algorithms For Pseudo-Lru Policies