Abstract:With recent advances of processor technology, the LRU based shared last-level cache (LLC) has been widely employed in modern Chip Multi-processors (CMP). However, past research [1,2,8,9] indicates that the cache performance of the LLC and further of the CMP processors may be degraded severely by LRU under the occurrence of the inter-thread interference or the excess of the working set size over the cache size. Existing approaches tackling this performance degradation problem have limited improvement of an overall cache performance because they usually focus on a single type of memory access behavior and thus lack full consideration of tradeoffs among different types of memory access behaviors. In this paper, we propose a unified cache management policy called Partitioning-Aware Eviction and Thread-aware Insertion/Promotion policy (PAE-TIP) that can effectively enhance capacity management, adaptive insertion/promotion, and further improve the overall cache performance. Specifically, PAE-TIP employs an adaptive mechanism to decide the position where to put the incoming lines or to move the hit lines, and chooses a victim line based on the target partitioning given by utility-based cache partitioning (UCP) [2]. In our study, we show that PAE-TIP can cover a variety of memory access behaviors simultaneously and provide a good tradeoff for overall cache performance improvement while retaining competitively low hardware and design overhead. The evaluation conducted on 4-way CMPs shows that the PAE-TIP-managed LLC can improve overall performance by19.3% on average over the LRU policy. Furthermore, the performance benefit of PAE-TIP is 1.09x compared to PIPP, 1.11x compared to TADIP and 1.12x compared to UCP.

Performance Modeling for Helper Thread on Shared Cache Cmps

Analytical Modeling the Multi-Core Shared Cache Behavior with Considerations of Data-Sharing and Coherence

Cache Sharing Management for Performance Fairness in Chip Multiprocessors

Helper Without Threads: Customized Prefetching for Delinquent Irregular Loads

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

Performance Metrics and Models for Shared Cache

CMP Thread Assignment Based on Group Sharing L2 Cache

Cache Hierarchy Optimization

PASCMP: A Novel Cache Framework for Data Mining Application

Architectural support predicting method for CMP scheduling

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor

Test of the MPCore cache bandwidthand considerations for efficient software execution

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

Exploring Data Prefetching Mechanisms for Last Level Cache in Chip Multi-Processors

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

Optimal Symbiosis and Fair Scheduling in Shared Cache

Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

Bayesian Theory Based Adaptive Proximity Data Accessing For Cmp Caches

Fast Modeling L2 Cache Reuse Distance Histograms Using Combined Locality Information from Software Traces