Abstract:With recent advances of processor technology, the LRU based shared last-level cache (LLC) has been widely employed in modern Chip Multi-processors (CMP). However, past research [1,2,8,9] indicates that the cache performance of the LLC and further of the CMP processors may be degraded severely by LRU under the occurrence of the inter-thread interference or the excess of the working set size over the cache size. Existing approaches tackling this performance degradation problem have limited improvement of an overall cache performance because they usually focus on a single type of memory access behavior and thus lack full consideration of tradeoffs among different types of memory access behaviors. In this paper, we propose a unified cache management policy called Partitioning-Aware Eviction and Thread-aware Insertion/Promotion policy (PAE-TIP) that can effectively enhance capacity management, adaptive insertion/promotion, and further improve the overall cache performance. Specifically, PAE-TIP employs an adaptive mechanism to decide the position where to put the incoming lines or to move the hit lines, and chooses a victim line based on the target partitioning given by utility-based cache partitioning (UCP) [2]. In our study, we show that PAE-TIP can cover a variety of memory access behaviors simultaneously and provide a good tradeoff for overall cache performance improvement while retaining competitively low hardware and design overhead. The evaluation conducted on 4-way CMPs shows that the PAE-TIP-managed LLC can improve overall performance by19.3% on average over the LRU policy. Furthermore, the performance benefit of PAE-TIP is 1.09x compared to PIPP, 1.11x compared to TADIP and 1.12x compared to UCP.

Thread ID Based Power Reduction Mechanism for Multi-Thread Shared Set-Associative Caches

Study on the Low Power Cache Design Technique

Low power instruction cache based on adjacent line linking access

TADC: Thread-aware Divide-and-Conquer Policy to Manage Shared Cache

I-Cache Tag Reduction for Low Power Chip Multiprocessor.

Access Adaptive and Thread-Aware Cache Partitioning in Multicore Systems

A Way Memoization Technique for Reducing Power Consumption of Caches in Application Specific Integrated Processors

Augmenting Cache Partitioning With Thread-Aware Insertion/Promotion Policies To Manage Shared Caches

CMP Thread Assignment Based on Group Sharing L2 Cache

THE DESIGN OF A LOW POWER DYNAMICALLY RECONFIGURABLE CACHE

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

Cache Management with Partitioning-Aware Eviction and Thread-Aware Insertion/Promotion Policy

Design of a Low-Power Cache with Partial-Tag Comparison

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

Low-power consumption strategy for instruction cache based on way-access track

PAM: an Efficient Power-Aware Multilevel Cache Policy to Reduce Energy Consumption of Storage Systems

Linking history based low-power instruction cache

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

Integrated I-cache Way Predictor and Branch Target Buffer to Reduce Energy Consumption

Dynamic Cache Reservation to Maximize Efficiency in Shared Cache Multicores