Abstract:Resource sharing can cause unfair and unpredictable performance of concurrently executing applications in Chip-Multiprocessors (CMP). The shared last-level cache is one of the most important shared resources because off-chip request latency may take a significant part of total execution cycles for data intensive applications. Instead of enforcing performance fairness directly, prior work addressing fairness issue of cache sharing mainly focuses on the fairness metrics of cache miss numbers or miss rates. However, because of the variation of cache miss penalty, fairness on cache miss cannot guarantee performance fairness. Cache sharing management which directly addresses performance fairness is needed for CMP systems. This paper introduces a model to analyze the performance impact of cache sharing, and proposes a mechanism of cache sharing management to provide performance fairness for concurrently executing applications. The proposed mechanism monitors the actual penalty of all cache misses and dynamically estimates the cache misses with dedicated caches when the applications are actually running with a shared cache. The estimated relative slowdown for each core from dedicated environment to shared environment is used to guide cache sharing in order to guarantee performance fairness. The experiment results show that the proposed mechanism always improves the performance fairness metric, and can provide no worse throughput than the scenario without any management mechanism.

A sharing-aware actively pushing cache on CMP

A Sharing-Aware Active Pushing Cache Technology on Chip-Multiprocessor

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

Online Cache Modeling for Commodity Multicore Processors

Enhancing the Performance and Fairness of Shared DRAM Systems with Sharing-Aware Scheduling

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

Cache Sharing Management for Performance Fairness in Chip Multiprocessors

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

CMP Thread Assignment Based on Group Sharing L2 Cache

PASCMP: A Novel Cache Framework for Data Mining Application

PACP: A Prefetch-aware Multi-core Shared Cache Partitioning Strategy

Pseudo share data cache in multiprocessor: PSDMP

Design Scheme of Directory-based Cooperative Cache in CMP

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

Cache Exclusivity and Sharing: Theory and Optimization.

Cache Exclusivity and Sharing

Efficient shared cache management through sharing-aware replacement and streaming-aware insertion policy

Tolerating Memory Latency Using a Hardware-Based Active-Pushing Technique

Management Policies Analysis for Multi-core Shared Caches

Performance Modeling for Helper Thread on Shared Cache Cmps

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor