Abstract:Modern chip-level multiprocessors (CMPs) contain multiple processor cores sharing a common last-level cache, memory interconnects, and other hardware resources. Workloads running on separate cores compete for these resources, often resulting in highly-variable performance. To improve fairness and performance, it is helpful to co-schedule workloads having minimal cache and other forms of resource contention. In this work, we develop several cache modeling techniques to help make informed resource management decisions.Using only commonly-available performance counters on existing processors, we introduce an efficient online technique for estimating the cache occupancies of software threads. We derive an analytical model that considers the impact of set-associativity, line replacement policy, and memory locality effects. We demonstrate the effectiveness of occupancy estimation with a series of CMP simulations using SPEC benchmarks. Our occupancy estimation technique is currently being used to develop online utility functions, such as miss-ratio curves (MRCs), which capture performance impacts as a function of resource usage. We are leveraging both online cache occupancy estimation and MRC construction in our ongoing studies of cache-aware scheduling.

Cache Miss Reduction Through Hardware-Assisted Loop Optimization

Optimization method for multi-core last level Cache considering the memory access modes

Mutual Effect of Instruction Layout Optimization and Instruction Memory Hierarchy

Instruction High-speed Cache Optimization Techniques Based on Statistic Analysis

Power reduction through specific instruction scheduling based on hardware/software Co-design

Low power instruction cache based on adjacent line linking access

Online Cache Modeling for Commodity Multicore Processors

Global Data Access Optimization Via Load/Store Instruction Extension

Loop acceleration and instruction repeat support for application specific instruction-set processors

Reducing Power with an L0 Instruction Cache Using History-Based Prediction

I-Cache Tag Reduction for Low Power Chip Multiprocessor.

Design of L2 CACHE Replacement Arithmetic for Chip Multiprocessor Architecture

A memory bandwidth effective cache store miss policy

Cache Behavior Analysis of a Compiler-Assisted Cache Replacement Policy

A Technique to Exploit Memory Locality for Fast Instruction Set Simulation

An Adaptive and Selective Instruction Active Push Mechanism for Multi-core Architecture

Shared L1 instruction cache for many-core processors

Tolerating Memory Latency Using a Hardware-Based Active-Pushing Technique

Reducing Competitive Cache Misses in Modern Processor Architectures

Reconfigurable cache for real-time MPSoCs: Scheduling and implementation