Abstract:This paper characterizes the memory behavior on emerging RMS (recognition, mining, and synthesis) workloads for future multi-core processors. As multi-core processors proliferate across different application domains, and the number of on-die cores continues to increase, a key issue facing processor architects is the design of the on-die last level cache (LLC). In this paper, we explore the LLC design space for multi-threaded RMS workloads by examining the working set sizes, data sharing behavior, and spatial data locality. Our study reveals that these RMS workloads are memory intensive, have large working-set sizes greater than 16MB on average, exhibit a significant amount of data sharing, about47% on average, and show strong strided streaming access behavior with 77% of accesses in regular pattern. Based on the observations, we then investigate the potential cache architecture choices for future multi-core design. Our experiments show that for these workloads (a) large DRAM caches can be useful to address their large working sets; E.g., a 128MB DRAM cache can reduce the average L1 miss penalty by 18%; (b) shared last level cache provides better cache performance than private cache; E.g., a 8MB shared cache provides 25% performance improvement over a private one with the same total size; and (c) stride based hardware prefetcher provides significant performance benefit by 25%. As a result, we suggest a memory hierarchy with a 128MB DRAM cache, a 8MB on-die SRAM shared cache and an 8-entry stride prefetcher to accommodate RMS workloads.

A Data-sharing Aware and Scalable Cache Miss Rates Model for Multi-core Processors with Multi-level Cache Hierarchies

Analytical Modeling the Multi-Core Shared Cache Behavior with Considerations of Data-Sharing and Coherence

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems

Cache Sharing Management for Performance Fairness in Chip Multiprocessors

Fast Modeling L2 Cache Reuse Distance Histograms Using Combined Locality Information from Software Traces

Bayesian Theory Based Adaptive Proximity Data Accessing For Cmp Caches

Cluster Cache Monitor: Leveraging the Proximity Data in CMP

Cluster Cache Monitor

Cache Hierarchy Optimization

Efficient shared cache management through sharing-aware replacement and streaming-aware insertion policy

L1 Collective Cache: Managing Shared Data for Chip Multiprocessors

Reducing Competitive Cache Misses in Modern Processor Architectures

Understanding the Memory Behavior of Emerging Multi-core Workloads

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors

3D Cache Hierarchy Optimization

PASCMP: A Novel Cache Framework for Data Mining Application

Characterizing the L1 Data Cache's Vulnerability to Transient Errors in Chip-Multiprocessors

Performance Study of Partitioned Caches in Asymmetric Multi-Core Processors

Pace: Penalty Aware Cache Modeling With Enhanced Aet

A 3-Level Cache Miss Model for a Nonvolatile Extension to Transcendent Memory

CSDA: an Adaptive Data Storage Strategy for Predictive Branch Path on Multi-Core Architecture