Abstract:Utilizing analytical models to evaluate proposals or provide guidance in high-level architecture decisions is been becoming more and more attractive. A certain number of methods have emerged regarding cache behaviors and quantified insights in the last decade, such as the stack distance theory and the memory level parallelism (MLP) estimations. However, prior research normally oversimplified the factors that need to be considered in out-of-order processors, such as the effects triggered by reordered memory instructions, and multiple dependences among memory instructions, along with the merged accesses in the same MSHR entry. These ignored influences actually result in low and unstable precisions of recent analytical models. By quantifying the aforementioned effects, this article proposes a cache performance evaluation framework equipped with three analytical models, which can more accurately predict cache misses, MLPs, and the average cache miss service time, respectively. Similar to prior studies, these analytical models are all fed with profiled software characteristics in which case the architecture evaluation process can be accelerated significantly when compared with cycle-accurate simulations. We evaluate the accuracy of proposed models compared with gem5 cycle-accurate simulations with 16 benchmarks chosen from Mobybench Suite 2.0, Mibench 1.0, and Mediabench II. The average root mean square errors for predicting cache misses, MLPs, and the average cache miss service time are around 4%, 5%, and 8%, respectively. Meanwhile, the average error of predicting the stall time due to cache misses by our framework is as low as 8%. The whole cache performance estimation can be sped by about 15 times versus gem5 cycle-accurate simulations and 4 times when compared with recent studies. Furthermore, we have shown and studied the insights between different performance metrics and the reorder buffer sizes by using our models. As an application case of the framework, we also demonstrate how to use our framework combined with McPAT to find out Pareto optimal configurations for cache design space explorations.

3D Cache Hierarchy Optimization

Cache Hierarchy Optimization

Online Cache Modeling for Commodity Multicore Processors

The study of memory architectures for 3D chip multi-processors

Cost-Aware Lifetime Yield Analysis of Heterogeneous 3D On-chip Cache

Energy-efficient Non Uniform Last Level Caches for Chip-multiprocessors Based on Compression

Design of 3D DRAM and Its Application in 3D Integrated Multi-Core Computing Systems

Architecting High-Performance Energy-Efficient Soft Error Resilient Cache under 3D Integration Technology

At the Locus of Performance: Quantifying the Effects of Copious 3D-Stacked Cache on HPC Workloads

A Survey of Memory Architecture for 3d Chip Multi-Processors

Fast Hierarchical Cache Directory: A Scalable Cache Organization for Large-Scale CMP

Optimization method for multi-core last level Cache considering the memory access modes

Performance/Thermal-Aware Design of 3D-Stacked L2 Caches for CMPs

A Data-sharing Aware and Scalable Cache Miss Rates Model for Multi-core Processors with Multi-level Cache Hierarchies

PASCMP: A Novel Cache Framework for Data Mining Application

A Novel Cache Organization for Tiled Chip Multiprocessor

An Analytical Cache Performance Evaluation Framework for Embedded Out-of-Order Processors Using Software Characteristics

CIACP: A Correlation- and Iteration- Aware Cache Partitioning Mechanism to Improve Performance of Multiple Coarse-Grained Reconfigurable Arrays.

Exploration of 3D Stacked L2 Cache Design for High Performance and Efficient Thermal Control

Architecting On-Chip Interconnects for Stacked 3D STT-RAM Caches in CMPs

An Efficient Lightweight Shared Cache Design for Chip Multiprocessors