Abstract:Utilizing analytical models to evaluate proposals or provide guidance in high-level architecture decisions is been becoming more and more attractive. A certain number of methods have emerged regarding cache behaviors and quantified insights in the last decade, such as the stack distance theory and the memory level parallelism (MLP) estimations. However, prior research normally oversimplified the factors that need to be considered in out-of-order processors, such as the effects triggered by reordered memory instructions, and multiple dependences among memory instructions, along with the merged accesses in the same MSHR entry. These ignored influences actually result in low and unstable precisions of recent analytical models. By quantifying the aforementioned effects, this article proposes a cache performance evaluation framework equipped with three analytical models, which can more accurately predict cache misses, MLPs, and the average cache miss service time, respectively. Similar to prior studies, these analytical models are all fed with profiled software characteristics in which case the architecture evaluation process can be accelerated significantly when compared with cycle-accurate simulations. We evaluate the accuracy of proposed models compared with gem5 cycle-accurate simulations with 16 benchmarks chosen from Mobybench Suite 2.0, Mibench 1.0, and Mediabench II. The average root mean square errors for predicting cache misses, MLPs, and the average cache miss service time are around 4%, 5%, and 8%, respectively. Meanwhile, the average error of predicting the stall time due to cache misses by our framework is as low as 8%. The whole cache performance estimation can be sped by about 15 times versus gem5 cycle-accurate simulations and 4 times when compared with recent studies. Furthermore, we have shown and studied the insights between different performance metrics and the reorder buffer sizes by using our models. As an application case of the framework, we also demonstrate how to use our framework combined with McPAT to find out Pareto optimal configurations for cache design space explorations.

Performance Estimation Techniques with MPSoC Transaction-Accurate Models

SoC performance modeling methodology and implementation basedon transaction dataflow

Profiling and annotation combined method for multimedia application specific MPSoC performance estimation

Online Cache Modeling for Commodity Multicore Processors

An Analytical Cache Performance Evaluation Framework for Embedded Out-of-Order Processors Using Software Characteristics

PMCC: Fast and Accurate System-Level Power Modeling for Processors on Heterogeneous SoC

Performance estimation of program partitions on multi-core platforms

Performance Optimization of Application Algorithms for Heterogeneous Multi-Processor System-on-Chips

Efficient Mart-Aided Modeling for Microarchitecture Design Space Exploration and Performance Prediction

Coarse-Grain Performance Estimator for Heterogeneous Parallel Computing Architectures like Zynq All-Programmable SoC

An Experimental Approach of Modeling the Memory Level Parallelism

A Mechanistic Model of Memory Level Parallelism Fed with Cache Miss Rates.

Providing Predictable Performance Via a Slowdown Estimation Model

AFEC: An analytical framework for evaluating cache performance in out-of-order processors.

Accelerating the Analytical Modeling of Memory Level Parallelism by the Probability Analysis

Dynamic Power Estimation with Hardware Performance Counters Support on Multi-core Platform

Cache Performance Research for Embedded Processors

Counters Based Performance Analysis and Optimization of an Out-of-order Superscalar Processor Core

An Efficient Power Estimation Approach for the Synchronous Data Transfer Architecture

Performance Evaluation of Multicore Systems: from Traffic Analysis to Latency Predictions (embedded Tutorial)

Evaluating the Memory System Performance of Software-Initiated Inter-core LLC Prepushing