Abstract:As multicore and many-core architectures evolve, their memory systems are becoming increasingly more complex. To bridge the latency and bandwidth gap between the processor and memory, they often use a mix of multilevel private/shared caches that are either blocking or nonblocking and are connected by high-speed network-on-chip. Moreover, they also incorporate hardware and software prefetching and simultaneous multithreading (SMT) to hide memory latency. On such multi- and many-core systems, to incorporate various memory optimization schemes using compiler optimizations and performance tuning techniques, it is crucial to have microarchitectural details of the target memory system. Unfortunately, such details are often unavailable from vendors, especially for newly released processors. In this article, we propose a novel microbenchmarking methodology based on short elapsed-time events (SETEs) to obtain comprehensive memory microarchitectural details in multi- and many-core processors. This approach requires detailed analysis of potential interfering factors that could affect the intended behavior of such memory systems. We lay out effective guidelines to control and mitigate those interfering factors. Taking the impact of SMT into consideration, our proposed methodology not only can measure traditional cache/memory latency and off-chip bandwidth but also can uncover the details of software and hardware prefetching units not attempted in previous studies. Using the newly released Intel Xeon Phi many-core processor (with in-order cores) as an example, we show how we can use a set of microbenchmarks to determine various microarchitectural features of its memory system (many are undocumented from vendors). To demonstrate the portability and validate the correctness of such a methodology, we use the well-documented Intel Sandy Bridge multicore processor (with out-of-order cores) as another example, where most data are available and can be validated. Moreover, to illustrate the usefulness of the measured data, we do a multistage coordinated data prefetching case study on both Xeon Phi and Sandy Bridge and show that by using the measured data, we can achieve 1.3X and 1.08X performance speedup, respectively, compared to the state-of-the-art Intel ICC compiler. We believe that these measurements also provide useful insights into memory optimization, analysis, and modeling of such multicore and many-core architectures.

Microprocessor architecture-level "Y-behavior" research for branch instructions

A Low-power Design for gshare Branch Predictor

Research on Branch Characteristic and Branch Predictor Performance

Modeling, Derivation, and Automated Analysis of Branch Predictor Security Vulnerabilities

MBAPIS: Multi-Level Behavior Analysis Guided Program Interval Selection for Microarchitecture Studies

A New Architecture for Branch-Intensive Loops

Variable Instruction Fetch Rate to Reduce Control Dependent Penalties

A Hardware Security Protection Method for Conditional Branches of Embedded Systems

Convergence path instruction-level reuse high performance optimization mechanism

A VLIW Architecture for Optimal Execution of Branch-Intensive Loops

Modeling the Propagation of Soft Errors in Programs

Branch Prediction for Network Processors

Microarchitecture Parameter Selection to Optimize System Performance under Process Variation

Performance Characterization of SPEC CPU2006 Benchmarks on Intel and AMD Platform

DYNAMEM — A Microarchitecture for Improving Memory Disambiguation at Run-Time

Measuring Microarchitectural Details of Multi- and Many-Core Memory Systems Through Microbenchmarking

Realization of Branch Prediction and Value Prediction in VLIW

Characterizing the Effects of Intermittent Faults on a Processor for Dependability Enhancement Strategy

A Theoretical Research on Program Instruction Level Parallelism to Guide Microprocessor Design

Exploring Predictable Redundant Instruction Parallelism in Fault Tolerant Microprocessors

Memory Performance Characterization Of Spec Cpu2006 Benchmarks Using Tsim1