Abstract:As multicore and many-core architectures evolve, their memory systems are becoming increasingly more complex. To bridge the latency and bandwidth gap between the processor and memory, they often use a mix of multilevel private/shared caches that are either blocking or nonblocking and are connected by high-speed network-on-chip. Moreover, they also incorporate hardware and software prefetching and simultaneous multithreading (SMT) to hide memory latency. On such multi- and many-core systems, to incorporate various memory optimization schemes using compiler optimizations and performance tuning techniques, it is crucial to have microarchitectural details of the target memory system. Unfortunately, such details are often unavailable from vendors, especially for newly released processors. In this article, we propose a novel microbenchmarking methodology based on short elapsed-time events (SETEs) to obtain comprehensive memory microarchitectural details in multi- and many-core processors. This approach requires detailed analysis of potential interfering factors that could affect the intended behavior of such memory systems. We lay out effective guidelines to control and mitigate those interfering factors. Taking the impact of SMT into consideration, our proposed methodology not only can measure traditional cache/memory latency and off-chip bandwidth but also can uncover the details of software and hardware prefetching units not attempted in previous studies. Using the newly released Intel Xeon Phi many-core processor (with in-order cores) as an example, we show how we can use a set of microbenchmarks to determine various microarchitectural features of its memory system (many are undocumented from vendors). To demonstrate the portability and validate the correctness of such a methodology, we use the well-documented Intel Sandy Bridge multicore processor (with out-of-order cores) as another example, where most data are available and can be validated. Moreover, to illustrate the usefulness of the measured data, we do a multistage coordinated data prefetching case study on both Xeon Phi and Sandy Bridge and show that by using the measured data, we can achieve 1.3X and 1.08X performance speedup, respectively, compared to the state-of-the-art Intel ICC compiler. We believe that these measurements also provide useful insights into memory optimization, analysis, and modeling of such multicore and many-core architectures.

Swrodinia: A Benchmark Suite for Exploiting Architecture Properties of Sunway Processor

Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

A Swarm-Inspired Resource Distribution for SMT Processors.

swTVM: Towards Optimized Tensor Code Generation for Deep Learning on Sunway Many-Core Processor

Superblock-based performance optimization for Sunway Math Library on SW26010 many-core processor

Building a domain-specific compiler for emerging processors with a reusable approach

Adapting Combined Tiling to Stencil Optimizations on Sunway Processor

Taming the "Monster": Overcoming Program Optimization Challenges on SW26010 Through Precise Performance Modeling

Parallel Image Processing on the Sunway Many-Core Processor

swCUDA: Auto parallel code translation framework from CUDA to ATHREAD for new generation sunway supercomputer

Pipelining Computation and Optimization Strategies for Scaling GROMACS on the Sunway Many-Core Processor.

Measuring Microarchitectural Details of Multi- and Many-Core Memory Systems Through Microbenchmarking

Tuning a General Purpose Software Cache Library for TaihuLight’s SW26010 Processor

Optimizing Astrophysical Simulation Software on Sunway Heterogeneous Manycore Architecture

Enabling High-Performance Physical Based Rendering on New Sunway Supercomputer

Porting and Optimizing OpenFOAM on Sunway TaihuLight System

swATOP: Automatically Optimizing Deep Learning Operators on SW26010 Many-Core Processor

Optimizing Compiler for Shared-Memory Multiple Simd Architecture

O2ATH: an OpenMP Offloading Toolkit for the Sunway Heterogeneous Manycore Platform

Automatic Optimization of Parallel Parameters for Sunway TaihuLight Super-computer Application Program

swMD: Performance Optimizations for Molecular Dynamics Simulation on Sunway Taihulight