Abstract:As the energy consumption has been surging in an unsustainable way, it is important to understand the impact of existing architecture designs from energy efficiency perspective, which is especially valuable for High Performance Computing (HPC) and datacenter environment hosting tens of thousands of servers. One obstacle hindering the advance of comprehensive evaluation on energy efficiency is the deficient power measuring approach. Most of the energy study relies on either external power meters or power models, both of these two methods contain intrinsic drawbacks in their practical adoption and measuring accuracy. Fortunately, the advent of Intel Running Average Power Limit (RAPL) interfaces has promoted the power measurement ability into next level, with higher accuracy and finer time resolution. Therefore, we argue it is the exact time to conduct an in-depth evaluation of the existing architecture designs to understand their impact on system energy efficiency. In this paper, we leverage representative benchmark suites including serial and parallel workloads from diverse domains to evaluate the architecture features such as Non Uniform Memory Access (NUMA), Simultaneous Multithreading (SMT) and Turbo Boost. The energy is tracked at subcomponent level such as Central Processing Unit (CPU) cores, uncore components and Dynamic Random-Access Memory (DRAM) through exploiting the power measurement ability exposed by RAPL. The experiments reveal non-intuitive results: 1) the mismatch between local compute and remote memory node caused by NUMA effect not only generates dramatic power and energy surge but also deteriorates the energy efficiency significantly; 2) for multithreaded application such as the Princeton Application Repository for Shared-Memory Computers (PARSEC), most of the workloads benefit a notable increase of energy efficiency using SMT, with more than 40% decline in average power consumption; 3) Turbo Boost is effective to accelerate the workload execution and further preserve the energy, however it may not be applicable on system with tight power budget.

Calibrating DRAMPower Model: A Runtime Perspective from Real-System HPC Measurements

What Your DRAM Power Models Are Not Telling You: Lessons from a Detailed Experimental Study

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

A Power and Temperature Aware DRAM Architecture

A Trace-Driven Analytical Model with Less Profiling Overhead for DRAM Access Latencies

Integrating DRAM Power-Down Modes in gem5 and Quantifying their Impact

Data-Driven Power Modeling and Monitoring via Hardware Performance Counters Tracking

HighRPM: Combining Integrated Measurement and Sofware Power Modeling for High-Resolution Power Monitoring.

System-Level Early Power Estimation for Memory Subsystem in Embedded Systems

A Calibratable Model for Fast Energy Estimation of MVM Operations on RRAM Crossbars

Evaluating Architecture Impact on System Energy Efficiency.

Synergy of Dynamic Frequency Scaling and Demotion on DRAM Power Management: Models and Optimizations

Understanding the Interactions of Workloads and DRAM Types: A Comprehensive Experimental Study

A Holistic Energy-Efficient Approach for a Processor-Memory System

PMCC: Fast and Accurate System-Level Power Modeling for Processors on Heterogeneous SoC

A Novel Power Estimation Framework for SRAM-based FPGAs

An Energy Consumption Model for SRAM-Based In-Memory-Computing Architectures

Architecture-level energy model for high-capacity STT-MRAM memory

Improving DRAM Performance, Security, and Reliability by Understanding and Exploiting DRAM Timing Parameter Margins

Dynamic Power Estimation with Hardware Performance Counters Support on Multi-core Platform

Study of Performance Evaluation of Embedded DRAM for System-on-a-Chip