Abstract:Datacenter capacity is growing exponentially to satisfy the increasing demand for emerging computationally-intensive applications, such as deep learning. This trend has led to concerns over datacenters' increasing energy consumption and carbon footprint. The basic prerequisite for optimizing a datacenter's energy- and carbon-efficiency is accurately monitoring and attributing energy consumption to specific users and applications. Since datacenter servers tend to be multi-tenant, i.e., they host many applications, server- and rack-level power monitoring alone does not provide insight into their resident applications' energy usage and carbon emissions. At the same time, current application-level energy monitoring and attribution techniques are intrusive: they require privileged access to servers and require coordinated support in hardware and software, which is not always possible in cloud. To address the problem, we design WattScope, a system for non-intrusively estimating the power consumption of individual applications using external measurements of a server's aggregate power usage without requiring direct access to the server's operating system or applications. Our key insight is that, based on an analysis of production traces, the power characteristics of datacenter workloads, e.g., low variability, low magnitude, and high periodicity, are highly amenable to disaggregation of a server's total power consumption into application-specific values. WattScope adapts and extends a machine learning-based technique for disaggregating building power and applies it to server- and rack-level power meter measurements in data centers. We evaluate WattScope's accuracy on a production workload and show that it yields high accuracy, e.g., often <10% normalized mean absolute error, and is thus a potentially useful tool for datacenters in externally monitoring application-level power usage.

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

Profiling and Modeling of Power Characteristics of Leadership-Scale HPC System Workloads

Power Profiling for Low Power Optimization Using New Computing Model

Modeling and Predicting Power Consumption of High Performance Computing Jobs

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

Power Consumption Modeling and Prediction in a Hybrid CPU-GPU-MIC Supercomputer (preliminary version)

Predicting System-level Power for a Hybrid Supercomputer

Exploring the Frontiers of Energy Efficiency using Power Management at System Scale

A Two-Level Parallel Decomposition Approach for Transient Stability Constrained Optimal Power Flow

Multi-node Power/Performance Modeling for HPC System

ytopt: Autotuning Scientific Applications for Energy Efficiency at Large Scales

Applications Classification and Scheduling on Heterogeneous HPC Systems Using Experimental Research.

Full Lifecycle Data Analysis on a Large-scale and Leadership Supercomputer: What Can We Learn from It?

Prediction of job characteristics for intelligent resource allocation in HPC systems: a survey and future directions

A Comprehensive Analysis of Process Energy Consumption on Multi-Socket Systems with GPUs

Power Modeling for Effective Datacenter Planning and Compute Management

Run your HPC jobs in Eco-Mode: revealing the potential of user-assisted power capping in supercomputing systems

Analyzing Resource Utilization in an HPC System: A Case Study of NERSC Perlmutter

WattScope: Non-intrusive Application-level Power Disaggregation in Datacenters

Optimization of hybrid parallel application execution in heterogeneous high performance computing systems considering execution time and power consumption

Sustaining Performance While Reducing Energy Consumption: A Control Theory Approach