Abstract:Datacenter capacity is growing exponentially to satisfy the increasing demand for emerging computationally-intensive applications, such as deep learning. This trend has led to concerns over datacenters' increasing energy consumption and carbon footprint. The basic prerequisite for optimizing a datacenter's energy- and carbon-efficiency is accurately monitoring and attributing energy consumption to specific users and applications. Since datacenter servers tend to be multi-tenant, i.e., they host many applications, server- and rack-level power monitoring alone does not provide insight into their resident applications' energy usage and carbon emissions. At the same time, current application-level energy monitoring and attribution techniques are intrusive: they require privileged access to servers and require coordinated support in hardware and software, which is not always possible in cloud. To address the problem, we design WattScope, a system for non-intrusively estimating the power consumption of individual applications using external measurements of a server's aggregate power usage without requiring direct access to the server's operating system or applications. Our key insight is that, based on an analysis of production traces, the power characteristics of datacenter workloads, e.g., low variability, low magnitude, and high periodicity, are highly amenable to disaggregation of a server's total power consumption into application-specific values. WattScope adapts and extends a machine learning-based technique for disaggregating building power and applies it to server- and rack-level power meter measurements in data centers. We evaluate WattScope's accuracy on a production workload and show that it yields high accuracy, e.g., often <10% normalized mean absolute error, and is thus a potentially useful tool for datacenters in externally monitoring application-level power usage.

Watts-inside: A hardware-software cooperative approach for Multicore Power Debugging

Power Profiling for Low Power Optimization Using New Computing Model

A novel cross-layer framework for early-stage power delivery and architecture co-exploration.

A Hardware-Software Cooperative Approach for Application Energy Profiling

Multi-core Chip Dynamic Power Management Framework Based on Reinforcement Learning br

Endebug: A Hardware–software Framework for Automated Energy Debugging

HW/SW Co-Optimization for Stencil Computation: Beginning with a Customizable Core

Coordinating System Software for Power Savings

COP: A Combinational Optimization Power Budgeting Method for Manycore Systems in Dark Silicon

WattScope: Non-intrusive Application-level Power Disaggregation in Datacenters

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

An Empirical-cum-Statistical Approach to Power-Performance Characterization of Concurrent GPU Kernels

Multi-Optimization Power Management for Chip Multiprocessors

SmartWatts: Self-Calibrating Software-Defined Power Meter for Containers

Data-Driven Power Modeling and Monitoring via Hardware Performance Counters Tracking

Online Power Management for Multi-Cores: A Reinforcement Learning Based Approach

Taming the "Monster": Overcoming Program Optimization Challenges on SW26010 Through Precise Performance Modeling

Prediction models for multi-dimensional power-performance optimization on many cores

Deep Reinforcement Learning-Based Power Management for Chiplet-Based Multicore Systems

Codem Software/Hardware Codesign for Embedded Multicore Systems Supporting Hardware Services

Power Regulation in High Performance Multicore Processors