Abstract:Modern computing paradigms, such as cloud computing, are increasingly adopting GPUs to boost their computing capabilities primarily due to the heterogeneous nature of AI/ML/deep learning workloads. However, the energy consumption of GPUs is a critical problem. Dynamic Voltage Frequency Scaling (DVFS) is a widely used technique to reduce the dynamic power of GPUs. Yet, configuring the optimal clock frequency for essential performance requirements is a non-trivial task due to the complex nonlinear relationship between the application's runtime performance characteristics, energy, and execution time. It becomes more challenging when different applications behave distinctively with similar clock settings. Simple analytical solutions and standard GPU frequency scaling heuristics fail to capture these intricacies and scale the frequencies appropriately. In this regard, we propose a data-driven frequency scaling technique by predicting the power and execution time of a given application over different clock settings. We collect the data from application profiling and train the models to predict the outcome accurately. The proposed solution is generic and can be easily extended to different kinds of workloads and GPU architectures. Furthermore, using this frequency scaling by prediction models, we present a deadline-aware application scheduling algorithm to reduce energy consumption while simultaneously meeting their deadlines. We conduct real extensive experiments on NVIDIA GPUs using several benchmark applications. The experiment results have shown that our prediction models have high accuracy with the average RMSE values of 0.38 and 0.05 for energy and time prediction, respectively. Also, the scheduling algorithm consumes 15.07% less energy as compared to the baseline policies.

FCM: Towards Fine-Grained GPU Power Management for Closed Source Mobile Games.

Texture-Directed Mobile GPU Power Management for Closed-Source Games.

Multi-core Chip Dynamic Power Management Framework Based on Reinforcement Learning br

An Efficient and Flexible Learning Framework for Dynamic Power and Thermal Co-Management

Behavior-Aware Integrated CPU-GPU Power Management for Mobile Games.

A user-centric CPU-GPU governing framework for 3D games on mobile devices

A DVFS Design and Simulation Framework Using Machine Learning Models

On-the-Fly Power-Aware Rendering

Optimizing Power Consumption of Mobile Games.

Mobile GPU Power Consumption Reduction Via Dynamic Resolution and Frame Rate Scaling.

A survey and measurement study of GPU DVFS on energy conservation

Real-time Rendering on a Power Budget.

DSO: A GPU Energy Efficiency Optimizer by Fusing Dynamic and Static Information

A Data-Driven Frequency Scaling Approach for Deadline-aware Energy Efficient Scheduling on Graphics Processing Units (GPUs)

Energy Management on DVS Based Coarse-Grained Reconfigurable Platform.

RAVEN: Perception-aware Optimization of Power Consumption for Mobile Games.

Towards Accurate GPU Power Modeling for Smartphones

PowerNet: Learning-Based Real-Time Power-Budget Rendering

A Cloud-Edge Collaborative Gaming Framework Using AI-Powered Foveated Rendering and Super Resolution

Energy Efficient Real-Time Task Scheduling on CPU-GPU Hybrid Clusters

Automated PMC-based Power Modeling Methodology for Modern Mobile GPUs