Abstract:Nowadays, the prominent computing horse power of graphics processing units (GPUs) grants them dramatically higher performance than their CPU counterpart. As a result, GPUs are pervasively utilized to accelerate a wide variety of scientific applications. This trend has been promoted with the recent advancements in programming paradigms such as CUDA, which greatly simplify the way to exploit the tremendous computation capacity of GPUs for general purpose applications. Meanwhile, due to significant power consumption of GPUs, it is important to take the factor of energy efficiency into consideration when designing GPU applications. However, comprehensive understanding of how programming affects the power consumption of GPU applications is missing and how to optimize GPU applications to achieve higher energy efficiency still remains a challenge. Although it is indispensable to acquire the ability to measure GPU power consumption accurately before further investigating the energy issues, existing approaches for GPU power measurement are quite deficient. Since the current GPUs are not equipped with internal power sensors, the GPU power is either observed from a separate power meter or deduced from the probed voltage and current on the GPUs. Such approaches require additional hardware devices and are not practical solutions. Whereas, software approaches to estimate the power consumption are still in the early stages, which could not provide accurate power prediction for GPU applications due to its coarse granularity. Moreover, the existing approaches primarily rely on performance profiling and cannot provide any insight on energy facet from programming perspective. CUDA, proposed by NVIDIA, is a widely accepted programming paradigm for general purpose computing in both academy and industry. Thus it would be effective to understand the power consumption of GPUs in terms of CUDA program. Especially, how CUDA program impacts the GPU power consumption from the way it is designed and implemented. However, in order

Performance and Power Comparisons between NVIDIA and ATI GPUS

Architecture Comparisons Between Nvidia and Ati Gpus: Computation Parallelism and Data Communications

Performance and Power Analysis of ATI GPU: A Statistical Approach

Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect

An adaptive GPU performance and power model

Statistical GPU Power Analysis Using Tree-Based Methods.

High Performance Computing Via a GPU

Performance Optimization Strategies of High Performance Computing on GPU

Tree structured analysis on GPU power study

Performance Evaluation and Optimization on Gpu

Evaluating the Potential of Graphics Processors for High Performance Embedded Computing

Energy Cost Evaluation of Parallel Algorithms for Multiprocessor Systems

An Implementation of Analytical Power Model on Integrated GPU

GPUWattch

Power Modeling Approach for GPU Source Program

High Performance Matrix Multiplication on General Purpose Graphics Processing Units

An Experimental GPU Global Memory Performance Estimation and Optimization

Benchmarking the Nvidia GPU Lineage: From Early K80 to Modern A100 with Asynchronous Memory Transfers

Programming-Level Power Measurement for GPU Clusters

GPGPU Memory Estimation and Optimization Targeting OpenCL Architecture

An Instruction Level GPU Power Modeling Method