Abstract:Modern Graphic Processing Units (GPUs) provide sufficiently flexible programming models that understanding their performance can provide insight in designing tomorrow's manycore processors, whether those are GPUs or other-wise. The combination of multiple, multithreaded, SIMD cores makes studying these GPUs useful in understanding tradeoffs among memory, data, and thread level parallelism. While modern GPUs offer orders of magnitude more raw computing power than contemporary CPUs, many important ap-plications, even those with abundant data level parallelism, do not achieve peak performance. This paper characterizes several non-graphics applications written in NVIDIA's CUDA programming model by running them on a novel detailed microarchitecture performance simulator that runs NVIDIA's parallel thread execution (PTX) virtual instruction set. For this study, we selected twelve non-trivial CUDA applications demonstrating varying levels of performance improvement on GPU hardware (versus a CPU-only sequential version of the application). We study the performance of these applications on our GPU performance simulator with configurations comparable to contemporary high-end graphics cards. We characterize the performance impact of several microarchitecture design choices including choice of interconnect topology, use of caches, design of memory controller, parallel workload distribution mechanisms, and memory request coalescing hardware. Two observations we make are (1) that for the applications we study, performance is more sensitive to interconnect bisection bandwidth rather than latency, and (2) that, for some applications, running fewer threads concurrently than on-chip resources might otherwise allow can improve performance by reducing contention in the memory system.

Tools for top-down performance analysis of GPU-accelerated applications

A tool for top-down performance analysis of GPU-accelerated applications

Tools for GPU Computing - Debugging and Performance Analysis of Heterogenous HPC Applications

Workload Analysis for Typical GPU Programs Using CUPTI Interface

Research On Performance Tool In Hpc And Grid Computing

Web-Oriented Visual Performance Analysis Tool for Hpc: Thptiii

Application of performance portability solutions for GPUs and many-core CPUs to track reconstruction kernels

Performance Analysis and Optimization of a Hybrid Distributed Reverse Time Migration Application

Data-Driven Analysis to Understand GPU Hardware Resource Usage of Optimizations

APMT: an Automatic Hardware Counter-Based Performance Modeling Tool for HPC Applications

Programming-Level Power Measurement for GPU Clusters

KLARAPTOR: A Tool for Dynamically Finding Optimal Kernel Launch Parameters Targeting CUDA Programs

Parallel Application Performance Prediction Using Analysis Based Models and HPC Simulations

Analyzing CUDA workloads using a detailed GPU simulator

DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns

High Performance Computing Via a GPU

Providing performance portable numerics for Intel GPUs

Dwarfs on Accelerators: Enhancing OpenCL Benchmarking for Heterogeneous Computing Architectures

Automated Programmatic Performance Analysis of Parallel Programs

Daisen: A Framework for Visualizing Detailed GPU Execution

Performance modeling of graphics processing unit application using static and dynamic analysis