Abstract:Graphic process units (GPUs) are widely used in scientific computing, because of their high performance and energy efficiency. Nonetheless, GPUs are featured with a hierarchical memory system, on which code optimization requires an in-depth understanding for programmers. For this, we often measure the capability (latency or bandwidth) of the memory system with micro-benchmarks. Prior works focus on the latency of a single thread to disclose the unrevealed information. This per-thread measurement cannot reflect the actual process of a program execution, because the smallest executable unit of parallelism on a GPU comprises 32 threads (a warp of threads). This motivates us to benchmark the GPU memory system at the warp-level. In this paper, we benchmark the GPU memory system to quantify the capability of parallel accessing and broadcasting. Such warp-level measurements are performed on shared memory, constant memory, global memory and texture memory. Further, we discuss how to replace local memory with registers, how to avoid bank conflicts of share memory, and how to maximize global memory bandwidth with alternative data types. By analyzing the experimental results, we summarize the optimization guidelines for different types of memories, and build an optimization framework on GPU memories. Taking a case study of maximum noise fraction rotation in dimension reduction of hyperspectral images, we demonstrate that our framework is applicable and effective. Our work discloses the characteristics of GPU memories at the warp-level, and leads to optimization guidelines. The warp-level benchmarking results can facilitate the process of designing parallel algorithms, modeling and optimizing GPU programs. To the best of our knowledge, this is the first benchmarking effort at the warp-level for the GPU memory system. (C) 2017 Elsevier B.V. All rights reserved.

A Case Study of SWIM: Optimization of Memory Intensive Application on GPGPU

An Experimental GPU Global Memory Performance Estimation and Optimization

Program Optimization of Stencil Based Application on the GPU-Accelerated System

GPGPU Memory Estimation and Optimization Targeting OpenCL Architecture

The optimization of parallel Smith-Waterman sequence alignment using on-chip memory of GPGPU

A Survey of GPGPU Parallel Processing Architecture Performance Optimization

Performance Evaluation and Optimization on Gpu

Study on Optimization Techniques for Memory Accesses of CUDA Parallel Programs

Orchestrating Cache Management and Memory Scheduling for GPGPU Applications.

Optimizing Non-Coalesced Memory Access for Irregular Applications with GPU Computing

Performance Optimization Strategies of High Performance Computing on GPU

A Polyhedral Modeling Based Source-to-Source Code Optimization Framework for GPGPU

Exploiting Memory Access Patterns to Improve Memory Performance in Data-Parallel Architectures

HW/SW Co-Optimization for Stencil Computation: Beginning with a Customizable Core

Optimizing stencil application on multi-thread GPU architecture using stream programming model

Optimization and Implementation of LBM Benchmark on Multithreaded GPU

Generalized Gpu Acceleration For Applications Employing Finite-Volume Methods

Adaptive Cache Management for Energy-Efficient GPU Computing.

Benchmarking the GPU Memory at the Warp Level

Performance Optimization of the HPCG Benchmark on the Sunway TaihuLight Supercomputer.

A Hierarchical Grid Algorithm for Accelerating High-Performance Conjugate Gradient Benchmark on Sunway Many-Core Processor