Abstract:Graphic process units (GPUs) are widely used in scientific computing, because of their high performance and energy efficiency. Nonetheless, GPUs are featured with a hierarchical memory system, on which code optimization requires an in-depth understanding for programmers. For this, we often measure the capability (latency or bandwidth) of the memory system with micro-benchmarks. Prior works focus on the latency of a single thread to disclose the unrevealed information. This per-thread measurement cannot reflect the actual process of a program execution, because the smallest executable unit of parallelism on a GPU comprises 32 threads (a warp of threads). This motivates us to benchmark the GPU memory system at the warp-level. In this paper, we benchmark the GPU memory system to quantify the capability of parallel accessing and broadcasting. Such warp-level measurements are performed on shared memory, constant memory, global memory and texture memory. Further, we discuss how to replace local memory with registers, how to avoid bank conflicts of share memory, and how to maximize global memory bandwidth with alternative data types. By analyzing the experimental results, we summarize the optimization guidelines for different types of memories, and build an optimization framework on GPU memories. Taking a case study of maximum noise fraction rotation in dimension reduction of hyperspectral images, we demonstrate that our framework is applicable and effective. Our work discloses the characteristics of GPU memories at the warp-level, and leads to optimization guidelines. The warp-level benchmarking results can facilitate the process of designing parallel algorithms, modeling and optimizing GPU programs. To the best of our knowledge, this is the first benchmarking effort at the warp-level for the GPU memory system. (C) 2017 Elsevier B.V. All rights reserved.

Research on Memory Hierarchy and Load Balance Strategy in Heterogeneous System Based on GPU

Performance Optimization Strategies of High Performance Computing on GPU

A Memory Scheduling Strategy for Eliminating Memory Access Interference in Heterogeneous System

An Experimental GPU Global Memory Performance Estimation and Optimization

A perceptual and predictive batch-processing memory scheduling strategy for a CPU-GPU heterogeneous system

Dynamic Memory Management in Massively Parallel Systems: A Case on GPUs

Study on Optimization Techniques for Memory Accesses of CUDA Parallel Programs

Thread Batching for High-performance Energy-efficient GPU Memory Design

Dynamic Buffer Management in Massively Parallel Systems: A Case on GPUs

Data Partitioning Strategy of GPU Heterogeneous Clusters Based on Learning

Orchestrating Cache Management and Memory Scheduling for GPGPU Applications.

A Locality-Aware Memory Hierarchy for Energy-Efficient GPU Architectures

Optimizing Non-Coalesced Memory Access for Irregular Applications with GPU Computing

Performance Optimization for CPU-GPU Heterogeneous Parallel System

Communication and Memory Access Latency Characteristics of CPU/GPU Heterogeneous Cluster

GPU Memory Optimization Through Program Restructuring Methods

Performance Evaluation and Optimization on Gpu

Benchmarking the GPU Memory at the Warp Level

A Survey of GPGPU Parallel Processing Architecture Performance Optimization

Design of load balancing algorithm for CPU and GPU collaborative computing based on C4.5 decision tree.

Exploration on Task Scheduling Strategy for CPU-GPU Heterogeneous Computing System