Abstract:Modern graphics processing units (GPUs) are delivering tremendous computing horsepower by running tens of thousands of threads concurrently. The massively parallel execution model has been effective to hide the long latency of off-chip memory accesses in graphics and other general computing applications exhibiting regular memory behaviors. With the fast-growing demand for general purpose computing on GPUs (GPGPU), GPU workloads are becoming highly diversified, and thus requiring a synergistic coordination of both computing and memory resources to unleash the computing power of GPUs. Accordingly, recent graphics processors begin to integrate an on-die level-2 (L2) cache. The huge number of threads on GPUs, however, poses significant challenges to L2 cache design. The experiments on a variety of GPGPU applications reveal that the L2 cache may or may not improve the overall performance depending on the characteristics of applications. In this paper, we propose efficient techniques to improve GPGPU performance by orchestrating both L2 cache and memory in a unified framework. The basic philosophy is to exploit the temporal locality among the massive number of concurrent memory requests and minimize the impact of memory divergence behaviors among simultaneously executed groups of threads. Our major contributions are twofold. First, a priority-based cache management is proposed to maximize the chance of frequently revisited data to be kept in the cache. Second, an effective memory scheduling is introduced to reorder memory requests in the memory controller according to the divergence behavior for reducing average waiting time of warps. Simulation results reveal that our techniques enhance the overall performance by 10% on average for memory intensive benchmarks, whereas the maximum gain can be up to 30%.

Program Optimization of Stencil Based Application on the GPU-Accelerated System

Optimizing stencil application on multi-thread GPU architecture using stream programming model

Accelerating Stencil Computation on GPGPU by Novel Mapping Method Between the Global Memory and the Shared Memory.

A New Memory Mapping Mechanism for GPGPUs’ Stencil Computation

Adapting Combined Tiling to Stencil Optimizations on Sunway Processor

Modeling the Performance of 2.5D Blocking of 3D Stencil Code on GPUs

Optimizing Stencil Computation on Multi-core DSPs

Toward Accelerated Stencil Computation by Adapting Tensor Core Unit on GPU

Performance Optimization Of A Dem Simulation Framework On Gpu Using A Stencil Model

Scaling and analyzing the stencil performance on multi-core and many-core architectures

Research on Optimization of Heterogeneous Stencil Computing Based on CPU and GPU

GPU Memory Optimization Through Program Restructuring Methods

GPGPU Memory Estimation and Optimization Targeting OpenCL Architecture

StencilMART: Predicting Optimization Selection for Stencil Computations Across GPUs

Exploiting Scratchpad Memory for Deep Temporal Blocking: A case study for 2D Jacobian 5-point iterative stencil kernel (j2d5pt)

High-performance code generation for stencil computations on GPU architectures

A Case Study of SWIM: Optimization of Memory Intensive Application on GPGPU

Orchestrating Cache Management and Memory Scheduling for GPGPU Applications.

An Analytical GPU Performance Model for 3D Stencil Computations from the Angle of Data Traffic

DRStencil: Exploiting Data Reuse Within Low-order Stencil on GPU

HW/SW Co-Optimization for Stencil Computation: Beginning with a Customizable Core