Abstract:High-level functional programming abstractions have started to show promising results for HPC (High-Performance Computing). Approaches such as Lift, Futhark or Delite have shown that it is possible to have both, high-level abstractions and performance, even for HPC workloads such as stencils. In addition, these high-level functional abstractions can also be used to represent programs and their optimized variants, within the compiler itself. However, such high-level approaches rely heavily on the compiler to optimize programs which is notoriously hard when targeting GPUs. Compilers either use hand-crafted heuristics to direct the optimizations or iterative compilation to search the optimization space. The first approach has fast compile times, however, it is not performance-portable across different devices and requires a lot of human effort to build the heuristics. Iterative compilation, on the other hand, has the ability to search the optimization space automatically and adapts to different devices. However, this process is often very time-consuming as thousands of variants have to be evaluated. Performance models based on statistical techniques have been proposed to speedup the optimization space exploration. However, they rely on low-level hardware features, in the form of performance counters or low-level static code features. Using the Lift framework, this paper demonstrates how low-level, GPU-specific features are extractable directly from a high-level functional representation. The Lift IR (Intermediate Representation) is in fact a very suitable choice since all optimization choices are exposed at the IR level. This paper shows how to extract low-level features such as number of unique cache lines accessed per warp, which is crucial for building accurate GPU performance models. Using this approach, we are able to speedup the exploration of the space by a factor 2000x on an AMD GPU and 450x on Nvidia on average across many stencil applications.

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Scaling and analyzing the stencil performance on multi-core and many-core architectures

Optimizing Stencil Computation on Multi-core DSPs

Evaluation of Programming Models and Performance for Stencil Computation on Current GPU Architectures

Performance Tuning and Analysis for Stencil-Based Applications on POWER8 Processor.

Research on Optimization of Heterogeneous Stencil Computing Based on CPU and GPU

A Portable Framework for Accelerating Stencil Computations on Modern Node Architectures

DRStencil: Exploiting Data Reuse Within Low-order Stencil on GPU

HW/SW Co-Optimization for Stencil Computation: Beginning with a Customizable Core

High-performance code generation for stencil computations on GPU architectures

Casper: Accelerating Stencil Computation using Near-cache Processing

High-level Hardware Feature Extraction for GPU Performance Prediction of Stencils

Program Optimization of Stencil Based Application on the GPU-Accelerated System

Optimizing Three-Dimensional Stencil-Operations on Heterogeneous Computing Environments

Performance Modeling of Stencil Computation on SW26010 Processors

Extreme-Scale Realistic Stencil Computations on Sunway TaihuLight with Ten Million Cores

Cstuner: Scalable Auto-tuning Framework for Complex Stencil Computation on GPUs

Fast: A Fast Stencil Autotuning Framework Based On An Optimal-Solution Space Model

Toward Accelerated Stencil Computation by Adapting Tensor Core Unit on GPU

Mapping Stencils on Coarse-grained Reconfigurable Spatial Architecture

StencilMART: Predicting Optimization Selection for Stencil Computations Across GPUs