Abstract:Stencil computation arises from a large variety of scientific and engineering applications and often plays a critical role in the performance of extreme-scale simulations. Due to the memory bound nature, it is a challenging task to optimize stencil computation kernels on many leadership supercomputers, such as Sunway TaihuLight, which has relatively high computing throughput whilst relatively low data-moving capability. In this white paper, we show the efforts we have been making during the past two years in developing end-to-end implementation and optimization techniques for extreme-scale stencil computations on Sunway TaihuLight. We started with a work on optimizing the 3-D 2nd-order 13-point stencil for nonhydrostatic atmospheric dynamics simulation, which is an important part of the 2016 ACM Gordon Bell Prize winning work, and extended it in ways that can handle a broader range of realistic and challenging problems, such as the HPGMG benchmark that consists of memory-hungry stencils and the gaseous wave detonation simulation that relies on complex high-order stencils. The presented stencil computation paradigm on Sunway TaihuLight includes not only multilevel parallelization to exploit the parallelism on different hardware levels, but also systematic performance optimization techniques for communication, memory access, and computation. We show by extreme-scale tests that the proposed systematic stencil computation paradigm can successfully deliver remarkable performance on Sunway TaihuLight with ten million heterogeneous cores. In particular, we achieve an aggregate performance of 23.12 Pflops for the 3-D 5th-order WENO stencil computation in gaseous wave detonation simulation, which is the highest performance result for high-order stencil computations as far as we know, and an aggregate performance of solving over one trillion unknowns per second in the HPGMG benchmark, which ranks the first place in the HPGMG List of Nov 2017.

Optimizing Three-Dimensional Stencil-Operations on Heterogeneous Computing Environments

A parallel computing method for irregular work

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Extreme-Scale Realistic Stencil Computations on Sunway TaihuLight with Ten Million Cores

Dynamic Stencil: Effective Exploitation of Run-Time Resources in Reconfigurable Clusters

Optimization of Lattice Boltzmann Simulations on Heterogeneous Computers

Scaling and analyzing the stencil performance on multi-core and many-core architectures

Evaluating multi-core and many-core architectures through accelerating the three-dimensional Lax-Wendroff correction stencil

Gamify Stencil Dwarf on Cloud for Democratizing Scientific Computing

Computing Nodes In Reconfigurable Clusters Are Occupied And Released By Applications During Their

Large-Scale Heterogeneous Computing for 3D Deterministic Particle Transport on Tianhe-2A Supercomputer

A Portable Framework for Accelerating Stencil Computations on Modern Node Architectures

Architecture Specific Generation of Large Scale Lattice Boltzmann Methods for Sparse Complex Geometries

26 PFLOPS Stencil Computations for Atmospheric Modeling on Sunway TaihuLight.

Evaluation of Programming Models and Performance for Stencil Computation on Current GPU Architectures

Cache-Friendly Design for Complex Spatially-Variable Coefficient Stencils on Many-Core Architectures

Experience Of Parallelizing Cryo-Em 3d Reconstruction On A Cpu-Gpu Heterogeneous System

HW/SW Co-Optimization for Stencil Computation: Beginning with a Customizable Core

GPU Support for Automatic Generation of Finite-Differences Stencil Kernels

Massively Parallel Stencil Strategies for Radiation Transport Moment Model Simulations

Applying the swept rule for solving explicit partial differential equations on heterogeneous computing systems