Abstract:Partial differential equation (PDE) solvers are extensively utilized across numerous scientific and engineering fields. However, achieving high performance and scalability often necessitates intricate and low-level programming, particularly when leveraging deterministic sparsity patterns in structured grids. In this paper, we propose an innovative domain-specific language (DSL), Mat2Stencil, with its compiler, for PDE solvers on structured grids. Mat2Stencil introduces a structured sparse matrix abstraction, facilitating modular, flexible, and easy-to-use expression of solvers across a broad spectrum, encompassing components such as Jacobi or Gauss-Seidel preconditioners, incomplete LU or Cholesky decompositions, and multigrid methods built upon them. Our DSL compiler subsequently generates matrix-free code consisting of generalized stencils through multi-stage programming. The code allows spatial loop-carried dependence in the form of quasi-affine loops, in addition to the Jacobi-style stencil's embarrassingly parallel on spatial dimensions. We further propose a novel automatic parallelization technique for the spatially dependent loops, which offers a compile-time deterministic task partitioning for threading, calculates necessary inter-thread synchronization automatically, and generates an efficient multi-threaded implementation with fine-grained synchronization. Implementing 4 benchmarking programs, 3 of them being the pseudo-applications in NAS Parallel Benchmarks with $6.3\%$ lines of code and 1 being matrix-free High Performance Conjugate Gradients with $16.4\%$ lines of code, we achieve up to $1.67\times$ and on average $1.03\times$ performance compared to manual implementations.

An Arbitrary N-dimensional Stencil Transformer in Cilk + + ∗

TurboStencil: You Only Compute Once for Stencil Computation.

Improving Parallelism of Recursive Stencil Computations without Sacrificing Cache Performance

Mapping Stencils on Coarse-grained Reconfigurable Spatial Architecture

The Pochoir Stencil Compiler

Cache-Friendly Design for Complex Spatially-Variable Coefficient Stencils on Many-Core Architectures

Optimizing Stencil Code Via Locality Of Computation

Temporal Vectorization for Stencils

DHTS: A Dynamic Hybrid Tiling Strategy for Optimizing Stencil Computation on GPUs

A Portable Framework for Accelerating Stencil Computations on Modern Node Architectures

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Toward Accelerated Stencil Computation by Adapting Tensor Core Unit on GPU

Scaling and analyzing the stencil performance on multi-core and many-core architectures

PADS: A Pattern-Driven Stencil Compiler-Based Tool for Reuse of Optimizations on GPGPUs

Employing polyhedral methods to optimize stencils on FPGAs with stencil-specific caches, data reuse, and wide data bursts

Mat2Stencil: A Modular Matrix-Based DSL for Explicit and Implicit Matrix-Free PDE Solvers on Structured Grid

Locality of Computation for Stencil Optimization

DRStencil: Exploiting Data Reuse Within Low-order Stencil on GPU

Tight Bounds for Low Dimensional Star Stencils in the Parallel External Memory Model

Adapting Combined Tiling to Stencil Optimizations on Sunway Processor

Exploiting Scratchpad Memory for Deep Temporal Blocking: A case study for 2D Jacobian 5-point iterative stencil kernel (j2d5pt)