Abstract:Fast and accurate climate simulations and weather predictions are critical for understanding and preparing for the impact of climate change. Real-world weather and climate modeling consist of complex compound stencil kernels that do not perform well on conventional architectures. Horizontal diffusion is one such important compound stencil found in many climate and weather prediction models. Recent works propose using FPGAs as an alternative to traditional CPU and GPU-based systems to accelerate compound stencil kernels. However, we observe that compound stencil computations cannot leverage the bit-level flexibility available on an FPGA because of its complex memory access patterns, leading to high hardware resource utilization and low peak performance. We introduce SPARTA, a novel spatial accelerator for horizontal diffusion weather stencil computation. We exploit the two-dimensional spatial architecture to efficiently accelerate horizontal diffusion stencil by designing the first scaled-out spatial accelerator using MLIR (Multi-Level Intermediate Representation) compiler framework. We evaluate its performance on a real cutting-edge AMD-Xilinx Versal AI Engine spatial architecture. Our real-system evaluation results demonstrate that SPARTA outperforms the state-of-the-art CPU, GPU, and FPGA implementations by 17.1x, 1.2x, and 2.1x, respectively. Our results reveal that balancing workload across the available processing resources is crucial in achieving high performance on spatial architectures. We also implement and evaluate five elementary stencils that are commonly used as benchmarks for stencil computation research. We freely open-source all our implementations to aid future research in stencil computation and spatial computing systems at <a class="link-external link-https" href="https://github.com/CMU-SAFARI/SPARTA" rel="external noopener nofollow">this https URL</a>.

SPARTA: High-Level Synthesis of Parallel Multi-Threaded Accelerators

An accelerator-aware microarchitecture simulator for design space exploration

SPARTA: A Divide and Conquer Approach to Address Translation for Accelerators

SPARTA: Spatial Acceleration for Efficient and Scalable Horizontal Diffusion Weather Stencil Computation

Design Space Exploration of FPGA-based Accelerators with Multi-Level Parallelism

Sparse-HeteroCL: from Sparse Tensor Algebra to Highly Customized Accelerators on FPGAs.

Towards Generalized On-Chip Communication for Programmable Accelerators in Heterogeneous Architectures

Extending High-Level Synthesis for Task-Parallel Programs

Multilevel Granularity Parallelism Synthesis on FPGAs

TAPA-CS: Enabling Scalable Accelerator Design on Distributed HBM-FPGAs

Spatial: a language and compiler for application accelerators

Enhancing High-Level Synthesis with Automated Pragma Insertion and Code Transformation Framework

Automatic Hardware Pragma Insertion in High-Level Synthesis: A Non-Linear Programming Approach

Spada: Accelerating Sparse Matrix Multiplication with Adaptive Dataflow.

Allo: A Programming Model for Composable Accelerator Design

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

FEASTA: A Flexible and Efficient Accelerator for Sparse Tensor Algebra in Machine Learning

Automatic generation of efficient accelerators for reconfigurable hardware

POAS: A high-performance scheduling framework for exploiting Accelerator Level Parallelism

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

POAS: a framework for exploiting accelerator level parallelism in heterogeneous environments