Abstract:CG-Kit is a new code generation toolkit that we propose as a solution for portability and maintainability for scientific computing applications. The development of CG-Kit is rooted in the urgent need created by the shifting landscape of high-performance computing platforms and the algorithmic complexities of a particular large-scale multiphysics application: Flash-X. This combination leads to unique challenges including handling an existing large code base in Fortran and/or C/C++, subdivision of code into a great variety of units supporting a wide range of physics and numerical methods, different parallelization techniques for distributed- and shared-memory systems and accelerator devices, and heterogeneity of computing platforms requiring coexisting variants of parallel algorithms. The challenges demand that developers determine custom abstractions and granularity for code generation. CG-Kit tackles this with standalone tools that can be combined into highly specific and, we argue, highly effective portability and maintainability tool chains. Here we present the design of our new tools: parametrized source trees, control flow graphs, and recipes. The tools are implemented in Python. Although the tools are agnostic to the programming language of the source code, we focus on C/C++ and Fortran. Code generation experiments demonstrate the generation of variants of parallel algorithms: first, multithreaded variants of the basic AXPY operation (scalar-vector addition and vector-vector multiplication) to introduce the application of CG-Kit tool chains; and second, variants of parallel algorithms within a hydrodynamics solver, called Spark, from Flash-X that operates on block-structured adaptive meshes. In summary, code generated by CG-Kit achieves a reduction by over 60% of the original C/C++/Fortran source code.

Bandicoot: C++ Library for GPU Linear Algebra and Scientific Computing

Ginkgo: A Modern Linear Operator Algebra Framework for High Performance Computing

Kernel Launcher: C++ Library for Optimal-Performance Portable CUDA Applications

PyArmadillo: a streamlined linear algebra library for Python

Porting a sparse linear algebra math library to Intel GPUs

Automated Fortran--C++ Bindings for Large-Scale Scientific Applications

AMGCL: an Efficient, Flexible, and Extensible Algebraic Multigrid Implementation

Alpaka - An Abstraction Library for Parallel Kernel Acceleration

GraphMat: High performance graph analytics made productive

CG-Kit: Code Generation Toolkit for Performant and Maintainable Variants of Source Code Applied to Flash-X Hydrodynamics Simulations

cpp11armadillo: An R Package to Use the Armadillo C++ Library

LAW: A Tool for Improved Productivity with High-Performance Linear Algebra Codes. Design and Applications

Easily porting material point methods codes to GPU

Developing a BLAS library for the AMD AI Engine

CLBlast: A Tuned OpenCL BLAS Library

A GEMM interface and implementation on NVIDIA GPUs for multiple small matrices

Providing performance portable numerics for Intel GPUs

Application Experiences on a GPU-Accelerated Arm-based HPC Testbed

Multi-GPU aggregation-based AMG preconditioner for iterative linear solvers

cuIBM -- A GPU-accelerated Immersed Boundary Method