Abstract:Matrix-matrix multiplication is a basic operation in linear algebra and an essential building block for a wide range of algorithms in various scientific fields. Theory and implementation for the dense, square matrix case are well-developed. If matrices are sparse, with application-specific sparsity patterns, the optimal implementation remains an open question. Here, we explore the performance of communication reducing 2.5D algorithms and one-sided MPI communication in the context of linear scaling electronic structure theory. In particular, we extend the DBCSR sparse matrix library, which is the basic building block for linear scaling electronic structure theory and low scaling correlated methods in CP2K. The library is specifically designed to efficiently perform block-sparse matrix-matrix multiplication of matrices with a relatively large occupation. Here, we compare the performance of the original implementation based on Cannon's algorithm and MPI point-to-point communication, with an implementation based on MPI one-sided communications (RMA), in both a 2D and a 2.5D approach. The 2.5D approach trades memory and auxiliary operations for reduced communication, which can lead to a speedup if communication is dominant. The 2.5D algorithm is somewhat easier to implement with one-sided communications. A detailed description of the implementation is provided, also for non ideal processor topologies, since this is important for actual applications. Given the importance of the precise sparsity pattern, and even the actual matrix data, which decides the effective fill-in upon multiplication, the tests are performed within the CP2K package with application benchmarks. Results show a substantial boost in performance for the RMA based 2.5D algorithm, up to 1.80x, which is observed to increase with the number of processes involved in the parallelization.

Local Basic Linear Algebra Subroutines (lblas) for the Cm-5/5e

Lasa: Abstraction and Specialization for Productive and Performant Linear Algebra on FPGAs

LAW: A Tool for Improved Productivity with High-Performance Linear Algebra Codes. Design and Applications

FT-BLAS: A Fault Tolerant High Performance BLAS Implementation on x86 CPUs

CLBlast: A Tuned OpenCL BLAS Library

miniLB: A Performance Portability Study of Lattice-Boltzmann Simulations

Multi-Threaded Dense Linear Algebra Libraries for Low-Power Asymmetric Multicore Processors

Developing a BLAS library for the AMD AI Engine

Interface for Sparse Linear Algebra Operations

BLASX: A High Performance Level-3 BLAS Library for Heterogeneous Multi-GPU Computing

AMGCL: an Efficient, Flexible, and Extensible Algebraic Multigrid Implementation

Parallel Sparse Matrix Multiplication for Preconditioning and SSTA on a Many-Core Architecture

Machine-Learning-Driven Runtime Optimization of BLAS Level 3 on Modern Multi-Core Systems

Parallelization of LAPACK Linear Equation Functions Based on Loongson 3A

Increasing the Efficiency of Sparse Matrix-Matrix Multiplication with a 2.5D Algorithm and One-Sided MPI

DBCSR: A Library for Dense Matrix Multiplications on Distributed GPU-Accelerated Systems

Fast Matrix Multiplication via Compiler-only Layered Data Reorganization and Intrinsic Lowering

Automatic Generation of Efficient Linear Algebra Programs

Implementing High-performance Complex Matrix Multiplication via the 3m and 4m Methods

On a vectorized basic linear algebra package for prototyping codes in MATLAB