Abstract:Matrix-matrix multiplication is a basic operation in linear algebra and an essential building block for a wide range of algorithms in various scientific fields. Theory and implementation for the dense, square matrix case are well-developed. If matrices are sparse, with application-specific sparsity patterns, the optimal implementation remains an open question. Here, we explore the performance of communication reducing 2.5D algorithms and one-sided MPI communication in the context of linear scaling electronic structure theory. In particular, we extend the DBCSR sparse matrix library, which is the basic building block for linear scaling electronic structure theory and low scaling correlated methods in CP2K. The library is specifically designed to efficiently perform block-sparse matrix-matrix multiplication of matrices with a relatively large occupation. Here, we compare the performance of the original implementation based on Cannon's algorithm and MPI point-to-point communication, with an implementation based on MPI one-sided communications (RMA), in both a 2D and a 2.5D approach. The 2.5D approach trades memory and auxiliary operations for reduced communication, which can lead to a speedup if communication is dominant. The 2.5D algorithm is somewhat easier to implement with one-sided communications. A detailed description of the implementation is provided, also for non ideal processor topologies, since this is important for actual applications. Given the importance of the precise sparsity pattern, and even the actual matrix data, which decides the effective fill-in upon multiplication, the tests are performed within the CP2K package with application benchmarks. Results show a substantial boost in performance for the RMA based 2.5D algorithm, up to 1.80x, which is observed to increase with the number of processes involved in the parallelization.

mdspan in C++: A Case Study in the Integration of Performance Portable Features into International Language Standards

An extension of C++ with memory-centric specifications for HPC to reduce memory footprints and streamline MPI development

PARRAY

A More Scalable Sparse Dynamic Data Exchange

Performance on HPC Platforms Is Possible Without C++

Performance and Power Efficient Massive Parallel Computational Model for HPC Heterogeneous Exascale Systems

Enabling Highly-Scalable Remote Memory Access Programming with MPI-3 One Sided

Distributed Ranges: A Model for Distributed Data Structures, Algorithms, and Views

Increasing the Efficiency of Sparse Matrix-Matrix Multiplication with a 2.5D Algorithm and One-Sided MPI

Programming Bare-Metal Accelerators with Heterogeneous Threading Models: A Case Study of Matrix-3000

Mamba: Portable Array-based Abstractions for Heterogeneous High-Performance Systems

Numerical eigen-spectrum slicing, accurate orthogonal eigen-basis, and mixed-precision eigenvalue refinement using OpenMP data-dependent tasks and accelerator offload

An approach to performance portability through generic programming

Porting Molecular Dynamics simulation to heterogeneous multi-core architecture

Interface for Sparse Linear Algebra Operations

MPIs Language Bindings are Holding MPI Back

Design and implementation of self-adaptable parallel algorithms for scientific computing on highly heterogeneous HPC platforms

Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

A New Hybrid Hierarchical Parallel Algorithm to Enhance the Performance of Large-Scale Structural Analysis Based on Heterogeneous Multicore Clusters

Design and Implementation of ShenWei Universal C/C++

Design and Implementation of Adaptive SpMV Library for Multicore and Many-Core Architecture