Abstract:Sparse matrix-vector multiplication (SpMV) operations are commonly used in various scientific applications. The performance of the SpMV operation often depends on exploiting regularity patterns in the matrix. Various representations have been proposed to minimize the memory bandwidth bottleneck arising from the irregular memory access pattern involved. Among recent representation techniques, tensor decomposition is a popular one used for very large but sparse matrices. Post sparse-tensor decomposition, the new representation involves indirect accesses, making it challenging to optimize for multi-cores and GPUs. Computational neuroscience algorithms often involve sparse datasets while still performing long-running computations on them. The LiFE application is a popular neuroscience algorithm used for pruning brain connectivity graphs. The datasets employed herein involve the Sparse Tucker Decomposition (STD), a widely used tensor decomposition method. Using this decomposition leads to irregular array references, making it very difficult to optimize for both CPUs and GPUs. Recent codes of the LiFE algorithm show that its SpMV operations are the key bottleneck for performance and scaling. In this work, we first propose target-independent optimizations to optimize these SpMV operations, followed by target-dependent optimizations for CPU and GPU systems. The target-independent techniques include: (1) standard compiler optimizations, (2) data restructuring methods, and (3) methods to partition computations among threads. Then we present the optimizations for CPUs and GPUs to exploit platform-specific speed. Our highly optimized CPU code obtain a speedup of 27.12x over the original sequential CPU code running on 16-core Intel Xeon (Skylake-based) system, and our optimized GPU code achieves a speedup of 5.2x over a reference optimized GPU code version on NVIDIA's GeForce RTX 2080 Ti GPU.

Optimizing Sparse Matrix-Multiple Vectors Multiplication for Nuclear Configuration Interaction Calculations

A High Performance Block Eigensolver for Nuclear Configuration Interaction Calculations.

High Performance Optimizations For Nuclear Physics Code Mfdn On Knl

Accelerating Configuration Interaction Calculations for Nuclear Structure

Automatic Tuning of Sparse Matrix-Vector Multiplication on Multicore Clusters.

A lightweight optimization selection method for Sparse Matrix-Vector Multiplication

On reducing i/o overheads in large-scale invariant subspace projections

Accelerating Nuclear Configuration Interaction Calculations through a Preconditioned Block Iterative Eigensolver

Increasing the Efficiency of Sparse Matrix-Matrix Multiplication with a 2.5D Algorithm and One-Sided MPI

Performance Analysis and Optimization of Sparse Matrix-Vector Multiplication on Modern Multi- and Many-Core Processors

An Integral-equation-oriented Vectorized SpMV Algorithm and Its Application on CT Imaging Reconstruction

Scaling of ab-initio nuclear physics calculations on multicore computer architectures

Accelerating Eigenvalue Computation for Nuclear Structure Calculations via Perturbative Corrections

Design and Implementation of Adaptive SpMV Library for Multicore and Many-Core Architecture

Efficient Sparse Matrix Kernels based on Adaptive Workload-Balancing and Parallel-Reduction

A Comprehensive Performance Model of Sparse Matrix-Vector Multiplication to Guide Kernel Optimization

Smat: An Input Adaptive Auto-Tuner For Sparse Matrix-Vector Multiplication

Large-scale Ab Initio Configuration Interaction Calculations for Light Nuclei

Optimizing the Linear Fascicle Evaluation Algorithm for Multi-Core and Many-Core Systems

Node Aware Sparse Matrix-Vector Multiplication

Large-scale parallel null space calculation for nuclear configuration interaction.