Abstract:Sparse matrix computation is crucial in various modern applications, including large-scale graph analytics, deep learning, and recommender systems. The performance of sparse kernels varies greatly depending on the structure of the input matrix, making it difficult to gain a comprehensive understanding of sparse computation and its relationship to inputs, algorithms, and target machine architecture. Despite extensive research on certain sparse kernels, such as Sparse Matrix-Vector Multiplication (SpMV), the overall family of sparse algorithms has yet to be investigated as a whole. This paper introduces SpChar, a workload characterization methodology for general sparse computation. SpChar employs tree-based models to identify the most relevant hardware and input characteristics, starting from hardware and input-related metrics gathered from Performance Monitoring Counters (PMCs) and matrices. Our analysis enables the creation of a characterization loop that facilitates the optimization of sparse computation by mapping the impact of architectural features to inputs and algorithmic choices. We apply SpChar to more than 600 matrices from the SuiteSparse Matrix collection and three state-of-the-art Arm CPUs to determine the critical hardware and software characteristics that affect sparse computation. In our analysis, we determine that the biggest limiting factors for high-performance sparse computation are (1) the latency of the memory system, (2) the pipeline flush overhead resulting from branch misprediction, and (3) the poor reuse of cached elements. Additionally, we propose software and hardware optimizations that designers can implement to create a platform suitable for sparse computation. We then investigate these optimizations using the gem5 simulator to achieve a significant speedup of up to 2.63x compared to a CPU where the optimizations are not applied.

Bringing Order to Sparsity: A Sparse Matrix Reordering Study on Multicore CPUs

Efficient and effective sparse tensor reordering

Performance Analysis and Optimization of Sparse Matrix-Vector Multiplication on Modern Multi- and Many-Core Processors

A lightweight optimization selection method for Sparse Matrix-Vector Multiplication

Automatic Tuning of Sparse Matrix-Vector Multiplication on Multicore Clusters.

Sparse matrix partitioning for optimizing SpMV on CPU-GPU heterogeneous platforms

SpChar: Characterizing the Sparse Puzzle via Decision Trees

Performance Optimization for Sparse A(T)Ax in Parallel on Multicore Cpu

Efficient Sparse Matrix Kernels based on Adaptive Workload-Balancing and Parallel-Reduction

PARS3: Parallel Sparse Skew-Symmetric Matrix-Vector Multiplication with Reverse Cuthill-McKee Reordering

A Comprehensive Performance Model of Sparse Matrix-Vector Multiplication to Guide Kernel Optimization

Scale-Free Sparse Matrix-Vector Multiplication on Many-Core Architectures

Feature-based SpMV Performance Analysis on Contemporary Devices

Parallel Sparse Matrix Multiplication for Preconditioning and SSTA on a Many-Core Architecture

A Work-Efficient Parallel Sparse Matrix-Sparse Vector Multiplication Algorithm

Diagonally-Addressed Matrix Nicknack: How to improve SpMV performance

Increasing the Efficiency of Sparse Matrix-Matrix Multiplication with a 2.5D Algorithm and One-Sided MPI

A Data Locality-Aware Design Framework For Reconfigurable Sparse Matrix-Vector Multiplication Kernel

Efficient Distributed-Memory Parallel Matrix-Vector Multiplication with Wide or Tall Unstructured Sparse Matrices

Skew-Symmetric Matrix Decompositions on Shared-Memory Architectures

Distributed-Memory Parallel Algorithms for Sparse Matrix and Sparse Tall-and-Skinny Matrix Multiplication