Abstract:Given a sparse matrix A, the selected inversion algorithm is an efficient method for computing certain selected elements of A-1. These selected elements correspond to all or some nonzero elements of the LU factors of A. In many ways, the types of matrix updates performed in the selected inversion algorithm are similar to those performed in the LU factorization, although the sequence of operations is different. In the context of LU factorization, it is known that the leftlooking and right-looking algorithms exhibit different memory access and data communication patterns, and hence different behavior on shared memory and distributed memory parallel machines. Corresponding to right-looking and left-looking LU factorization, the selected inversion algorithm can be organized as a left-looking or a right-looking algorithm. The parallel right-looking version of the algorithm has been developed in [9]. The sequence of operations performed in this version of the selected inversion algorithm is similar to those performed in a left-looking LU factorization algorithm. In this paper, we describe the left-looking variant of the selected inversion algorithm, and present an efficient implementation of the algorithm for shared memory machines using a task parallel method. We demonstrate that with the task scheduling features provided by OpenMP 4.0, the left-looking selected inversion algorithm can scale well both on the Intel Haswell multicore architecture and on the Intel Knights Landing (KNL) manycore architecture up to 16 and 64 cores, respectively. On the KNL architecture, we observe that the maximum parallel efficiency achieved by the left-looking selected inversion algorithm can be as high as 62% even when all 64 cores are used, despite the inherent asynchronous nature of the computation and communication patterns in sparse matrix operations. Compared to the right-looking selected inversion algorithm, the left-looking formulation facilitates efficient pipelining of operations along different branches of the elimination tree, and can be a promising candidate for future development of massively parallel selected inversion algorithms on heterogeneous architectures.

PSelInv - A Distributed Memory Parallel Algorithm for Selected Inversion: the non-symmetric Case

PSelInv -- A Distributed Memory Parallel Algorithm for Selected Inversion : the Symmetric Case

Enhancing the scalability and load balancing of the parallel selected inversion algorithm via tree-based asynchronous communication.

Enhancing Scalability and Load Balancing of Parallel Selected Inversion Via Tree-Based Asynchronous Communication.

SelInv---An Algorithm for Selected Inversion of a Sparse Symmetric Matrix

A Left-Looking Selected Inversion Algorithm and Task Parallelism on Shared Memory Systems.

A Fast Parallel Algorithm for Selected Inversion of Structured Sparse Matrices with Application to 2D Electronic Structure Calculations.

A Communication-Avoiding Parallel Algorithm for the Symmetric Eigenvalue Problem

Solving unsymmetric sparse systems of linear equations with PARDISO

Distributed-Memory Parallel Algorithms for Sparse Matrix and Sparse Tall-and-Skinny Matrix Multiplication

Skew-Symmetric Matrix Decompositions on Shared-Memory Architectures

A Communication Avoiding and Reducing Algorithm for Symmetric Eigenproblem for Very Small Matrices

Parallel Eigenvalue Calculation Based On Multiple Shift-Invert Lanczos And Contour Integral Based Spectral Projection Method

Blockwise inversion and algorithms for inverting large partitioned matrices

Generating Approximate Inverse Preconditioners for Sparse Matrices Using CUDA and GPGPU

Efficient Distributed-Memory Parallel Matrix-Vector Multiplication with Wide or Tall Unstructured Sparse Matrices

An efficient hybrid tridiagonal divide-and-conquer algorithm on distributed memory architectures

Parallel Sparse Matrix Multiplication for Preconditioning and SSTA on a Many-Core Architecture

A Parallel, Distributed Memory Implementation of the Adaptive Sampling Configuration Interaction Method

A Work-Efficient Parallel Sparse Matrix-Sparse Vector Multiplication Algorithm

A Shift Selection Strategy for Parallel Shift-Invert Spectrum Slicing in Symmetric Self-Consistent Eigenvalue Computation