Abstract:We investigate the SPAI and PSAI preconditioning procedures and shed light on two important features of them: (i) For the large linear system Ax=b with A irregular sparse, i.e., with A having s relatively dense columns, SPAI may be very costly to implement, and the resulting sparse approximate inverses may be ineffective for preconditioning. PSAI can be effective for preconditioning but may require excessive storage and be unacceptably time consuming; (ii) the situation is improved drastically when A is regular sparse, that is, all of its columns are sparse. In this case, both SPAI and PSAI are efficient. Moreover, SPAI and, especially, PSAI are more likely to construct effective preconditioners. Motivated by these features, we propose an approach to making SPAI and PSAI more practical for Ax=b with A irregular sparse. We first split A into a regular sparse Ã and a matrix of low rank s. Then exploiting the Sherman–Morrison–Woodbury formula, we transform Ax=b into s+1 new linear systems with the same coefficient matrix Ã, use SPAI and PSAI to compute sparse approximate inverses of Ã efficiently and apply Krylov iterative methods to solve the preconditioned linear systems. Theoretically, we consider the non-singularity and conditioning of Ã obtained from some important classes of matrices. We show how to recover an approximate solution of Ax=b from those of the s+1 new systems and how to design reliable stopping criteria for the s+1 systems to guarantee that the approximate solution of Ax=b satisfies a desired accuracy. Given the fact that irregular sparse linear systems are common in applications, this approach widely extends the practicability of SPAI and PSAI. Numerical results demonstrate the considerable superiority of our approach to the direct application of SPAI and PSAI to Ax=b.

Preconditioning to Comply with the Irrepresentable Condition

Preconditioning the Lasso for Sign Consistency

A Preconditioner based on Non-uniform Row Sampling for Linear Least Squares Problems

Incomplete Factorization Preconditioning for Linear Least Squares Problems

A preconditioner for solving linear programming problems with dense columns

Full operator preconditioning and the accuracy of solving linear systems

Large Scale Constrained Linear Regression Revisited: Faster Algorithms via Preconditioning

Are sketch-and-precondition least squares solvers numerically stable?

An Approach to Making SPAI and PSAI Preconditioning Effective for Large Irregular Sparse Linear Systems.

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

Polynomial Preconditioners for Regularized Linear Inverse Problems

Solving Dense Linear Systems Faster Than via Preconditioning

A Residual Based Sparse Approximate Inverse Preconditioning Procedure for Large Sparse Linear Systems

A preconditioned iteration method for solving saddle point problems

Graph Neural Preconditioners for Iterative Solutions of Sparse Linear Systems

Symmetric Stair Preconditioning of Linear Systems for Parallel Trajectory Optimization

Preconditioning Technique for Symmetric M-matrices

Preconditioned Krylov solvers for kernel regression

Neural incomplete factorization: learning preconditioners for the conjugate gradient method

Faster Linear Systems and Matrix Norm Approximation via Multi-level Sketched Preconditioning