Abstract:Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least-squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least-squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi-definite splittings to introduce two-level Schwarz preconditioners for least-squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter $\tau$ that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.

Multilevel inverse-based factorization preconditioner for solving sparse linear systems in electromagnetics

A Hybrid Recursive Multilevel Incomplete Factorization Preconditioner for Solving General Linear Systems

Two-step preconditioner of multilevel simple sparse method for electromagnetic scattering problems

Sparse Approximate Inverse Preconditioner for Multiscale Dynamic Electromagnetic Problems

Factorized Sparse Approximate Inverse Preconditioning Strategies for MLFMA

A new parallel sparse approximation inverse preconditioner in MLFMA

The Factorized Sparse Approximate Inverse Preconditioned Conjugate Gradient Algorithm for Finite Element Analysis of Scattering Problems

A Perturbed Preconditioning Technique for Solving Complex Linear Systems Arising from Scattering Problems

A Modified Complex Shifted Preconditioner Combined with Sparse Approximate Inversion Preconditioner for Electromagnetic Scattering

MODIFIED INCOMPLETE CHOLESKY FACTORIZATION FOR SOLVING ELECTROMAGNETIC SCATTERING PROBLEMS

Data-sparse LU-decomposition Preconditioning Combined with Multilevel Fast Multipole Method for Electromagnetic Scattering Problems

Near-Field Sparse Inverse Preconditioning of Multilevel Fast Multipole Algorithm for Electric Field Integral Equations

Application of the incomplete Cholesky factorization preconditioned Krylov subspace method to the vector finite element method for 3-D electromagnetic scattering problems

Improved Algebraic Preconditioning for Multiscale Electromagnetic Problems

Multilevel Sparse Approximate Inverse Preconditioning for Solving Dynamic Integral Equation by H-matrix Method

A sparse-sparse iteration for computing a sparse incomplete factorization of the inverse of an SPD matrix

Sparse Recursive Cholesky Factorization Preconditioning Technique for Acceleration of Iterative Solution to PO-MoM Problems

Sparse Approximate Inverse Preconditioners Based on a Revised Cholesky Factorization

A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

A Novel Hierarchical Two-Level Spectral Preconditioning Technique for Electromagnetic Wave Scattering

An incomplete factorization preconditioning method for solving vector finite element equations