Abstract:Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least-squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least-squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi-definite splittings to introduce two-level Schwarz preconditioners for least-squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter $\tau$ that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.

SSOR Preconditioned Conjugate Gradient Method for Solution of Large Sparse Linear Equations from Vector FEM

The Modified Solutoin for Large Sparse Symmetric Linear Systems in Electromagnetic Field Analysis

Application of the SSOR preconditioned CG algorithm to the vector FEM for 3D full-wave analysis of electromagnetic-field boundary-value problems

A Novel Matrix-Free Finite Element Method for Time-Harmonic Maxwell’s Equations

SSOR Preconditioner Accelerated Time Domain Finite Element Boundary Integral Method

Parallel Fast Algorithm for Large-Scale Electromagnetic Scattering

A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

FAST SOLUTION FOR LARGE SCALE ELECTROMAGNETIC SCATTERING PROBLEMS USING WAVELET TRANSFORM AND ITS PRECONDITION - Abstract

Advances In Sparse Solver For Finite Element Analysis

An OSRC Preconditioner for the EFIE

Improved SAI Preconditioning of Hybridized MLFMA for Electrically Large Multiscale Problems

High Performance Sparse Static Solver in Finite Element Analyses with Loop-Unrolling

Improved SAI Preconditioning of Hybridized MLFMA for Electrically Large Multi-scale Problems

Anderson Accelerated PMHSS for Complex-Symmetric Linear Systems

Large-scale 3D geoelectromagnetic modeling using parallel adaptive high-order finite element method

A Simple Overlapping DDM Preconditioned Fast HOVSIE for Wideband Scatterings of Anisotropic Medium-Metallic Objects

Fast Sparse Eigen Solution In Finite Element Analysis

A CONSTRAINT PRECONDITIONER FOR SOLVING SYMMETRIC POSITIVE DEFINITE SYSTEMS AND APPLICATION TO THE HELMHOLTZ EQUATIONS AND POISSON EQUATIONS

Hierarchical Node Method for Solving Large-Scale Sparse Linear Equations in Parallel

A Modified SSOR-like Preconditioner for Non-Hermitian Positive Definite Matrices

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations