Abstract:Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least-squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least-squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi-definite splittings to introduce two-level Schwarz preconditioners for least-squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter $\tau$ that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.

Iterative Methods for Sparse Symmetric Multilinear Systems

A general class of iterative splitting methods for solving linear systems

Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations

A note on indefinite matrix splitting and preconditioning

An Efficient Iterative Approach to Large Sparse Nonlinear Systems with Non-Hermitian Jacobian Matrices

A Non-Krylov subspace Method for Solving Large and Sparse Linear System of Equations

Convergence Properties of an Iterative Method for Solving Symmetric Non-linear Equations

Developing iterative algorithms to solve Sylvester tensor equations

On Krylov subspace methods for skew-symmetric and shifted skew-symmetric linear systems

Iterative Methods by Space Decomposition and Subspace Correction

Preconditioned iterative method for nonsymmetric saddle point linear systems

Gradient-based iterative approach for solving constrained systems of linear matrix equations

A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

Iterative method for constrained systems of conjugate transpose matrix equations

Improved Seed Methods for Symmetric Positive Definite Linear Equations with Multiple Right-hand Sides

On iterative methods based on Sherman-Morrison-Woodbury splitting

Modified CRI iteration methods for complex symmetric indefinite linear systems

A Survey on Intelligent Iterative Methods for Solving Sparse Linear Algebraic Equations

New Accelerated Modulus-Based Iteration Method for Solving Large and Sparse Linear Complementarity Problem

A class of multiplicative splitting iterations for solving the continuous Sylvester equation

Minimum residual NDSS iteration method for a class of complex symmetric linear systems