Abstract:Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least-squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least-squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi-definite splittings to introduce two-level Schwarz preconditioners for least-squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter $\tau$ that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.

Golub-Kahan-Lanczos based preconditioner for least squares problems in overdetermined and underdetermined cases

A Preconditioner based on Non-uniform Row Sampling for Linear Least Squares Problems

A New Preconditioner for Solving Weighted Toeplitz Least Squares Problems

Preconditioning to Comply with the Irrepresentable Condition

A Class Of Preconditioners For Non-Hermitian Positive Definite Linear Systems

New Preconditioners for Nonsymmetric and Indefinite Saddle Point Linear Systems

A CONSTRAINT PRECONDITIONER FOR SOLVING SYMMETRIC POSITIVE DEFINITE SYSTEMS AND APPLICATION TO THE HELMHOLTZ EQUATIONS AND POISSON EQUATIONS

Incomplete Factorization Preconditioning for Linear Least Squares Problems

A new preconditioner for indefinite and asymmetric matrices

Block-splitting preconditioners for indefinite least squares problem

Positive stable preconditioners for symmetric indefinite linear systems arising from Helmholtz equations

A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

Scalable Approximate Optimal Diagonal Preconditioning

Full operator preconditioning and the accuracy of solving linear systems

Two Augmentation Preconditioners for Nonsymmetric and Indefinite Saddle Point Linear Systems with Singular (1, 1) Blocks.

Two-level Nyström-Schur preconditioner for sparse symmetric positive definite matrices

Preconditioned iterative method for nonsymmetric saddle point linear systems

A preconditioned iteration method for solving saddle point problems

A Robust Two-Level Schwarz Preconditioner For Sparse Matrices

A Class of Approximate Inverse Preconditioners for Solving Linear Systems

Efficient Preconditioner Updates for Unsymmetric Shifted Linear Systems