Abstract:Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least-squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least-squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi-definite splittings to introduce two-level Schwarz preconditioners for least-squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter $\tau$ that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.

Compact quasi‐Newton preconditioners for symmetric positive definite linear systems

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

Two-level Nyström-Schur preconditioner for sparse symmetric positive definite matrices

Preconditioning Technique for Symmetric M-matrices

An Efficient Scaled spectral preconditioner for sequences of symmetric positive definite linear systems

Incomplete Factorization Preconditioning for Linear Least Squares Problems

A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

A Note on Constraint Preconditioners for Nonsymmetric Saddle Point Problems

A CONSTRAINT PRECONDITIONER FOR SOLVING SYMMETRIC POSITIVE DEFINITE SYSTEMS AND APPLICATION TO THE HELMHOLTZ EQUATIONS AND POISSON EQUATIONS

Ideal Preconditioners for Saddle Point Systems with a Rank-Deficient Leading Block

Soft quasi-Newton: Guaranteed positive definiteness by relaxing the secant constraint

A Robust Two-Level Schwarz Preconditioner For Sparse Matrices

Preconditioner Design via Bregman Divergences

Multigrid preconditioning of linear systems for semi-smooth Newton methods applied to optimization problems constrained by smoothing operators

Preconditioned iterative method for nonsymmetric saddle point linear systems

Nonlinear Schwarz preconditioning for nonlinear optimization problems with bound constraints

Double Saddle-Point Preconditioning for Krylov Methods in the Inexact Sequential Homotopy Method

Some preconditioning techniques for a class of double saddle point problems

A semi-conjugate gradient method for solving unsymmetric positive definite linear systems

Efficient Preconditioner Updates for Unsymmetric Shifted Linear Systems

Nonlinearly preconditioned semismooth Newton algorithms for nonlinear nonsmooth systems