Incomplete Factorization Preconditioning for Linear Least Squares Problems

Xiaoge Wang
1994-01-01
Abstract:A new family of preconditioners for conjugate gradient-like iterative methods applied to large sparse linear least squares problems, $ m i n ~ \(|| ~Ax~-~b~ \(|| sub 2 ,$ is proposed. The family is based on Incomplete Gram-Schmidt (IGS) factorizations of $A$. Particular attention has been given to the following members of the family: Incomplete Classical Gram-Schmidt (ICGS), Incomplete Modified Gram-Schmidt (IMGS) and Compressed Incomplete Modified Gram-Schmidt (CIMGS) factorizations. The numerical properties of each of these methods have been considered as well as the relationships between the methods concerning the preservaton of sparsity, computational efficiency and the quality of the preconditioner. When certain conditions are imposed on the sparsity pattern of the preconditioning matrix, incomplete Cholesky (IC) factorization is identical to IMGS. Therefore, a sufficient condition on the sparsity pattern for a stable IC factorization can be derived. Based on this condition, three algorithms for modifying a sparsity pattern for which IC may not succeed have been designed. These methods differ from previously proposed methods to guarantee the existence and improve the stability of the IC factorization since they do not require numerical information. Numerical experiments illustrating the capabilities of the preconditioners are also presented.
What problem does this paper attempt to address?