A modified version of the PRESB preconditioner for a class of non-Hermitian complex systems of linear equations

Owe Axelsson,Dovod Khojasteh Slakuyeh

2024-05-14

Abstract:We present a modified version of the PRESB preconditioner for two-by-two block system of linear equations with the coefficient matrix $$\textbf{A}=\left(\begin{array}{cc}

Numerical Analysis

What problem does this paper attempt to address?

A Modified SSOR-like Preconditioner for Non-Hermitian Positive Definite Matrices

Sheng-Zhong Song,Zheng-Da Huang

DOI: https://doi.org/10.1016/j.apnum.2020.11.008

IF: 2.994

2021-01-01

Applied Numerical Mathematics

Abstract:A modified SSOR-like (MSSOR-like) preconditioner is constructed for a non-Hermitian positive definite linear system with a dominant Hermitian part. The eigenvalue distribution of the MSSOR-like preconditioned matrix and the convergence property of the corresponding MSSOR-like iteration method are discussed in depth. Numerical experiments show that the MSSOR-like preconditioner can lead to a high-speed and effectively preconditioned GMRES, even when the dominant Hermitian part of the coefficient matrix is not so strong.
Robust PRESB Preconditioning of a 3-Dimensional Space-Time Finite Element Method for Parabolic Problems

Ladislav Foltyn,Dalibor Lukáš,Marco Zank

DOI: https://doi.org/10.1515/cmam-2023-0085

2024-01-25

Computational Methods in Applied Mathematics

Abstract:We present a recently developed preconditioning of square block matrices (PRESB) to be used within a parallel method to solve linear systems of equations arising from tensor-product discretizations of initial boundary-value problems for parabolic partial differential equations. We consider weak formulations in Bochner–Sobolev spaces and tensor-product finite element approximations for the heat and eddy current equations. The fast diagonalization method is employed to decouple the arising linear system of equations into auxiliary spatial complex-valued linear systems that can be solved concurrently. We prove that the real part of the system matrix is positive definite, which allows us to accelerate the flexible generalized minimal residual method (FGMRES) by the PRESB preconditioner. The action of PRESB on a vector includes two solutions with positive definite matrices. The spectrum of the preconditioned system lies between 1/2 and 1. Finally, we combine the PRESB-FGMRES method with multigrid-CG iterations and illustrate the numerical efficiency and the robustness for spatial discretizations up to 12 millions degrees of freedom.

mathematics, applied
A preconditioned version of the MBP iteration method for a class of complex symmetric linear systems

Xiaofeng Xie,Zhengge Huang,Jingjing Cui,Beibei Li

DOI: https://doi.org/10.1007/s40314-024-02643-4

2024-03-25

Computational and Applied Mathematics

Abstract:In this paper, we consider the iterative solution of a class of complex symmetric linear systems and construct a preconditioned variant of the modified block product (PMBP) iteration method. The proposed method is established by applying the preconditioning technique to the MBP method presented recently. The convergence conditions, optimal iteration parameters, and corresponding optimal convergence factor of the PMBP iteration method are determined. Meanwhile, a practical way to choose the iteration parameters for the PMBP iteration method is proposed. Furthermore, comparisons between the PMBP iteration method and some existing ones verify that the PMBP iteration method owns faster convergence rate than some known ones. Finally, some numerical experiments are provided to demonstrate the effectiveness and the superiority of the proposed PMBP method.

mathematics, applied
A Note on Constraint Preconditioners for Nonsymmetric Saddle Point Problems

Yiqin Lin,Yimin Wei

DOI: https://doi.org/10.1002/nla.536

2007-01-01

Numerical Linear Algebra with Applications

Abstract:A class of constraint preconditioners for solving two-by-two block linear equations with the (1,2)-block being the transpose of the (2,1)-block and the (2,2)-block being zero was investigated in a recent paper of Cao (Numer Math. 2006; 103:47-61). In this short note, we extend his idea by allowing the (1,2)-block to be not equal to the transpose of the (2,1)-block. Results concerning the spectrum, the form of the eigenvectors and the convergence behaviour of a Krylov subspace method, such as GMRES are presented. Copyright (c) 2007 John Wiley & Sons, Ltd.
A CONSTRAINT PRECONDITIONER FOR SOLVING SYMMETRIC POSITIVE DEFINITE SYSTEMS AND APPLICATION TO THE HELMHOLTZ EQUATIONS AND POISSON EQUATIONS

Zhuo-Hong Huang,Ting-Zhu Huang

DOI: https://doi.org/10.3846/1392-6292.2010.15.299-311

2010-07-15

Mathematical Modelling and Analysis

Abstract:In this paper, first, by using the diagonally compensated reduction and incomplete Cholesky factorization methods, we construct a constraint preconditioner for solving symmetric positive definite linear systems and then we apply the preconditioner to solve the Helmholtz equations and Poisson equations. Second, according to theoretical analysis, we prove that the preconditioned iteration method is convergent. Third, in numerical experiments, we plot the distribution of the spectrum of the preconditioned matrix M−1A and give the solution time and number of iterations comparing to the results of [5, 19].

mathematics
Practical Restrictively Preconditioned Conjugate Gradient Methods for a Class of Block Two-by-Two Linear Systems

Fang Chen,Shu-Ru He

DOI: https://doi.org/10.1007/s42967-023-00356-9

2024-02-05

Communications on Applied Mathematics and Computation

Abstract:We further analyze the solution of a class of block two-by-two linear systems. Instead of using the preconditioned GMRES iteration methods, we propose a new approximation of the Schur complement based on the special structure of this kind of block two-by-two matrix, and construct a practical restrictive preconditioner accordingly. Subsequently, we propose a practical restrictively preconditioned conjugate gradient (RPCG) method to solve this class of linear systems. The convergence property of the practical RPCG method is similar to the RPCG method. Last, numerical experiments show that this method is more efficient than some classical preconditioned Krylov subspace iteration methods.

mathematics, applied
A universal matrix-free split preconditioner for the fixed-point iterative solution of non-symmetric linear systems

Tom Vettenburg,Ivo M. Vellekoop

2023-09-29

Abstract:We present an efficient preconditioner for linear problems $A x=y$. It guarantees monotonic convergence of the memory-efficient fixed-point iteration for all accretive systems of the form $A = L + V$, where $L$ is an approximation of $A$, and the system is scaled so that the discrepancy is bounded with $\lVert V \rVert<1$. In contrast to common splitting preconditioners, our approach is not restricted to any particular splitting. Therefore, the approximate problem can be chosen so that an analytic solution is available to efficiently evaluate the preconditioner. We prove that the only preconditioner with this property has the form $(L+I)(I - V)^{-1}$. This unique form moreover permits the elimination of the forward problem from the preconditioned system, often halving the time required per iteration. We demonstrate and evaluate our approach for wave problems, diffusion problems, and pantograph delay differential equations. With the latter we show how the method extends to general, not necessarily accretive, linear systems.

Numerical Analysis,Computational Physics
Two-level Nyström-Schur preconditioner for sparse symmetric positive definite matrices

Hussam Al Daas,T. Rees,J. Scott

DOI: https://doi.org/10.1137/21M139548X

IF: 2.968

2021-01-01

SIAM Journal on Scientific Computing

Abstract:Randomized methods are becoming increasingly popular in numerical linear algebra. However, few attempts have been made to use them in developing preconditioners. Our interest lies in solving large-scale sparse symmetric positive definite linear systems of equations where the system matrix is preordered to doubly bordered block diagonal form (for example, using a nested dissection ordering). We investigate the use of randomized methods to construct high quality preconditioners. In particular, we propose a new and efficient approach that employs Nystr\"om's method for computing low rank approximations to develop robust algebraic two-level preconditioners. Construction of the new preconditioners involves iteratively solving a smaller but denser symmetric positive definite Schur complement system with multiple right-hand sides. Numerical experiments on problems coming from a range of application areas demonstrate that this inner system can be solved cheaply using block conjugate gradients and that using a large convergence tolerance to limit the cost does not adversely affect the quality of the resulting Nystr\"om--Schur two-level preconditioner.

Mathematics,Computer Science
Efficient Preconditioner Updates for Unsymmetric Shifted Linear Systems

Wei-Hua Luo,Ting-Zhu Huang,Liang Li,Yong Zhang,Xian-Ming Gu

DOI: https://doi.org/10.1016/j.camwa.2014.03.005

IF: 3.218

2014-01-01

Computers & Mathematics with Applications

Abstract:In this paper, we introduce a preconditioning strategy for unsymmetric shifted linear systems (A + alpha I)x = b, which is a generalization of the scheme proposed by Bellavia et al. (2011). By modifying the nonzero entries in the LDU factorization of A, we give a series of preconditioners with the same sparsity pattern as the seed preconditioner. Theoretical analyses show that when alpha -> 0 or infinity, the eigenvalues of the preconditioned systems will cluster about 1. Some practical examples, including non-Hermitian eigenvalue problems arising from the convection diffusion equation, are given to illustrate the efficiency of the preconditioners. (C) 2014 Elsevier Ltd. All rights reserved.
A Robust Two-Level Schwarz Preconditioner For Sparse Matrices

Hussam Al Daas,Pierre Jolivet,Frédéric Nataf,Pierre-Henri Tournier

2024-01-08

Abstract:This paper introduces a fully algebraic two-level additive Schwarz preconditioner for general sparse large-scale matrices. The preconditioner is analyzed for symmetric positive definite (SPD) matrices. For those matrices, the coarse space is constructed based on approximating two local subspaces in each subdomain. These subspaces are obtained by approximating a number of eigenvectors corresponding to dominant eigenvalues of two judiciously posed generalized eigenvalue problems. The number of eigenvectors can be chosen to control the condition number. For general sparse matrices, the coarse space is constructed by approximating the image of a local operator that can be defined from information in the coefficient matrix. The connection between the coarse spaces for SPD and general matrices is also discussed. Numerical experiments show the great effectiveness of the proposed preconditioners on matrices arising from a wide range of applications. The set of matrices includes SPD, symmetric indefinite, nonsymmetric, and saddle-point matrices. In addition, we compare the proposed preconditioners to the state-of-the-art domain decomposition preconditioners.

Numerical Analysis
A preconditioned MINRES method for block lower triangular Toeplitz systems

Congcong Li,Xuelei Lin,Sean Hon,Shu-Lin Wu

2023-12-21

Abstract:In this study, a novel preconditioner based on the absolute-value block $\alpha$-circulant matrix approximation is developed, specifically designed for nonsymmetric dense block lower triangular Toeplitz (BLTT) systems that emerge from the numerical discretization of evolutionary equations. Our preconditioner is constructed by taking an absolute-value of a block $\alpha$-circulant matrix approximation to the BLTT matrix. To apply our preconditioner, the original BLTT linear system is converted into a symmetric form by applying a time-reversing permutation transformation. Then, with our preconditioner, the preconditioned minimal residual method (MINRES) solver is employed to solve the symmetrized linear system. With properly chosen $\alpha$, the eigenvalues of the preconditioned matrix are proven to be clustered around $\pm1$ without any significant outliers. With the clustered spectrum, we show that the preconditioned MINRES solver for the preconditioned system has a convergence rate independent of system size. To the best of our knowledge, this is the first preconditioned MINRES method with size-independent convergence rate for the dense BLTT system. The efficacy of the proposed preconditioner is corroborated by our numerical experiments, which reveal that it attains optimal convergence.

Numerical Analysis
Spectral analysis of block preconditioners for double saddle-point linear systems with application to PDE-constrained optimization

Luca Bergamaschi,Angeles Martinez,John Pearson,Andreas Potschka

2024-05-24

Abstract:In this paper, we describe and analyze the spectral properties of a symmetric positive definite inexact block preconditioner for a class of symmetric, double saddle-point linear systems.

Numerical Analysis
Absolute-value based preconditioner for complex-shifted Laplacian systems

Xuelei Lin,Congcong Li,Sean Hon

2024-08-01

Abstract:The complex-shifted Laplacian systems arising in a wide range of applications. In this work, we propose an absolute-value based preconditioner for solving the complex-shifted Laplacian system. In our approach, the complex-shifted Laplacian system is equivalently rewritten as a $2\times 2$ block real linear system. With the Toeplitz structure of uniform-grid discretization of the constant-coefficient Laplacian operator, the absolute value of the block real matrix is fast invertible by means of fast sine transforms. For more general coefficient function, we then average the coefficient function and take the absolute value of the averaged matrix as our preconditioner. With assumptions on the complex shift, we theoretically prove that the eigenvalues of the preconditioned matrix in absolute value are upper and lower bounded by constants independent of matrix size, indicating a matrix-size independent linear convergence rate of MINRES solver. Interestingly, numerical results show that the proposed preconditioner is still efficient even if the assumptions on the complex shift are not met. The fast invertibility of the proposed preconditioner and the robust convergence rate of the preconditioned MINRES solver lead to a linearithmic (nearly optimal) complexity of the proposed solver. The proposed preconditioner is compared with several state-of-the-art preconditioners via several numerical examples to demonstrate the efficiency of the proposed preconditioner.

Numerical Analysis
Shift-splitting preconditioner for non-Hermitian positive definite matrices

Zhong-Zhi Bai,Junfeng Yin,Yangfeng Su

DOI: https://doi.org/10.1002/nla.2004

2006-01-01

Journal of Computational Mathematics

Abstract:A shift splitting concept is introduced and, correspondingly, a shift-splitting iteration scheme and a shift-splitting preconditioner are presented, for solving the large sparse system of linear equations of which the coefficient matrix is an ill-conditioned non-Hermitian positive definite matrix. The convergence property of the shift-splitting iteration method and the eigenvalue distribution of the shift-splitting preconditioned matrix are discussed in depth, and the best possible choice of the shift is investigated in detail. Numerical computations show that the shift-splitting preconditioner can induce accurate, robust and effective preconditioned Krylov subspace iteration methods for solving the large sparse non-Hermitian positive definite systems of linear equations.
New preconditioner strategy for solving block four-by-four linear systems: An application to the saddle-point problem from 3D Stokes equation

Achraf Badahmane, Ahmed Ratnani, Hassane Sadok

2024-02-21

Abstract:We have presented a fast method for solving a specific type of block four-by-four saddlepoint problem arising from the finite element discretization of the generalized 3D Stokes problem. We analyze the eigenvalue distribution and the eigenvectors of the preconditioned matrix. Furthermore, we suggested utilizing the preconditioned global conjugate gradient method (PGCG) as a block iterative solver for handling multiple right-hand sides within the sub-system and give some new convergence results. Numerical experiments have shown that our preconditioned iterative approach is very efficient for solving the 3D Stokes problem

Numerical Analysis
Ideal Preconditioners for Saddle Point Systems with a Rank-Deficient Leading Block

Susanne Bradley

DOI: https://doi.org/10.48550/arXiv.1807.08590

2018-07-23

Numerical Analysis

Abstract:We consider the iterative solution of symmetric saddle point systems with a rank-deficient leading block. We develop two preconditioners that, under certain assumptions on the rank structure of the system, yield a preconditioned matrix with a constant number of eigenvalues. We then derive some properties of the inverse of a particular class of saddle point system and exploit these to develop a third preconditioner, which remains ideal even when the earlier assumptions on rank structure are relaxed.
Polynomial Preconditioning for the Action of the Matrix Square Root and Inverse Square Root

Andreas Frommer,Gustavo Ramirez-Hidalgo,Marcel Schweitzer,Manuel Tsolakis

2024-01-13

Abstract:While preconditioning is a long-standing concept to accelerate iterative methods for linear systems, generalizations to matrix functions are still in their infancy. We go a further step in this direction, introducing polynomial preconditioning for Krylov subspace methods which approximate the action of the matrix square root and inverse square root on a vector. Preconditioning reduces the subspace size and therefore avoids the storage problem together with -- for non-Hermitian matrices -- the increased computational cost per iteration that arises in the unpreconditioned case. Polynomial preconditioning is an attractive alternative to current restarting or sketching approaches since it is simpler and computationally more efficient. We demonstrate this for several numerical examples.

Numerical Analysis
A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

Hussam Al Daas,Pierre Jolivet,Jennifer Scott

DOI: https://doi.org/10.48550/arXiv.2107.09006

2022-01-02

Abstract:Solving the normal equations corresponding to large sparse linear least-squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least-squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least-squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi-definite splittings to introduce two-level Schwarz preconditioners for least-squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter $\tau$ that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.

Numerical Analysis
A Class of Inexact Block Factorization Preconditioners for Indefinite Matrices with a Three-by-three Block Structure.

Sheng-Zhong Song,Zheng-Da Huang

DOI: https://doi.org/10.48550/arxiv.2211.09346

2022-01-01

Abstract:We consider using the preconditioned-Krylov subspace method to solve the system of linear equations with a three-by-three block structure. By making use of the three-by-three block structure, eight inexact block factorization preconditioners, which can be put into a same theoretical analysis frame, are proposed based on a kind of inexact factorization. By generalizing Bendixson Theorem and developing a unified technique of spectral equivalence, the bounds of the real and imaginary parts of eigenvalues of the preconditioned matrices are obtained. The comparison to eleven existed exact and inexact preconditioners shows that three of the proposed preconditioners can lead to high-speed and effective preconditioned-GMRES in most tests.

A modified version of the PRESB preconditioner for a class of non-Hermitian complex systems of linear equations

A Modified SSOR-like Preconditioner for Non-Hermitian Positive Definite Matrices

Robust PRESB Preconditioning of a 3-Dimensional Space-Time Finite Element Method for Parabolic Problems

A preconditioned version of the MBP iteration method for a class of complex symmetric linear systems

A Note on Constraint Preconditioners for Nonsymmetric Saddle Point Problems

A CONSTRAINT PRECONDITIONER FOR SOLVING SYMMETRIC POSITIVE DEFINITE SYSTEMS AND APPLICATION TO THE HELMHOLTZ EQUATIONS AND POISSON EQUATIONS

Practical Restrictively Preconditioned Conjugate Gradient Methods for a Class of Block Two-by-Two Linear Systems

A universal matrix-free split preconditioner for the fixed-point iterative solution of non-symmetric linear systems

Two-level Nyström-Schur preconditioner for sparse symmetric positive definite matrices

Efficient Preconditioner Updates for Unsymmetric Shifted Linear Systems

A Robust Two-Level Schwarz Preconditioner For Sparse Matrices

A preconditioned MINRES method for block lower triangular Toeplitz systems

Spectral analysis of block preconditioners for double saddle-point linear systems with application to PDE-constrained optimization

Absolute-value based preconditioner for complex-shifted Laplacian systems

Shift-splitting preconditioner for non-Hermitian positive definite matrices

New preconditioner strategy for solving block four-by-four linear systems: An application to the saddle-point problem from 3D Stokes equation

Ideal Preconditioners for Saddle Point Systems with a Rank-Deficient Leading Block

Polynomial Preconditioning for the Action of the Matrix Square Root and Inverse Square Root

A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations

A Class of Inexact Block Factorization Preconditioners for Indefinite Matrices with a Three-by-three Block Structure.