Abstract:Preconditioning is at the heart of iterative solutions of large, sparse linear systems of equations in scientific disciplines. Several algebraic approaches, which access no information beyond the matrix itself, are widely studied and used, but ill-conditioned matrices remain very challenging. We take a machine learning approach and propose using graph neural networks as a general-purpose preconditioner. They show attractive performance for many problems and can be used when the mainstream preconditioners perform poorly. Empirical evaluation on over 800 matrices suggests that the construction time of these graph neural preconditioners (GNPs) is more predictable and can be much shorter than that of other widely used ones, such as ILU and AMG, while the execution time is faster than using a Krylov method as the preconditioner, such as in inner-outer GMRES. GNPs have a strong potential for solving large-scale, challenging algebraic problems arising from not only partial differential equations, but also economics, statistics, graph, and optimization, to name a few.

What problem does this paper attempt to address?

The paper aims to address the issue of preconditioner design in the iterative solution of large sparse linear systems. Specifically: 1. **Core Issue**: In scientific computing, preconditioners are crucial for solving large sparse linear systems, especially when the matrix has a poor condition number. Traditional algebraic methods (such as Incomplete LU factorization (ILU) and Algebraic Multigrid (AMG)) often perform poorly in such cases. 2. **Proposed Method**: The authors propose a general preconditioner based on Graph Neural Networks (GNN), called Graph Neural Preconditioner (GNP), to solve problems of the form \( AMu = b \), where \( M \approx A^{-1} \) is the preconditioner, \( u \) is the new unknown, and \( x = Mu \) is the recovered solution. 3. **Objective**: By training a Graph Neural Network to learn \( M \), the goal is to improve the solution of matrices with poor condition numbers and to outperform traditional methods like ILU and AMG in terms of construction time and execution time. 4. **Application Scenarios**: This method is applicable not only to matrix problems related to Partial Differential Equations (PDEs) but also to problems in fields such as economics, statistics, graph theory, and optimization. In summary, the goal of this paper is to develop a machine learning-based preconditioner to enhance the efficiency and accuracy of solving sparse linear systems, particularly when dealing with matrices with poor condition numbers.

Graph Neural Preconditioners for Iterative Solutions of Sparse Linear Systems