Abstract:The main purpose of this paper is to give a systematic introduction to a number of iterative methods for symmetric positive definite problems. Based on results and ideas from various existing works on iterative methods, a unified theory for a diverse group of iterative algorithms, such as Jacobi and GaussSeidel iterations, diagonal preconditioning, domain decomposition methods, multigrid methods, multilevel nodal basis preconditioners and hierarchical basis methods, is presented. By using the notions of space decomposition and subspace correction, all these algorithms are classified into two groups, namely parallel subspace correction (PSC) and successive subspace correction (SSC) methods. These two types of algorithms are similar in nature to the familiar Jacobi and GaussSeidel methods, respectively. A feature of this framework is that a quite general abstract convergence theory can be established. In order to apply the abstract theory to a particular problem, it is only necessary to specify a decomposition of the underlying space and the corresponding subspace solvers. For example, subspaces arising from the domain decomposition method are associated with subdomains whereas with the multigrid method subspaces are provided by multiple coarser grids. By estimating only two parameters, optimal convergence estimations for a given algorithm can be obtained as a direct consequence of the abstract theory.

Iterative Refinement of Solution with Biparameter for Solving Ill-Conditioned Systems of Linear Algebraic Equations

New Iterative Improvement of a Solution for an Ill-conditioned System of Linear Equations Based on a Linear Dynamic System

Stable iterative refinement algorithms for solving linear systems

Wilkinson’s Iterative Refinement of Solution with Automatic Step-Size Control for Linear System of Equations

A Note on Wilkinson's Iterative Refinement of Solution with Automatic Step-Size Control

Extended version with the analysis of dynamic system for iterative refinement of solution

New iterative methods for solving linear systems

A New Iterative Refinement with Roundoff Error Analysis.

A Preconditioned Iteration Method for Solving Sylvester Equations.

Iterative Refinement of Computing Inverse Matrix

Randomized Iterative Solver as Iterative Refinement: A Simple Fix Towards Backward Stability

Note on Predictor-Corrector Process for Ill-Conditioned Linear System of Equations

An Iterative Algorithm for Large Sparse Saddle Point Problems

A feasible adaptive refinement algorithm for linear semi-infinite optimization

Modified CRI iteration methods for complex symmetric indefinite linear systems

Coupled Iterative Algorithms Based on Optimisation for Solving Sylvester Matrix Equations

The AOR Iterative Method for Preconditioned Linear Systems

Mixed precision iterative refinement for linear inverse problems

On a New Iterative Method for Solving Linear Systems and Comparison Results

Iterative Methods by Space Decomposition and Subspace Correction

Solving ill-conditioned linear algebraic systems using methods that improve conditioning