Abstract:The main purpose of this paper is to give a systematic introduction to a number of iterative methods for symmetric positive definite problems. Based on results and ideas from various existing works on iterative methods, a unified theory for a diverse group of iterative algorithms, such as Jacobi and GaussSeidel iterations, diagonal preconditioning, domain decomposition methods, multigrid methods, multilevel nodal basis preconditioners and hierarchical basis methods, is presented. By using the notions of space decomposition and subspace correction, all these algorithms are classified into two groups, namely parallel subspace correction (PSC) and successive subspace correction (SSC) methods. These two types of algorithms are similar in nature to the familiar Jacobi and GaussSeidel methods, respectively. A feature of this framework is that a quite general abstract convergence theory can be established. In order to apply the abstract theory to a particular problem, it is only necessary to specify a decomposition of the underlying space and the corresponding subspace solvers. For example, subspaces arising from the domain decomposition method are associated with subdomains whereas with the multigrid method subspaces are provided by multiple coarser grids. By estimating only two parameters, optimal convergence estimations for a given algorithm can be obtained as a direct consequence of the abstract theory.

A two-step GS-Type iterative method

Block monotone iterative methods for solving coupled systems of nonlinear elliptic problems

Symmetric Gauss-Seidel Method with a Preconditioned Fixed-Point Iteration for the Steady-State Boltzmann equation

A New Parallel Gauss-Seidel Method by Iteration Space Alternate Tiling

A Two‐Step Matrix‐Splitting Iterative Method for Solving the Generalized Absolute Value Equation

A two-step Broyden-like method for nonlinear equations

A symmetric Gauss-Seidel method for the steady-state Boltzmann equation

A two-step algorithm for solving singular linear systems with index one.

An Efficient Iterative Approach to Large Sparse Nonlinear Systems with Non-Hermitian Jacobian Matrices

Aitken delta-squared generalized Juncgk-type iterative procedure

Newton-type Methods for Inverse Singular Value Problems with Multiple Singular Values

A general alternating direction implicit iteration method for solving complex symmetric linear systems

Explicit Gautschi-type Integrators for Nonlinear Multi-Frequency Oscillatory Second-Order Initial Value Problems

A dual-parameter double-step splitting iteration method for solving complex symmetric linear equations

A doubly stochastic block Gauss-Seidel algorithm for solving linear equations

Two-Step Fifth-Order Efficient Jacobian-Free Iterative Method for Solving Nonlinear Systems

An Improved Two‐Step Method for Inverse Eigenvalue Problems

Convergence Properties of an Iterative Method for Solving Symmetric Non-linear Equations

Iterative Methods by Space Decomposition and Subspace Correction

Randomized symmetric Gauss-Seidel method for solving linear least squares problems

The variable two-step BDF method for parabolic equations