Abstract:The main purpose of this paper is to give a systematic introduction to a number of iterative methods for symmetric positive definite problems. Based on results and ideas from various existing works on iterative methods, a unified theory for a diverse group of iterative algorithms, such as Jacobi and GaussSeidel iterations, diagonal preconditioning, domain decomposition methods, multigrid methods, multilevel nodal basis preconditioners and hierarchical basis methods, is presented. By using the notions of space decomposition and subspace correction, all these algorithms are classified into two groups, namely parallel subspace correction (PSC) and successive subspace correction (SSC) methods. These two types of algorithms are similar in nature to the familiar Jacobi and GaussSeidel methods, respectively. A feature of this framework is that a quite general abstract convergence theory can be established. In order to apply the abstract theory to a particular problem, it is only necessary to specify a decomposition of the underlying space and the corresponding subspace solvers. For example, subspaces arising from the domain decomposition method are associated with subdomains whereas with the multigrid method subspaces are provided by multiple coarser grids. By estimating only two parameters, optimal convergence estimations for a given algorithm can be obtained as a direct consequence of the abstract theory.

Developing iterative algorithms to solve Sylvester tensor equations

Preconditioned BiCGSTAB and BiCRSTAB methods for solving the Sylvester tensor equation

A nested divide-and-conquer method for tensor Sylvester equations with positive definite hierarchically semiseparable coefficients

Iterative Methods for Sparse Symmetric Multilinear Systems

Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations

Preconditioning techniques for generalized Sylvester matrix equations

A tensor-based approach to solving linear systems involving Kronecker sum of matrices

Numerical solution to a linear equation with tensor product structure.

Iterative Methods by Space Decomposition and Subspace Correction

Modified and accelerated relaxed gradient-based iterative algorithms for the complex conjugate and transpose matrix equations

Preconditioned Tensor Splitting AOR Iterative Methods for ℋ‐tensor Equations

The relaxed gradient based iterative algorithm for solving the generalized coupled complex conjugate and transpose Sylvester matrix equations

A new inexact fixed point iteration method for solving tensor absolute value equation

Straggler-tolerant stationary methods for linear systems

The shifted inner-outer iteration methods for solving Sylvester matrix equations

Gradient-based iterative approach for solving constrained systems of linear matrix equations

Solving the system of nonsingular tensor equations via randomized Kaczmarz-like method

Tensor Krylov subspace methods via the T-product for large Sylvester tensor equations

A Note on Wilkinson's Iterative Refinement of Solution with Automatic Step-Size Control

Preconditioned iterative method for nonsymmetric saddle point linear systems

Convergence Properties of an Iterative Method for Solving Symmetric Non-linear Equations