Abstract:The main purpose of this paper is to give a systematic introduction to a number of iterative methods for symmetric positive definite problems. Based on results and ideas from various existing works on iterative methods, a unified theory for a diverse group of iterative algorithms, such as Jacobi and GaussSeidel iterations, diagonal preconditioning, domain decomposition methods, multigrid methods, multilevel nodal basis preconditioners and hierarchical basis methods, is presented. By using the notions of space decomposition and subspace correction, all these algorithms are classified into two groups, namely parallel subspace correction (PSC) and successive subspace correction (SSC) methods. These two types of algorithms are similar in nature to the familiar Jacobi and GaussSeidel methods, respectively. A feature of this framework is that a quite general abstract convergence theory can be established. In order to apply the abstract theory to a particular problem, it is only necessary to specify a decomposition of the underlying space and the corresponding subspace solvers. For example, subspaces arising from the domain decomposition method are associated with subdomains whereas with the multigrid method subspaces are provided by multiple coarser grids. By estimating only two parameters, optimal convergence estimations for a given algorithm can be obtained as a direct consequence of the abstract theory.

Subspace power method for symmetric tensor decomposition

Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition

Finding tensor decompositions with sparse optimization

Tensor Decompositions for Count Data that Leverage Stochastic and Deterministic Optimization

Canonical Polyadic Decomposition via the generalized Schur decomposition

Partial orthogonal rank-one decomposition of complex symmetric tensors based on the Takagi factorization

Analyzing Tensor Power Method Dynamics in Overcomplete Regime

CP decomposition and low-rank approximation of antisymmetric tensors

Iterative Methods for Symmetric Outer Product Tensor Decompositions

Inertial Accelerated Stochastic Mirror Descent for Large-Scale Generalized Tensor CP Decomposition

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

A Fast Implementation for the Canonical Polyadic Decomposition

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

A nested divide-and-conquer method for tensor Sylvester equations with positive definite hierarchically semiseparable coefficients

Symmetry & Critical Points for Symmetric Tensor Decomposition Problems

A Multi-resolution Low-rank Tensor Decomposition

Chordal Decomposition in Operator-Splitting Methods for Sparse Semidefinite Programs

Decomposition of linear tensor transformations

A recursive eigenspace computation for the Canonical Polyadic decomposition

Iterative Methods by Space Decomposition and Subspace Correction