Abstract:Solving symmetric positive semidefinite linear systems is an essential task in many scientific computing problems. While Jacobi-type methods, including the classical Jacobi method and the weighted Jacobi method, exhibit simplicity in their forms and friendliness to parallelization, they are not attractive either because of the potential convergence failure or their slow convergence rate. This paper aims to showcase the possibility of improving classical Jacobi-type methods by employing Nesterov's acceleration technique that results in an accelerated Jacobi-type method with improved convergence properties. Simultaneously, it preserves the appealing features for parallel implementation. In particular, we show that the proposed method has an $O\left(\frac{1}{t^2}\right)$ convergence rate in terms of objective function values of the associated convex quadratic optimization problem, where $t\geq 1$ denotes the iteration counter. To further improve the practical performance of the proposed method, we also develop and analyze a restarted variant of the method, which is shown to have an $O\left(\frac{(\log_2(t))^2}{t^2}\right)$ convergence rate when the coefficient matrix is positive definite. Furthermore, we conduct appropriate numerical experiments to evaluate the efficiency of the proposed method. Our numerical results demonstrate that the proposed method outperforms the classical Jacobi-type methods and the conjugate gradient method and shows a comparable performance as the preconditioned conjugate gradient method with a diagonal preconditioner. Finally, we develop a parallel implementation and conduct speed-up tests on some large-scale systems. Our results indicate that the proposed framework is highly scalable.

Jacobi method for symmetric $4\times4$ matrices converges for every cyclic pivot strategy

On the global convergence of the Jacobi method for symmetric matrices of order 4 under parallel strategies

Convergence of the Cyclic and Quasi-cyclic Block Jacobi Methods

On the convergence of complex Jacobi methods

Convergence of the complex block Jacobi methods under the generalized serial pivot strategies

Convergence of the Eberlein diagonalization method under the generalized serial pivot strategies

A Sorted Partial Jacobi Method and Its Convergence Analysis

Pivot Selection Strategies in Jacobi Joint Block-Diagonalization

On the global convergence of the block Jacobi method for the positive definite generalized eigenvalue problem

Convergence of a Jacobi-type method for the approximate orthogonal tensor diagonalization

Global Convergence of Hessenberg Shifted QR I: Exact Arithmetic

Randomly Pivoted Partial Cholesky: Random How?

On positive Jacobi matrices with compact inverses

On pairs of complementary GJ pivoting transforming skew-symmetric matrices

The Joint Bidiagonalization of a Matrix Pair with Inaccurate Inner Iterations

A Convergence Analysis of the Inexact Rayleigh Quotient Iteration and Simplified Jacobi-Davidson Method for the Large Hermitian Matrix Eigenproblem

Nesterov's Accelerated Jacobi-Type Methods for Large-scale Symmetric Positive Semidefinite Linear Systems

Comparison Results Between Jacobi and Other Iterative Methods

Application of the Schur-Cohn Theorem to the precise convergence domain for a p-cyclic SOR iteration matrix

Approximate joint diagonalization by nonorthogonal nonparametric Jacobi transformations

A shift‐splitting Jacobi‐gradient iterative algorithm for solving the matrix equation AV−V ̅B=C