Abstract:The Kaczmarz method is a classical while effective iteration method for solving very large-scale consistent systems of linear equations, and the randomized Kaczmarz method is an important and valuable variant of the Kaczmarz method. By theoretically analyzing and numerically experimenting several criteria typically adopted in the non-randomized and the randomized Kaczmarz method for selecting the working row, we derive sharper upper bounds for the convergence rates of some of the correspondingly induced Kaczmarz-type methods including those with respect to the maximal residual, maximal distance, and distance selection rules of the working row, and, for this whole suite of iteration methods consisting of the Kaczmarz methods with respect to the uniform, non-uniform, residual, distance, maximal residual, and maximal distance selection rules of the working row, we reveal their comparable relationships in terms of both mean-squared distance and mean-squared error, and show their computational effectiveness and numerical robustness based upon implementing a large number of test examples. Here the mean-squared distance is defined as the mean-value of the squared Euclidean norm of the current update increment of the iteration, and the mean-squared error is defined as the mean-value of the squared Euclidean norm of the current error that is the difference between the current iterate and the true solution of the target linear system.

Convergence rates of the Kaczmarz-Tanabe method for linear systems

The standard forms and convergence theory of the Kaczmarz-Tanabe type methods for solving linear systems

The standard form and convergence theory of the relaxation Kaczmarz-Tanabe method for solving linear systems

On the Convergence of the Accelerated Riccati Iteration Method.

Error estimates of Kaczmarz and randomized Kaczmarz methods

On Convergence Rates of Kaczmarz-Type Methods with Different Selection Rules of Working Rows

Convergence rates for Kaczmarz-type algorithms

Preasymptotic convergence of randomized Kaczmarz method

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

On the exponential convergence of the Kaczmarz algorithm

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

An Inexact Cayley Transform Method for Inverse Eigenvalue Problems with Multiple Eigenvalues

Convergence properties of the randomized extended Gauss-Seidel and Kaczmarz methods

A quantile-based block Kaczmarz algorithm for solving large consistent linear systems

On Multi-step Extended Maximum Residual Kaczmarz Method for Solving Large Inconsistent Linear Systems

Randomized Kaczmarz Converges Along Small Singular Vectors

On the Convergence Rate of the Inexact Levenberg-Marquardt Method

Kantorovich's type theorems for systems of equations with constant rank derivatives

On maximum residual block Kaczmarz method for solving large consistent linear systems

A Convergence Analysis of the Inexact Uzawa Method with Variable Relaxation Parameters