Abstract:The Kaczmarz method is a classical while effective iteration method for solving very large-scale consistent systems of linear equations, and the randomized Kaczmarz method is an important and valuable variant of the Kaczmarz method. By theoretically analyzing and numerically experimenting several criteria typically adopted in the non-randomized and the randomized Kaczmarz method for selecting the working row, we derive sharper upper bounds for the convergence rates of some of the correspondingly induced Kaczmarz-type methods including those with respect to the maximal residual, maximal distance, and distance selection rules of the working row, and, for this whole suite of iteration methods consisting of the Kaczmarz methods with respect to the uniform, non-uniform, residual, distance, maximal residual, and maximal distance selection rules of the working row, we reveal their comparable relationships in terms of both mean-squared distance and mean-squared error, and show their computational effectiveness and numerical robustness based upon implementing a large number of test examples. Here the mean-squared distance is defined as the mean-value of the squared Euclidean norm of the current update increment of the iteration, and the mean-squared error is defined as the mean-value of the squared Euclidean norm of the current error that is the difference between the current iterate and the true solution of the target linear system.

Correction to: convergence rates for Kaczmarz-type algorithms

On the Convergence of the Accelerated Riccati Iteration Method.

Convergence rates for Kaczmarz-type algorithms

Kantorovich-Type Convergence Criterion for Inexact Newton Methods

A correction of "On the numerical ranges of matrices in max algebra", Banach J. Math. Anal. 14 (2020), 1773-1792

Erratum: Dynamics of the Bounds of Squared Concurrence [phys. Rev. A 79, 032306 (2009)]

Corrections to “Equivocations, Exponents and Second-Order Coding Rates under Various Rényi Information Measures”

Corrigendum to the paper, "A new iteration process for approximation of common fixed points for finite families of total asymtotically nonexpansive mappings". Int. J. Math. Math. Sci. vol. 2009, doi:10.1155/2009/615107

Convergence rates of the Kaczmarz-Tanabe method for linear systems

Convergence Rates for Greedy Kaczmarz Algorithms, and Faster Randomized Kaczmarz Rules Using the Orthogonality Graph

Corrigendum to “Linear operators, the Hurwitz zeta function and Dirichlet L-functions” [J. Number Theory 217 (2020) 422–442]

A comment on the article "The Schwarz alternating method in solid mechanics" by Alejandro Mota, Irina Tezaur and Coleman Alleman [Comput. Methods Appl. Mech. Engrg. 319 (2017) 1951]

Corrigendum to "Applications of Strassen's theorem and Choquet theory to optimal transport problems, to uniformly convex functions and to uniformly smooth functions"

On the Convergence Rate of a Quasi-Newton Method for Inverse Eigenvalue Problems

Kantorovich's type theorems for systems of equations with constant rank derivatives

Preasymptotic convergence of randomized Kaczmarz method

Remarks on Kaczmarz Algorithm for Solving Consistent and Inconsistent System of Linear Equations

On Convergence Rates of Kaczmarz-Type Methods with Different Selection Rules of Working Rows

On the Error Estimate of the Randomized Double Block Kaczmarz Method

On the exponential convergence of the Kaczmarz algorithm

Concrete convergence rates for common fixed point problems under Karamata regularity