Abstract:Kaczmarz's alternating projection method has been widely used for solving mostly over-determined linear system of equations A x = b in various fields of engineering, medical imaging, and computational science. Because of its simple iterative nature with light computation, this method was successfully applied in computerized tomography. Since tomography generates a matrix A with highly coherent rows, randomized Kaczmarz algorithm is expected to provide faster convergence as it picks a row for each iteration at random, based on a certain probability distribution. Since Kaczmarz's method is a subspace projection method, the convergence rate for simple Kaczmarz algorithm was developed in terms of subspace angles. This paper provides analyses of simple and randomized Kaczmarz algorithms and explains the link between them. New versions of randomization are proposed that may speed up convergence in the presence of nonuniform sampling, which is common in tomography applications. It is anticipated that proper understanding of sampling and coherence with respect to convergence and noise can improve future systems to reduce the cumulative radiation exposures to the patient. Quantitative simulations of convergence rates and relative algorithm benchmarks have been produced to illustrate the effects of measurement coherency and algorithm performance, respectively, under various conditions in a real-time kernel.

Choosing relaxation parameter in randomized Kaczmarz method

Strong underrelaxation in Kaczmarz's method for inconsistent systems

Preasymptotic convergence of randomized Kaczmarz method

The standard form and convergence theory of the relaxation Kaczmarz-Tanabe method for solving linear systems

Parameter Estimation and Statistical Noise Reduction for Low-Dose CT Sinogram

Accelerating the distributed Kaczmarz algorithm by strong over-relaxation

Rates of convergence of randomized Kaczmarz algorithms in Hilbert spaces

Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems

An Optimal Scheduled Learning Rate for a Randomized Kaczmarz Algorithm

Acceleration of Randomized Kaczmarz Method via the Johnson-Lindenstrauss Lemma

On the Error Estimate of the Randomized Double Block Kaczmarz Method

On the Randomized Kaczmarz Algorithm

Randomized Extended Kaczmarz for Solving Least-Squares

Kaczmarz Iterative Projection and Nonuniform Sampling with Complexity Estimates

A Note on the Behavior of the Randomized Kaczmarz Algorithm of Strohmer and Vershynin

Almost Sure Convergence of the Kaczmarz Algorithm with Random Measurements

Deterministic Versus Randomized Kaczmarz Iterative Projection

A subspace constrained randomized Kaczmarz method for structure or external knowledge exploitation

Sparse Sampling Kaczmarz-Motzkin Method with Linear Convergence

Randomized Kaczmarz with geometrically smoothed momentum

Error estimates of Kaczmarz and randomized Kaczmarz methods