Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 44, Issue 1, Page 212-239, March 2023. We propose a new deterministic Kaczmarz algorithm for solving consistent linear systems [math]. Basically, the algorithm replaces orthogonal projections with reflections in the original scheme of Stefan Kaczmarz. Building on this, we give a geometric description of solutions of linear systems. Suppose [math] is [math], we show that the algorithm generates a series of points distributed with patterns on an [math]-sphere centered on a solution. These points lie evenly on [math] lower-dimensional spheres [math], with the property that for any [math], the midpoint of the centers of [math] is exactly a solution of [math]. With this discovery, we prove that taking the average of [math] points on any [math] effectively approximates a solution up to relative error [math], where [math] characterizes the eigengap of the orthogonal matrix produced by the product of [math] reflections generated by the rows of [math]. We also analyze the connection between [math] and [math], the condition number of [math]. In the worst case [math], while for random matrices [math] on average. Finally, we prove that the algorithm indeed solves the linear system [math], where [math] is the lower-triangular matrix such that [math]. The connection between this linear system and the original one is studied. The numerical tests indicate that this new Kaczmarz algorithm has comparable performance to randomized (block) Kaczmarz algorithms.

Kaczmarz Projection Algorithms with Rank Two Gain Update

Kaczmarz Projection Algorithms in Moving Window: Performance Improvement via Extended Orthogonality & Forgetting

Convergence rates for Kaczmarz-type algorithms

Single Projection Kaczmarz Extended Algorithms

Kaczmarz Iterative Projection and Nonuniform Sampling with Complexity Estimates

Convergence of projected Landweber iteration for matrix rank minimization

Deterministic Versus Randomized Kaczmarz Iterative Projection

Inertial randomized Kaczmarz algorithms for solving coherent linear systems

Kaczmarz holography: holographic projection in the Fraunhofer region

Randomized Kaczmarz algorithm with averaging and block projection

Randomized Kaczmarz iteration methods: Algorithmic extensions and convergence theory

Accelerated Kaczmarz Algorithms using History Information

Convergence Rates for Greedy Kaczmarz Algorithms, and Faster Randomized Kaczmarz Rules Using the Orthogonality Graph

On block Gaussian sketching for the Kaczmarz method

Two-subspace Projection Method for Coherent Overdetermined Systems (Technical Report)

Stability of the Kaczmarz Reconstruction for Stationary Sequences

Randomized Kaczmarz Algorithm for Inconsistent Linear Systems: An Exact MSE Analysis

Randomized block Kaczmarz method with projection for solving least squares

Nonlinear Kaczmarz algorithms and their convergence

A Deterministic Kaczmarz Algorithm for Solving Linear Systems