Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 44, Issue 1, Page 212-239, March 2023. We propose a new deterministic Kaczmarz algorithm for solving consistent linear systems [math]. Basically, the algorithm replaces orthogonal projections with reflections in the original scheme of Stefan Kaczmarz. Building on this, we give a geometric description of solutions of linear systems. Suppose [math] is [math], we show that the algorithm generates a series of points distributed with patterns on an [math]-sphere centered on a solution. These points lie evenly on [math] lower-dimensional spheres [math], with the property that for any [math], the midpoint of the centers of [math] is exactly a solution of [math]. With this discovery, we prove that taking the average of [math] points on any [math] effectively approximates a solution up to relative error [math], where [math] characterizes the eigengap of the orthogonal matrix produced by the product of [math] reflections generated by the rows of [math]. We also analyze the connection between [math] and [math], the condition number of [math]. In the worst case [math], while for random matrices [math] on average. Finally, we prove that the algorithm indeed solves the linear system [math], where [math] is the lower-triangular matrix such that [math]. The connection between this linear system and the original one is studied. The numerical tests indicate that this new Kaczmarz algorithm has comparable performance to randomized (block) Kaczmarz algorithms.

A New Algorithm for Linear Systems of the Pascal Type

Fast and Stable Pascal Matrix Algorithms

Some Preconditioners for Block Pentadiagonal Linear Systems Based on New Approximate Factorization Methods

Linear System Based Approach for Solving Some Related Problems of M-matrices

An efficient variant of the greedy block Kaczmarz algorithm for solving large linear systems

An efficient numerical algorithm for solving linear systems with cyclic tridiagonal coefficient matrices

A Deterministic Kaczmarz Algorithm for Solving Linear Systems

A doubly stochastic block Gauss-Seidel algorithm for solving linear equations

Symbolic algorithm for solving cyclic penta-diagonal linear systems

A Structure Preserving Matrix Factorization for Solving General Periodic Pentadiagonal Toeplitz Linear Systems.

A Parallel Algorithm for Solving a Kind of Special Structured Linear Systems

A greedy block Kaczmarz algorithm for solving large-scale linear systems

A Method for Solving Large Size Linear Algebraic Equations

Hardness Results for Structured Linear Systems

Fast and Accurate Randomized Algorithms for Linear Systems and Eigenvalue Problems

Iterative methods for solving factorized linear systems

Two Symbolic Algorithms for Solving General Periodic Pentadiagonal Linear Systems

Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations

A two-step algorithm for solving singular linear systems with index one.

Randomized Iterative Methods for Linear Systems