Abstract:SIAM Journal on Matrix Analysis and Applications, Volume 44, Issue 1, Page 212-239, March 2023. We propose a new deterministic Kaczmarz algorithm for solving consistent linear systems [math]. Basically, the algorithm replaces orthogonal projections with reflections in the original scheme of Stefan Kaczmarz. Building on this, we give a geometric description of solutions of linear systems. Suppose [math] is [math], we show that the algorithm generates a series of points distributed with patterns on an [math]-sphere centered on a solution. These points lie evenly on [math] lower-dimensional spheres [math], with the property that for any [math], the midpoint of the centers of [math] is exactly a solution of [math]. With this discovery, we prove that taking the average of [math] points on any [math] effectively approximates a solution up to relative error [math], where [math] characterizes the eigengap of the orthogonal matrix produced by the product of [math] reflections generated by the rows of [math]. We also analyze the connection between [math] and [math], the condition number of [math]. In the worst case [math], while for random matrices [math] on average. Finally, we prove that the algorithm indeed solves the linear system [math], where [math] is the lower-triangular matrix such that [math]. The connection between this linear system and the original one is studied. The numerical tests indicate that this new Kaczmarz algorithm has comparable performance to randomized (block) Kaczmarz algorithms.

Solving systems of phaseless equations via Kaczmarz methods: a proof of concept study

PhaseMax: Stable Guarantees from Noisy Sub-Gaussian Measurements

Simultaneous Reconstruction of Phase and Amplitude for Wavefront Measurements Based on Nonlinear Optimization Algorithms

Phase Retrieval from Quantized Measurements Via Approximate Message Passing

Large-scale Phase Retrieval Method for Wavefront Reconstruction with Multi-Stage Random Phase Modulation

Practical Phase Unwrapping of Interferometric Fringes Based on Unscented Kalman Filter Technique.

Linear Convergence of an Iterative Phase Retrieval Algorithm with Data Reuse

A Deterministic Kaczmarz Algorithm for Solving Linear Systems

Phase Retrieval Using Iterative Projections: Dynamics in the Large Systems Limit

Convergence Analysis on a Fast Iterative Phase Retrieval Algorithm Without Independence Assumption

Reflective block Kaczmarz algorithms for least squares

Nonlinear Kaczmarz algorithms and their convergence

Deterministic fast and stable phase retrieval in multiple dimensions

Phase Retrieval via Linear Programming: Fundamental Limits and Algorithmic Improvements

Randomized Extended Kaczmarz for Solving Least-Squares

A randomized sparse Kaczmarz solver for sparse signal recovery via minimax‐concave penalty

On Multi-Step Randomized Extended Kaczmarz Method for Solving Large Sparse Inconsistent Linear Systems

The Dual Kaczmarz Algorithm

A Fast and Provable Algorithm for Sparse Phase Retrieval

Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems