Abstract:A greedy randomized augmented Kaczmarz (GRAK) method was proposed in Bai and Wu for large and sparse inconsistent linear systems. However, in each iteration of this method, one has to construct two new index sets via computing residual vector with respect to the augmented linear system. Thus, the computational overhead of this method may be large for extremely large‐scale problems. Moreover, there is no reliable stopping criterion for this method. In this work, we are interested in solving large‐scale sparse or dense inconsistent linear systems, and try to enhance the numerical performance of this method. The contributions of this work are as follows. First, we propose an accelerated GRAK method. Theoretical analysis indicates that it converges faster than the GRAK method under a very weak assumption. Second, we apply the semi‐randomized Kaczmarz method to the augmented linear system, and propose a semi‐randomized augmented Kaczmarz method with simple random sampling. In this method, there is no need to access all the information of the data matrix. The convergence of the proposed methods are established. To the best of our knowledge, there are no practical stopping criteria in all randomized Kaczmarz‐type methods till now. To fill‐in this gap, the third contribution of this work is to introduce a practical stopping criterion for Kaczmarz‐type methods, and show its rationality from a theoretical point of view. Numerical results are performed on both real‐world and synthetic data sets, which demonstrate the effectiveness of the proposed stopping criterion, and illustrate that the new methods are often superior to many state‐of‐the‐art Kaczmarz methods for large‐scale inconsistent linear systems.

On Multi-step Extended Maximum Residual Kaczmarz Method for Solving Large Inconsistent Linear Systems

On multi-step extended maximum residual Kaczmarz method for solving large inconsistent linear systems

On Multi-Step Randomized Extended Kaczmarz Method for Solving Large Sparse Inconsistent Linear Systems

On maximum residual block Kaczmarz method for solving large consistent linear systems

Three double multi-step randomized extended Kaczmarz methods for solving large sparse inconsistent linear systems

A residual-based weighted nonlinear Kaczmarz method for solving nonlinear systems of equations

On fast greedy block Kaczmarz methods for solving large consistent linear systems

On a Fast Deterministic Block Kaczmarz Method for Solving Large-Scale Linear Systems.

A quantile-based block Kaczmarz algorithm for solving large consistent linear systems

On the adaptive deterministic block Kaczmarz method with momentum for solving large-scale consistent linear systems

Remarks on Kaczmarz Algorithm for Solving Consistent and Inconsistent System of Linear Equations

Randomized Kaczmarz method with adaptive stepsizes for inconsistent linear systems

On a Nonlinear Fast Deterministic Block Kaczmarz Method for Solving Nonlinear Equations

A Novel Greedy Kaczmarz Method For Solving Consistent Linear Systems

A greedy average block sparse Kaczmarz method for sparse solutions of linear systems

A new greedy Kaczmarz algorithm for the solution of very large linear systems

An efficient variant of the greedy block Kaczmarz algorithm for solving large linear systems

On Kaczmarz method with oblique projection for solving large overdetermined linear systems

On Convergence Rates of Kaczmarz-Type Methods with Different Selection Rules of Working Rows

A Semi‐Randomized and Augmented Kaczmarz Method With Simple Random Sampling for Large‐Scale Inconsistent Linear Systems

Single projection Kaczmarz extended algorithms