Abstract:Randomized block Kaczmraz method plays an important role in solving large-scale linear system. One of the key points of this type of methods is how to effectively select working rows. However, in most of the state-of-the-art randomized block Kaczmarz-type methods, one has to scan all the rows of the coefficient matrix in advance for computing probabilities or paving, or to compute the residual vector of the linear system in each iteration to determine the working rows. Thus, we have to access all the rows of the data matrix in these methods, which are unfavorable for big-data problems. Moreover, to the best of our knowledge, how to efficiently choose working rows in randomized block Kaczmarz-type methods for multiple linear systems is still an open problem. In order to deal with these problems, we propose semi-randomized block Kaczmarz methods with simple random sampling for linear systems with single and multiple right-hand sides, respectively. In these methods, there is no need to scan or pave all the rows of the coefficient matrix, nor to compute probabilities and the residual vector of the linear system in each step. Specifically, one can update all the solutions of a large-scale linear system with multiple right-hand sides simultaneously. The convergence of the proposed methods is considered. Numerical experiments on both real-world and synthetic data sets show that the proposed methods are superior to many state-of-the-art randomized Kaczmarz-type methods for large-scale linear systems.

On a Nonlinear Fast Deterministic Block Kaczmarz Method for Solving Nonlinear Equations

On a Fast Deterministic Block Kaczmarz Method for Solving Large-Scale Linear Systems.

On fast greedy block Kaczmarz methods for solving large consistent linear systems

A class of pseudoinverse-free greedy block nonlinear Kaczmarz methods for nonlinear systems of equations

A greedy block Kaczmarz algorithm for solving large-scale linear systems

An efficient variant of the greedy block Kaczmarz algorithm for solving large linear systems

A greedy average block sparse Kaczmarz method for sparse solutions of linear systems

An Accelerated Block Randomized Kaczmarz Method

Greedy randomized sampling nonlinear Kaczmarz methods

On the adaptive deterministic block Kaczmarz method with momentum for solving large-scale consistent linear systems

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

On greedy randomized average block Kaczmarz method for solving large linear systems

A new greedy Kaczmarz algorithm for the solution of very large linear systems

Greedy randomized Bregman-Kaczmarz method for constrained nonlinear systems of equations

A Novel Greedy Kaczmarz Method For Solving Consistent Linear Systems

On maximum residual block Kaczmarz method for solving large consistent linear systems

On Multi-Step Randomized Extended Kaczmarz Method for Solving Large Sparse Inconsistent Linear Systems

On the Convergence of the Randomized Block Kaczmarz Algorithm for Solving a Matrix Equation

Semi-randomized block Kaczmarz methods with simple random sampling for large-scale linear systems