Abstract:Randomized block Kaczmraz method plays an important role in solving large-scale linear system. One of the key points of this type of methods is how to effectively select working rows. However, in most of the state-of-the-art randomized block Kaczmarz-type methods, one has to scan all the rows of the coefficient matrix in advance for computing probabilities or paving, or to compute the residual vector of the linear system in each iteration to determine the working rows. Thus, we have to access all the rows of the data matrix in these methods, which are unfavorable for big-data problems. Moreover, to the best of our knowledge, how to efficiently choose working rows in randomized block Kaczmarz-type methods for multiple linear systems is still an open problem. In order to deal with these problems, we propose semi-randomized block Kaczmarz methods with simple random sampling for linear systems with single and multiple right-hand sides, respectively. In these methods, there is no need to scan or pave all the rows of the coefficient matrix, nor to compute probabilities and the residual vector of the linear system in each step. Specifically, one can update all the solutions of a large-scale linear system with multiple right-hand sides simultaneously. The convergence of the proposed methods is considered. Numerical experiments on both real-world and synthetic data sets show that the proposed methods are superior to many state-of-the-art randomized Kaczmarz-type methods for large-scale linear systems.

A class of pseudoinverse-free greedy block nonlinear Kaczmarz methods for nonlinear systems of equations

A class of pseudoinverse-free greedy block nonlinear Kaczmarz methods for nonlinear systems of equations

On a Nonlinear Fast Deterministic Block Kaczmarz Method for Solving Nonlinear Equations

A greedy average block sparse Kaczmarz method for sparse solutions of linear systems

Greedy randomized sampling nonlinear Kaczmarz methods

On fast greedy block Kaczmarz methods for solving large consistent linear systems

Greedy randomized Bregman-Kaczmarz method for constrained nonlinear systems of equations

An efficient variant of the greedy block Kaczmarz algorithm for solving large linear systems

On greedy randomized average block Kaczmarz method for solving large linear systems

On a Fast Deterministic Block Kaczmarz Method for Solving Large-Scale Linear Systems.

A greedy block Kaczmarz algorithm for solving large-scale linear systems

Semi-randomized block Kaczmarz methods with simple random sampling for large-scale linear systems

An Accelerated Block Randomized Kaczmarz Method

Nonlinear Kaczmarz algorithms and their convergence

Paved with good intentions: Analysis of a randomized block Kaczmarz method

Block Broyden's Methods for Solving Nonlinear Equations.

A Novel Greedy Kaczmarz Method For Solving Consistent Linear Systems

Randomized block Kaczmarz method with projection for solving least squares

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

A new greedy Kaczmarz algorithm for the solution of very large linear systems