Abstract:Randomized block Kaczmraz method plays an important role in solving large-scale linear system. One of the key points of this type of methods is how to effectively select working rows. However, in most of the state-of-the-art randomized block Kaczmarz-type methods, one has to scan all the rows of the coefficient matrix in advance for computing probabilities or paving, or to compute the residual vector of the linear system in each iteration to determine the working rows. Thus, we have to access all the rows of the data matrix in these methods, which are unfavorable for big-data problems. Moreover, to the best of our knowledge, how to efficiently choose working rows in randomized block Kaczmarz-type methods for multiple linear systems is still an open problem. In order to deal with these problems, we propose semi-randomized block Kaczmarz methods with simple random sampling for linear systems with single and multiple right-hand sides, respectively. In these methods, there is no need to scan or pave all the rows of the coefficient matrix, nor to compute probabilities and the residual vector of the linear system in each step. Specifically, one can update all the solutions of a large-scale linear system with multiple right-hand sides simultaneously. The convergence of the proposed methods is considered. Numerical experiments on both real-world and synthetic data sets show that the proposed methods are superior to many state-of-the-art randomized Kaczmarz-type methods for large-scale linear systems.

A doubly stochastic block Gauss-Seidel algorithm for solving linear equations

Pseudoinverse-free randomized block iterative algorithms for consistent and inconsistent linear systems

An efficient variant of the greedy block Kaczmarz algorithm for solving large linear systems

Randomized symmetric Gauss-Seidel method for solving linear least squares problems

Iterative methods for solving factorized linear systems

On the Convergence of the Randomized Block Kaczmarz Algorithm for Solving a Matrix Equation

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

On generalized local Hermitian and skew-Hermitian splitting iterative method for block two-by-two linear systems.

On a Fast Deterministic Block Kaczmarz Method for Solving Large-Scale Linear Systems.

A novel greedy Gauss-Seidel method for solving large linear least squares problem

A greedy block Kaczmarz algorithm for solving large-scale linear systems

Randomized double and triple Kaczmarz for solving extended normal equations

On pseudoinverse-free randomized methods for linear systems: Unified framework and acceleration

A quantile-based block Kaczmarz algorithm for solving large consistent linear systems

Semi-randomized block Kaczmarz methods with simple random sampling for large-scale linear systems

On greedy randomized average block Kaczmarz method for solving large linear systems

Randomized Iterative Methods for Linear Systems

On maximum residual block Kaczmarz method for solving large consistent linear systems

Remarks on Kaczmarz Algorithm for Solving Consistent and Inconsistent System of Linear Equations