Abstract:Consider the linear ill-posed problems of the form $\sum_{i=1}^{b} A_i x_i =y$, where, for each $i$, $A_i$ is a bounded linear operator between two Hilbert spaces $X_i$ and ${\mathcal Y}$. When $b$ is huge, solving the problem by an iterative method using the full gradient at each iteration step is both time-consuming and memory insufficient. Although randomized block coordinate decent (RBCD) method has been shown to be an efficient method for well-posed large-scale optimization problems with a small amount of memory, there still lacks a convergence analysis on the RBCD method for solving ill-posed problems. In this paper, we investigate the convergence property of the RBCD method with noisy data under either {\it a priori} or {\it a posteriori} stopping rules. We prove that the RBCD method combined with an {\it a priori} stopping rule yields a sequence that converges weakly to a solution of the problem almost surely. We also consider the early stopping of the RBCD method and demonstrate that the discrepancy principle can terminate the iteration after finite many steps almost surely. For a class of ill-posed problems with special tensor product form, we obtain strong convergence results on the RBCD method. Furthermore, we consider incorporating the convex regularization terms into the RBCD method to enhance the detection of solution features. To illustrate the theory and the performance of the method, numerical simulations from the imaging modalities in computed tomography and compressive temporal imaging are reported.

A Block Lanczos Method for the CDT Subproblem

On convergence of the block Lanczos method for the CDT subproblem

A BLOCK LANCZOS METHOD FOR THE EXTENDED TRUST-REGION SUBPROBLEM

Study on large rotation problem of a block in discontinuous deformation analysis

A block Lanczos method for large-scale quadratic minimization problems with orthogonality constraints

A New Projected Variant of the Deflated Block Conjugate Gradient Method

On the Flexibility of Block Coordinate Descent for Large-Scale Optimization.

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

A Block-Dct Based Edge Detection Algorithm

Deflated Block Krylov Subspace Methods for Large Scale Eigenvalue Problems.

On the adaptive deterministic block coordinate descent methods with momentum for solving large linear least-squares problems

Numerical Method Improvement for a Subchannel Code

Block Variants of the Cocg and Cocr Methods for Solving Complex Symmetric Linear Systems with Multiple Right-Hand Sides

A Shifted Complex Global Lanczos Method and the Quasi-Minimal Residual Variant for the Stein-conjugate Matrix Equation X+AX¯B=C

Randomized block coordinate descent method for linear ill-posed problems

A sketch-and-project method for solving the matrix equation AXB = C

An efficient variant of the greedy block Kaczmarz algorithm for solving large linear systems

Convergence of the block Lanczos method for the trust‐region subproblem in the hard case

Inexact Block Newton Methods for Solving Nonlinear Equations

A greedy block Kaczmarz algorithm for solving large-scale linear systems