Abstract:Consider the linear ill-posed problems of the form $\sum_{i=1}^{b} A_i x_i =y$, where, for each $i$, $A_i$ is a bounded linear operator between two Hilbert spaces $X_i$ and ${\mathcal Y}$. When $b$ is huge, solving the problem by an iterative method using the full gradient at each iteration step is both time-consuming and memory insufficient. Although randomized block coordinate decent (RBCD) method has been shown to be an efficient method for well-posed large-scale optimization problems with a small amount of memory, there still lacks a convergence analysis on the RBCD method for solving ill-posed problems. In this paper, we investigate the convergence property of the RBCD method with noisy data under either {\it a priori} or {\it a posteriori} stopping rules. We prove that the RBCD method combined with an {\it a priori} stopping rule yields a sequence that converges weakly to a solution of the problem almost surely. We also consider the early stopping of the RBCD method and demonstrate that the discrepancy principle can terminate the iteration after finite many steps almost surely. For a class of ill-posed problems with special tensor product form, we obtain strong convergence results on the RBCD method. Furthermore, we consider incorporating the convex regularization terms into the RBCD method to enhance the detection of solution features. To illustrate the theory and the performance of the method, numerical simulations from the imaging modalities in computed tomography and compressive temporal imaging are reported.

On convergence of the block Lanczos method for the CDT subproblem

A Block Lanczos Method for the CDT Subproblem

On the Convergence of the Accelerated Riccati Iteration Method.

Convergence of the block Lanczos method for the trust‐region subproblem in the hard case

Block Coordinate Descent Methods for Structured Nonconvex Optimization with Nonseparable Constraints: Optimality Conditions and Global Convergence

Convergence depth control for interior point methods

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

On the Convergence Analysis of the Alternating Direction Method of Multipliers with Three Blocks

A BLOCK LANCZOS METHOD FOR THE EXTENDED TRUST-REGION SUBPROBLEM

Randomized block coordinate descent method for linear ill-posed problems

A sketch-and-project method for solving the matrix equation AXB = C

Convergence Rate of the Relaxed CQ Algorithm under Hölderian Type Error Bound Property

On the Convergence of the Randomized Block Kaczmarz Algorithm for Solving a Matrix Equation

A block Lanczos method for large-scale quadratic minimization problems with orthogonality constraints

On the Flexibility of Block Coordinate Descent for Large-Scale Optimization.

On convergence of the generalized Lanczos trust-region method for trust-region subproblems

On global randomized block Kaczmarz algorithm for solving large-scale matrix equations

The Convergence of the Generalized Lanczos Trust-Region Method for the Trust-Region Subproblem

The Convergence of Krylov Subspace Methods for Large Unsymmetric Linear Systems

Convergence of the Cyclic and Quasi-cyclic Block Jacobi Methods