Abstract:We consider the solution of the $\ell_1$ regularized image deblurring problem using isotropic and anisotropic regularization implemented with the split Bregman algorithm. For large scale problems, we replace the system matrix $A$ using a Kronecker product approximation obtained via an approximate truncated singular value decomposition for the reordered matrix $\mathcal{R}(A)$. To obtain the approximate decomposition for $\mathcal{R}(A)$ we propose the enlarged Golub Kahan Bidiagonalization algorithm that proceeds by enlarging the Krylov subspace beyond either a given rank for the desired approximation, or uses an automatic stopping test that provides a suitable rank for the approximation. The resultant expansion is contrasted with the use of the truncated and the randomized singular value decompositions with the same number of terms. To further extend the scale of problem that can be considered we implement the determination of the approximation using single precision, while performing all steps for the regularization in standard double precision. The reported numerical tests demonstrate the effectiveness of applying the approximate single precision Kronecker product expansion for $A$, combined with either isotropic or anisotropic regularization implemented using the split Bregman algorithm, for the solution of image deblurring problems. As the size of the problem increases, our results demonstrate that the major costs are associated with determining the Kronecker product approximation, rather than with the cost of the regularization algorithm. Moreover, the enlarged Golub Kahan Bidiagonalization algorithm competes favorably with the randomized singular value decomposition for estimating the approximate singular value decomposition.

Efficient Decomposition-Based Algorithms for $\ell_1$-Regularized Inverse Problems with Column-Orthogonal and Kronecker Product Matrices

Split Bregman Isotropic and Anisotropic Image Deblurring with Kronecker Product Sum Approximations using Single Precision Enlarged-GKB or RSVD Algorithms to provide low rank truncated SVDs

A Graph-based Iterative Algorithm for Inverse Problems with Local and Non-local Regularizations

Variable projection methods for separable nonlinear inverse problems with general-form Tikhonov regularization

Singular Value Decomposition Approximation via Kronecker Summations for Imaging Applications

Regularization of Linear Inverse Problems with Irregular Noise Using Embedding Operators

On the Nearest Kronecker Product Problem Under Orthonormal Constraints

A preconditioned Krylov subspace method for linear inverse problems with general-form Tikhonov regularization

Convergence Analysis of a Variable Projection Method for Regularized Separable Nonlinear Inverse Problems

Matrix Forms of Iterative Algorithms to Solve Large-Scale Discrete Ill-Posed Problems with an Application to Image Restoration.

Smooth over-parameterized solvers for non-smooth structured optimization

Generalizing the SVD of a matrix under non-standard inner product and its applications to linear ill-posed problems

A Joint Bidiagonalization Based Algorithm for Large Scale Linear Discrete Ill-posed Problems in General-Form Regularization

Parameter Selection by GCV and a $χ^2$ test within Iterative Methods for $\ell_1$-regularized Inverse Problems

Relaxed Inertial Projective Forward-backward Splitting Algorithms for Regularized Least Square Problems

Flexible Krylov Methods for Group Sparsity Regularization

Convergence of non-linear diagonal frame filtering for regularizing inverse problems

Inexact Generalized Golub-Kahan Methods for Large-Scale Bayesian Inverse Problems

Nested Bregman Iterations for Decomposition Problems

New Inexact Explicit Thresholding/shrinkage Formulas for Inverse Problems with Overlapping Group Sparsity.