Abstract:We consider the solution of the $\ell_1$ regularized image deblurring problem using isotropic and anisotropic regularization implemented with the split Bregman algorithm. For large scale problems, we replace the system matrix $A$ using a Kronecker product approximation obtained via an approximate truncated singular value decomposition for the reordered matrix $\mathcal{R}(A)$. To obtain the approximate decomposition for $\mathcal{R}(A)$ we propose the enlarged Golub Kahan Bidiagonalization algorithm that proceeds by enlarging the Krylov subspace beyond either a given rank for the desired approximation, or uses an automatic stopping test that provides a suitable rank for the approximation. The resultant expansion is contrasted with the use of the truncated and the randomized singular value decompositions with the same number of terms. To further extend the scale of problem that can be considered we implement the determination of the approximation using single precision, while performing all steps for the regularization in standard double precision. The reported numerical tests demonstrate the effectiveness of applying the approximate single precision Kronecker product expansion for $A$, combined with either isotropic or anisotropic regularization implemented using the split Bregman algorithm, for the solution of image deblurring problems. As the size of the problem increases, our results demonstrate that the major costs are associated with determining the Kronecker product approximation, rather than with the cost of the regularization algorithm. Moreover, the enlarged Golub Kahan Bidiagonalization algorithm competes favorably with the randomized singular value decomposition for estimating the approximate singular value decomposition.

A Partial Splitting Augmented Lagrangian Method for Low Patch-Rank Image Decomposition

Non-Local Image Inpainting Using Low-Rank Matrix Completion: Non-Local Image Inpainting Using Low-Rank Matrix Completion

A DECOMPOSITION AUGMENTED LAGRANGIAN METHOD FOR LOW-RANK SEMIDEFINITE PROGRAMMING

Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization

A Low-Rank ADMM Splitting Approach for Semidefinite Programming

Exact Decomposition of Joint Low Rankness and Local Smoothness Plus Sparse Matrices

Adaptive Parallelizable Algorithms for Interpolative Decompositions via Partially Pivoted LU

A Partially Parallel Splitting Method for Multiple-Block Separable Convex Programming with Applications to Robust Pca

Beyond Low Rank + Sparse: Multiscale Low Rank Matrix Decomposition

Split Bregman Isotropic and Anisotropic Image Deblurring with Kronecker Product Sum Approximations using Single Precision Enlarged-GKB or RSVD Algorithms to provide low rank truncated SVDs

An Inexact Dual Alternating Direction Method of Multipliers for Image Decomposition and Restoration

A Bregman-style Partially Symmetric Alternating Direction Method of Multipliers for Nonconvex Multi-block Optimization

A New Insight on Augmented Lagrangian Method with Applications in Machine Learning

A Splitting Method for Orthogonality Constrained Problems

Structure-Aware Analyses and Algorithms for Interpolative Decompositions

Low-Rank Tensor Approximation with Laplacian Scale Mixture Modeling for Multiframe Image Denoising

A distributed Douglas-Rachford splitting method for solving linear constrained multi-block weakly convex problems

An Augmented Lagrangian Coordination-Decomposition Algorithm for Solving Distributed Non-Convex Programs

Efficient Orthogonal Decomposition with Automatic Basis Extraction for Low-Rank Matrix Approximation

SPARSE AND LOW-RANK MATRIX DECOMPOSITION VIA ALTERNATING DIRECTION METHOD

Recursive sparse LU decomposition based on nested dissection and low rank approximations