Abstract:In recent years, image priors based on nonlocal self-similarity and low-rank approximation have been proven as powerful tools for image restoration. Many restoration methods group similar patches as a matrix and recover the underlying low-rank structure from the corrupted matrix via rank minimization. However, both the nonlocally redundant and low-rank properties are highly content dependent, and whether they can faithfully characterize a wide range of natural images still remains unclear. In this paper, we analyze these two properties and provide quantifications of them in a data-driven and parametric way, respectively, obtaining the new measures of regional redundancy and nonlocal patch rank. Leveraging these prior leads to an adaptive image restoration method with content-awareness. In particular, our method iteratively removes outliers and recovers latent fine details. To handle outliers, we propose an adaptive low-rank and sparse matrix approximation algorithm to encourage the estimated nonlocal rank in the patch matrix. The guidance of regional redundancy further gives rise to the “denoise” quality. In the detail recovery step, we propose an adaptive joint kernel regression algorithm using the redundancy measure to determine the confidence of each regression group. It also bridges the gap between our online and offline dictionary learning schemes. Experiments on synthetic and real-world images show the efficacy of our method in image deblurring and super-resolution tasks, especially when subject to practical outliers such as rain drops.

Image Denoising Via Low Rank Regularization Exploiting Intra and Inter Patch Correlation

Low rank regularization exploiting intra and inter patch correlation for image denoising

Image Denoising Based on Correlation Adaptive Sparse Modeling

CAS: Correlation Adaptive Sparse Modeling for Image Denoising

Robust image restoration via adaptive low-rank approximation and joint kernel regression.

Content-Adaptive Low Rank Regularization For Image Denoising

Image Denoising Via Structure-Constrained Low-Rank Approximation

Image Denoising Via Bandwise Adaptive Modeling and Regularization Exploiting Nonlocal Similarity

Image denoising by exploring external and internal correlations.

Correlation Preserving on Graphs for Image Denoising

From Rank Estimation to Rank Approximation: Rank Residual Constraint for Image Denoising.

Hyperspectral Image Denoising via Correntropy-Based Nonconvex Low-Rank Approximation

Correlation Preserving Sparse Coding over Multi-level Dictionaries for Image Denoising.

Low-Rank Regularized Joint Sparsity for Image Denoising

From Rank Estimation to Rank Approximation: Rank Residual Constraint for Image Restoration

Integrating Local and Non-local Denoiser Priors for Image Restoration.

Joint Image Denoising Using Self-Similarity Based Low-Rank Approximations

Ensemble Dictionary Learning for Single Image Deblurring Via Low-Rank Regularization

External Patch Prior Guided Internal Clustering for Image Denoising

Image Denoising by Random Interpolation Average with Low-Rank Matrix Approximation

Weighted bilinear factorization of low-rank matrix with structural smoothness for image denoising