Abstract:Due to all kinds of need of customers and the complicated transmitting environment of digital image and video resources, numerous practical applications emerge, e.g. Image in painting, interpolation, super-resolution and the removal of salt and pepper noise. One thing these cases all have in common is that there are plenty of missing pixels randomly distributed in an image. Existing image restoration methods aiming at solving this problem include kernel regression [1], matrix completion [2] and total variation (TV) model [3]. The 3-D AR model has also been proposed to detect and interpolate the missing data in video sequences. However, the missing rate or missing region in these papers is usually small. With the missing rate increasing, known pixels in a local neighborhood are not going to be enough to form a solvable linear system. Thus, generally speaking, AR model is not suitable for image restoration from high missing rates. Nevertheless, with proper preliminary processing as proposed in this paper, AR models can be well utilized and present good results even in high missing rates. In this paper, we propose a novel method for image restoration. For the first time, the 3-D AR model is utilized in a single image to simultaneously measure correlation within and between similar patches. 2-D AR model combining with a multiscale structure reconstruct the image using its low-resolution versions to preserve important perceptual statistics such as edges. After obtaining the preliminary reconstruction of the reconstructed full size image, similar patches are collected and the 3-D AR model is applied to form a more local-consistent patch set. Then, an iterative singular value thresholding (SVT) method is utilized to solve the low-rank minimization problem. Instead of aggregating all the overlapped patches after each patch set is processed, we perform SVT for each patch set and aggregate all the overlapped patches into an intermediate image, then the iterative regularization is carried out on the image to produce the newly output for next iteration. Experimental results demonstrate that the proposed method achieves higher PSNR and SSIM than state-of-the-art methods [1-3] and the processed images possess a better visual quality especially in edge structures and texture regions.

Low Rank Recovery Based Image Interpolation Using Local And Nonlocal Modeling

Non-Local Image Inpainting Using Low-Rank Matrix Completion: Non-Local Image Inpainting Using Low-Rank Matrix Completion

Remote Sensing Image Reconstruction Method Based on Non-Local Similarity and Low Rank Matrix

Nonlocal low-rank matrix completion for image interpolation using edge detection and neural network

Weighted-encoding-based Image Interpolation with the Nonlocal Linear Regression Model.

Weighted Encoding Based Image Interpolation With Nonlocal Linear Regression Model

Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling

High-quality Image Interpolation Via Local Autoregressive and Nonlocal 3-D Sparse Regularization

Image Interpolation Via Regularized Local Linear Regression

Reweighted Low-Rank Matrix Recovery and Its Application in Image Restoration

Robust image restoration via adaptive low-rank approximation and joint kernel regression.

Image Restoration Based on 3-D Autoregressive Model via Low-Rank Minimization

Adaptive Structured Low Rank Algorithm For Mr Image Recovery

Sparse Representation Based Single Image Super-Resolution with Low-Rank Constraint and Nonlocal Self-Similarity

Image Inpainting Based on Low-Rank and Joint-Sparse Matrix Recovery

Robust Image Restoration via Reweighted Low-Rank Matrix Recovery

Mmse-Directed Linear Image Interpolation Based on Nonlocal Geometric Similarity

Improved autoregressive image model estimation for directional image interpolation

Inter Prediction Based on Low-rank Matrix Completion

Local and Nonlocal Regularization to Image Interpolation

Low rank regularization exploiting intra and inter patch correlation for image denoising