Abstract:Due to all kinds of need of customers and the complicated transmitting environment of digital image and video resources, numerous practical applications emerge, e.g. Image in painting, interpolation, super-resolution and the removal of salt and pepper noise. One thing these cases all have in common is that there are plenty of missing pixels randomly distributed in an image. Existing image restoration methods aiming at solving this problem include kernel regression [1], matrix completion [2] and total variation (TV) model [3]. The 3-D AR model has also been proposed to detect and interpolate the missing data in video sequences. However, the missing rate or missing region in these papers is usually small. With the missing rate increasing, known pixels in a local neighborhood are not going to be enough to form a solvable linear system. Thus, generally speaking, AR model is not suitable for image restoration from high missing rates. Nevertheless, with proper preliminary processing as proposed in this paper, AR models can be well utilized and present good results even in high missing rates. In this paper, we propose a novel method for image restoration. For the first time, the 3-D AR model is utilized in a single image to simultaneously measure correlation within and between similar patches. 2-D AR model combining with a multiscale structure reconstruct the image using its low-resolution versions to preserve important perceptual statistics such as edges. After obtaining the preliminary reconstruction of the reconstructed full size image, similar patches are collected and the 3-D AR model is applied to form a more local-consistent patch set. Then, an iterative singular value thresholding (SVT) method is utilized to solve the low-rank minimization problem. Instead of aggregating all the overlapped patches after each patch set is processed, we perform SVT for each patch set and aggregate all the overlapped patches into an intermediate image, then the iterative regularization is carried out on the image to produce the newly output for next iteration. Experimental results demonstrate that the proposed method achieves higher PSNR and SSIM than state-of-the-art methods [1-3] and the processed images possess a better visual quality especially in edge structures and texture regions.

An Overview of Image Restoration Based on Variational Regularization

Research of Image Restoration Algorithms

Experimental Research 0n Image Restoration Algorithms for Special Application

Guided Regularization and its Application for Image Restoration

The review on infrared image restoration techniques

Variational Deep Image Restoration

Variational image segmentation model coupled with image restoration achievements

A multi-parameter regularization model for image restoration

Deep Variational Network Toward Blind Image Restoration

Hybrid regularization inspired by total variation and deep denoiser prior for image restoration

Image Restoration using Total Variation Regularized Deep Image Prior

Image Restoration: Total Variation, Wavelet Frames, and Beyond

Restoring Poissonian Images By A Combined First-Order And Second-Order Variation Approach

A survey of deep learning approaches to image restoration

High-Order Total Variation-Based Image Restoration with Spatially Adapted Parameter Selection

A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration

High-quality image restoration from partial random samples in spatial domain.

Image Restoration Based on 3-D Autoregressive Model via Low-Rank Minimization

A Total Fractional-Order Variation Model for Image Restoration with Non-homogeneous Boundary Conditions and its Numerical Solution