Abstract:Image inpainting (also known as image interpolation or video interpolation) is an evolving topic in image engineering (IE), especially in image processing (IP) layer (Zhang, 2009). It aims to automatically improving the quality of image, by filling in the holes of image that are to be removed for artistically or confidential considerations. Research in this field is on the rise and many applications are created (Abraham, 2012; Janarthanan, 2012; Modi, 2012). How can we make computer modify an image in a visually undetectable way analogous to sophisticated artists? This is quite an amazing topic in both art and image processing areas, with applications from the restoration of damaged paintings and photographs to the removal of selected objects. Image inpainting exactly aims to reconstitute the missing region (called the target region) using information from the remaining image areas (called the source region). Until now, there are two main categories of image inpainting approaches in the literature: diffusion-based (or PDE-based) approach (Chan, 2001; Tibshirani, 1997) and exemplar-based approach (Criminisi, 2003; Shen, 2009; Wong, 2008; Xu, 2010). In the following, two recent works, one from each category, are introduced as example (some other related methods can be found in references). One uses a patch-wise inpainting algorithm with sparse representation over a redundant dictionary. It is suitable both to deal with large holes and to preserve image details while taking less risk. To ensure the visually plausibility and consistency constraints between the filled hole and the surroundings, a redundant dictionary is constructed by directly sampling from the intact source region of current image. Then, the sparse representation for each incomplete patch at the boundary of the hole is sequentially computed and recovered until the whole hole is filled. Another uses a patch propagation-inpainting algorithm based on Weighted Sparse Non-negative Matrix Factorization (WSNMF). In this approach, the inpainting task is casted as a sequential low-rank matrix recovery and completion problem, where the incomplete data matrix consists of the image patch to be inpainted and several similar intact candidate patches under the assumption that they can be described using a low-dimensional linear model.

Inpainted Image Quality Evaluation Based on Saliency Map Features

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

Image Inpainting Algorithm Based on Saliency Map and Gray Entropy

Assessing Image Inpainting Via Re-Inpainting Self-Consistency Evaluation

A Hybrid Inpainting Model Combining Diffusion and Enhanced Exemplar Methods

Image Inpainting by Multiscale Spline Interpolation

Image Inpainting by Adaptive Fusion of Variable Spline Interpolations

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

Image Inpainting With Improved Exemplar-Based Approach

An image quality assessment algorithm based on saliency and sparsity

The Improved Image Inpainting Algorithm Via Encoder and Similarity Constraint

Image Inpainting by Kriging Interpolation Technique

Digital Image Inpainting with Kriging Method

An automatic image inpaint tool

Reference Image-Assisted Auxiliary Feature Fusion in Image Inpainting

Digital image inpainting by example-based image synthesis method

HySim: An Efficient Hybrid Similarity Measure for Patch Matching in Image Inpainting

Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering

Image Inpainting as an Evolving Topic in Image Engineering

A review of advances in image inpainting research

Comparative Study of Saliency- and Scanpath-Based Approaches for Patch Selection in Image Quality Assessment