INPAINTING OF BINARY IMAGES USING A PHASE-FIELDMODEL

Darae Jeong,Yibao Li,Hyun Geun Lee,Junseok Kim

2009-01-01

Abstract:Image inpainting is the filling in missing or damaged regions of images using information from surrounding areas. We compared our new modified CH equation with the modified CH eq. in previous paper [1] and developed on automatic varying ? and adaptive time step.

What problem does this paper attempt to address?

FAST AND AUTOMATIC INPAINTING OF BINARY IMAGES USING A PHASE-FIELD MODEL

Darae Jeong,Yibao Li,Hyun Geun Lee,Junseok Kim

2009-01-01

Journal of the Korea Society for Industrial and Applied Mathematics

Abstract:Image inpainting is the process of reconstructing lost or deteriorated parts of im- ages using information from surrounding areas. We propose a computationally efficient and fast phase-field method which uses automatic switching parameter, adaptive time step, and auto- matic stopping of calculation. The algorithm is based on an energy functional. We demonstrate the performance of our new method and compare it with a previous method.
Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

Zhu Yunfang,Wang Huiyan,Wang Xun,Du Xin

DOI: https://doi.org/10.1109/icvrv.2016.21

2016-01-01

Abstract:This paper introduces a novel example-based inpainting algorithm. It is different from traditional methods in two ways. First, it emphasizes the continuity of edges in filling processing because human vision system is sensitive to broken edges. Edge continuity is promised by a new measurement of similarity between texture patches, which gives different weights to different points based on their gradient magnitude during patch propagation. Second, a step of pre-editing on the best matching patch, which adjusts the patch's color according to the patches' boundary, is adopted to make it merge with surroundings more seamlessly. Experimental results show the effectiveness of the proposed algorithm, and demonstrate a better edge continuity and better fusion quality with the original image.
Inpainting of binary images using the Cahn-Hilliard equation

Andrea L Bertozzi,Selim Esedoglu,Alan Gillette

DOI: https://doi.org/10.1109/tip.2006.887728

Abstract:Image inpainting is the filling in of missing or damaged regions of images using information from surrounding areas. We outline here the use of a model for binary inpainting based on the Cahn-Hilliard equation, which allows for fast, efficient inpainting of degraded text, as well as super-resolution of high contrast images.
Inpainting Algorithm for Jacquared Image Based on Phase-Field Model

Zhilin Feng,Jianwei Yin,Jianan Zhou

DOI: https://doi.org/10.1109/iske.2008.4731113

2008-01-01

Abstract:Jacquard image inpainting is an interesting new research topic in pattern preprocessing for jacquard CAD. Phase field model has been well acknowledged as an important method for image inpainting. This paper discussed the problem of jacquard image inpainting by approaching the phase field paradigm from a numerical approximation perspective. The basic idea is to represent the damaged pattern of interest in implicit form, and fill-in the damaged parts with a system of geometric partial differential equations derived from phase-field model. The novelty of our approach lies primarily in exploiting explicitly the constraint enforced by the numerical solving of the sequential evolving of phase-field model. Extensive experiments are carried out in order to validate and compare the algorithm both quantitatively and qualitatively. They show the advantages of our algorithm and its readily application to jacquard texture.
Free-Form Image Inpainting with Separable Gate Encoder-Decoder Network

Liang Nie,Wenxin Yu,Xuewen Zhang,Si‐Yuan Li,Shiyu Chen,Zhiqiang Zhang,Jun Gong

DOI: https://doi.org/10.1007/978-3-030-92238-2_42

2021-01-01

Abstract:Image inpainting refers to the process of reconstructing damaged areas of an image. For image inpainting, there are many means to generate not too bad inpainting results today. However, these methods either make the results look unrealistic or have complex structures and a large number of parameters. In order to solve the above problems, this paper designed a simple encoder-decoder network and introduced the region normalization technique. At the same time, a new separable gate convolution is proposed. The simple network architecture and separable gate convolution significantly reduce the number of network parameters. Moreover, the separable gate convolution can learn the mask (represents the missing area) from the feature map and update it automatically. After mask update, weights will be applied to each pixel of the feature map to alleviate the impact of invalid mask information on the completed result and improve the inpainting quality. Our method reduces 0.58M parameters. Moreover, our method improved the PSNR of Celeba and Paris Street View by 0.7–1.4 dB and 0.7–1.0 dB, respectively, in 10% to 60% damage cases. The corresponding SSIM has been increased 1.6 to 2.7 and 0.9 to 2.3%.
An efficient and explicit local image inpainting method using the Allen–Cahn equation

Jian Wang,Ziwei Han,Junseok Kim

DOI: https://doi.org/10.1007/s00033-023-02184-6

2024-02-28

Zeitschrift für angewandte Mathematik und Physik

Abstract:Image inpainting is the process of restoring damaged areas in an image using information available from neighboring regions. In this paper, we present a novel, efficient, and simple local image inpainting algorithm based on the Allen–Cahn (AC) equation with a fidelity term. We utilize the phase separation property of the AC equation and introduce a new phase-dependent fidelity parameter to preserve the original values in the neighboring regions of an inpainting region. The governing partial differential equation is solved using the finite difference method, with the values of the neighboring cells serving as the Dirichlet boundary condition. The proposed algorithm is both local and explicit, making it is fast and easy to implement. We demonstrate the performance of the proposed model through several numerical experiments. Furthermore, comparing this method to other image inpainting methods demonstrates its superiority in image inpainting.

mathematics, applied
Partial Differential Equation Inpainting Method Based on Image Characteristics.

Fang Zhang,Ying Chen,Zhitao Xiao,Lei Geng,Jun Wu,Tiejun Feng,Ping Liu,Yufei Tan,Jinjiang Wang

DOI: https://doi.org/10.1007/978-3-319-21969-1_2

2015-01-01

Abstract:Inpainting is an image processing method to automatically restore the lost information according to the existing image information. Inpainting has great application on restoration of the lost information for photographs, text removal of image, and recovery for the loss coding of image, etc. Image restoration based on partial differential equation (PDE) is an important repair technology. To overcome the shortcomings of the existing PDEs in repair process, such as false edge, incomplete interpolation information, a new PDE for image restoration based on image characteristics is proposed. The new PDE applies different diffusion mode for image pixels with the different characteristics, which can effectively protect the edges, angular points, and other important characteristics of the image during the repair process. The experimental results in both gray images and color images show that our method can obviously improve the image visual effect after inpainting compared with different traditional diffusion models.
An Image Inpainting Approach Based on the Poisson Equation

Xiaowei Shao,Zhengkai Liu,Houqiang Li

DOI: https://doi.org/10.1109/dial.2006.3

2008-01-01

Abstract:A novel algorithm is proposed for inpainting digital images based on the Poisson equation. In this method, the image to be repaired is decomposed into the structure image and the texture image, which are processed respectively according to their image characteristics. The texture image is repaired by the exemplar-based method; for the structure image, the Laplacian operator is employed to enhance the structure information, and the Laplacian image is inpainted by the exemplar-based algorithm, followed by a reconstruction based on the Poisson equation. The inpainting result is obtained by adding back these two sub-images. Experiments show the proposed algorithm provides a better visual effect, especially for large area inpainting
Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

Kai Luo,Dong-xiao Li,Ya-mei Feng,Ming Zhang

DOI: https://doi.org/10.1631/jzus.a0820806

2009-01-01

Abstract:A new algorithm is proposed for restoring disocclusion regions in depth-image-based rendering (DIBR) warped images. Current solutions include layered depth image (LDI), pre-filtering methods, and post-processing methods. The LDI is complicated, and pre-filtering of depth images causes noticeable geometrical distortions in cases of large baseline warping. This paper presents a depth-aided inpainting method which inherits merits from Criminisi's inpainting algorithm. The proposed method features incorporation of a depth cue into texture estimation. The algorithm efficiently handles depth ambiguity by penalizing larger Lagrange multipliers of filling points closer to the warping position compared with the surrounding existing points. We perform morphological operations on depth images to accelerate the algorithm convergence, and adopt a luma-first strategy to adapt to various color sampling formats. Experiments on test multi-view sequence showed that our method has superiority in depth differentiation and geometrical loyalty in the restoration of warped images. Also, peak signal-to-noise ratio (PSNR) statistics on non-hole regions and whole image comparisons both compare favorably to those obtained by state of the art techniques.
A Progressive Image Inpainting Algorithm with a Mask Auto-update Branch

Liang Nie,Wenxin Yu,Xuewen Zhang,Siyuan Li,Ning Jiang,Zhiqiang Zhang

DOI: https://doi.org/10.1007/978-3-030-86340-1_49

2021-01-01

Abstract:Recently, learning-based image inpainting methods have made inspiring progress with squared or irregular holes. The generative adversarial networks (GANs) have been able to produce visually realistic and semantically correct results. However, most existing methods generate the results by one stage. They may have a slight advantage in computation time, but more information is lost during the inpainting process. Due to the lack of sufficient context information, these inpainting approaches cannot inpaint large holes in natural images very well. This paper proposes a progressive image inpainting algorithm for solving the above problem. This algorithm synthesizes different image components in a parallel manner within one stage. Moreover, this paper design a branch, which transmits the image features to the generative model iteratively. In each iteration, we adopt a mask auto-updating mechanism to shrink the boundary of a hole. Finally, the generative component can shrink the large corrupted regions in natural images and yield promising inpainting results.
Highly Efficient Local Non-Texture Image Inpainting Based on Partial Differential Equation

Chuang Zhu,Huizhu Jia,Meng Li,Xiaofeng Huang,Xiaodong Xie

DOI: https://doi.org/10.1109/CSE.2014.164

2014-01-01

Abstract:Image in painting has been a popular study point in recent years and a number of strategies have been developed. Partial differential equation (PDE) image in painting approach often acts as a fundamental building block in this area. However, the high computing load limits the application of PDE-based image in painting, especially in mobile terminal. In this paper, first an enhanced Curvature-Driven Diffusions (ECDD) model is proposed to improve the repairing performance. Then a fast local non-texture in painting scheme is performed based on ECDD and total variation (TV) to make the computing of the PDE-based image in painting more efficient. The experimental results show that the proposed strategy not only can repair the long disconnected objects more accurately, but also can greatly shorten the iteration time of image in painting.
Digital Image Inpainting with Radial Basis Functions

周廷方,汤锋,王进,王章野,彭群生

DOI: https://doi.org/10.3969/j.issn.1006-8961.2004.10.008

2004-01-01

Journal of Image and Graphics

Abstract:The goal of digital image inpainting is to restore damaged regions or remove objects in the image. This paper presents a novel image inpainting algorithm based on RBF (radial basis functions). After the user selects the regions to be inpainted, the algorithm automatically detects contours of the mask and finds appropriate regions to construct the RBF. Color of the 2D image is treated as height field over a regularly sampled grid, the 2D image inpainting problem is naturally converted to 3D implicit surface reconstruction problem, which RBF has been proved to be a good solver. With RBF resampling,the algorithm can nicely fix the damaged image or remove specific objects. Experiments show that our algorithm can fix a large variety of images effectively and robustly.
An automatic image inpaint tool

Timothy K. Shih,Liang-Chen Lu,Rong-Chi Chang

DOI: https://doi.org/10.1145/957013.957035

2003-01-01

Abstract:Automatic digital inpainting is a challenge but interesting research area. This demonstration presents a tool, which uses a color interpolation mechanism to restore damaged images. The mechanism checks the variation of pixel blocks and restores pixels using different strategies. We test more than 1000 images, including photos, paintings, and cartoon drawings. The proposed system is also available at: http://www.mine.tku.edu.tw/demos/inpaint.
A Hybrid Inpainting Model Combining Diffusion and Enhanced Exemplar Methods

Sreelakshmy I. J.,Binsu C. Kovoor

DOI: https://doi.org/10.1145/3418035

2021-04-27

Journal of Data and Information Quality

Abstract:Image inpainting is a technique in the world of image editing where missing portions of the image are estimated and filled with the help of available or external information. In the proposed model, a novel hybrid inpainting algorithm is implemented, which adds the benefits of a diffusion-based inpainting method to an enhanced exemplar algorithm. The structure part of the image is dealt with a diffusion-based method, followed by applying an adaptive patch size–based exemplar inpainting. Due to its hybrid nature, the proposed model exceeds the quality of output obtained by applying conventional methods individually. A new term, coefficient of smoothness, is introduced in the model, which is used in the computation of adaptive patch size for the enhanced exemplar method. An automatic mask generation module relieves the user from the burden of creating additional mask input. Quantitative and qualitative evaluation is performed on images from various datasets. The results provide a testimonial to the fact that the proposed model is faster in the case of smooth images. Moreover, the proposed model provides good quality results while inpainting natural images with both texture and structure regions.
Similar neighborhood approach for image inpainting

Wentao HE,Xueyi YE,Zhiwei HE,Yunlu WANG

DOI: https://doi.org/10.3778/j.issn.1002-8331.1207-0376

2014-01-01

Abstract:Image inpainting based on partial differential equation and image completion based on texture synthesis is a very important method in digital image inpainting, in the present, these methods perform well, but they consume much time. This paper presents a new image inpainting algorithm based on the similarity of neighborhood. Firstly, the paper calculates the priority of every boundary point and makes the descending priority order as an inpainting order, the algorithm takes the similarity of pixel’s neighborhood to measure the degree of the similarity of pixel, it fully considers the influence of known information of neighborhood for pixel, then, calculates the average of the known pixels whose meet the requirements of similarity as the values to be filled point. Experimental results show that this algorithm can inpaint image better, and under the same scope of to be filled and effect of inpainting conditions, this algorithm has higher inpainting efficiency.
IMAGE INPAINTING FROM PARTIAL NOISY DATA BY DIRECTIONAL COMPLEX TIGHT FRAMELETS

Yi Shen,Bin Han,Elena Braverman

DOI: https://doi.org/10.1017/s1446181117000219

2017-01-01

Abstract:Image inpainting methods recover true images from partial noisy observations. Natural images usually have two layers consisting of cartoons and textures. Methods using simultaneous cartoon and texture inpainting are popular in the literature by using two combined tight frames: one (often built from wavelets, curvelets or shearlets) provides sparse representations for cartoons and the other (often built from discrete cosine transforms) offers sparse approximation for textures. Inspired by the recent development on directional tensor product complex tight framelets ( $\text{TP}\text{-}\mathbb{C}\text{TF}$ s) and their impressive performance for the image denoising problem, we propose an iterative thresholding algorithm using tight frames derived from $\text{TP}\text{-}\mathbb{C}\text{TF}$ s for the image inpainting problem. The tight frame $\text{TP}\text{-}\mathbb{C}\text{TF}_{6}$ contains two classes of framelets; one is good for cartoons and the other is good for textures. Therefore, it can handle both the cartoons and the textures well. For the image inpainting problem with additive zero-mean independent and identically distributed Gaussian noise, our proposed algorithm does not require us to tune parameters manually for reasonably good performance. Experimental results show that our proposed algorithm performs comparatively better than several well-known frame systems for the image inpainting problem.
Fast Local Image Inpainting Based on the Allen-Cahn Model

Yibao Li,Darae Jeong,Jung-Il Choi,Seunggyu Lee,Junseok Kim

DOI: https://doi.org/10.1016/j.dsp.2014.11.006

IF: 2.92

2015-01-01

Digital Signal Processing

Abstract:In this paper, we propose a fast local image inpainting algorithm based on the Allen–Cahn model. The proposed algorithm is applied only on the inpainting domain and has two features. The first feature is that the pixel values in the inpainting domain are obtained by curvature-driven diffusions and utilizing the image information from the outside of the inpainting region. The second feature is that the pixel values outside of the inpainting region are the same as those in the original input image since we do not compute the outside of the inpainting region. Thus the proposed method is computationally efficient. We split the governing equation into one linear equation and one nonlinear equation by using an operator splitting technique. The linear equation is discretized by using a fully implicit scheme and the nonlinear equation is solved analytically. We prove the unconditional stability of the proposed scheme. To demonstrate the robustness and accuracy of the proposed method, various numerical results on real and synthetic images are presented.
Towards Interactive Image Inpainting via Sketch Refinement

Chang Liu,Shunxin Xu,Jialun Peng,Kaidong Zhang,Dong Liu

DOI: https://doi.org/10.1109/TMM.2024.3402620

2023-06-19

Abstract:One tough problem of image inpainting is to restore complex structures in the corrupted regions. It motivates interactive image inpainting which leverages additional hints, e.g., sketches, to assist the inpainting process. Sketch is simple and intuitive to end users, but meanwhile has free forms with much randomness. Such randomness may confuse the inpainting models, and incur severe artifacts in completed images. To address this problem, we propose a two-stage image inpainting method termed SketchRefiner. In the first stage, we propose using a cross-correlation loss function to robustly calibrate and refine the user-provided sketches in a coarse-to-fine fashion. In the second stage, we learn to extract informative features from the abstracted sketches in the feature space and modulate the inpainting process. We also propose an algorithm to simulate real sketches automatically and build a test protocol with different applications. Experimental results on public datasets demonstrate that SketchRefiner effectively utilizes sketch information and eliminates the artifacts due to the free-form sketches. Our method consistently outperforms the state-of-the-art ones both qualitatively and quantitatively, meanwhile revealing great potential in real-world applications. Our code and dataset are available.

Computer Vision and Pattern Recognition
Image Inpainting Based on Geometrical Modeling of Complex Wavelet Coefficients

Gang Hua,Michael T. Orchard

DOI: https://doi.org/10.1109/icip.2007.4379014

2007-01-01

Abstract:The restoration of missing regions in images (inpainting) is mathematically an interpolation problem and has many important applications. This paper proposes a novel iterative inpainting algorithm based on the interpolation of the Complex Wavelet Transform (CWT) coefficients with simple geometrical models on the magnitude and phase of the coefficients. The geometrical models describe the directionality and uniformity of the CWT magnitudes and the linearity of the CWT phases around edges and within texture areas. Both piecewise smooth signals and structured textures can be interpolated accurately with the proposed models. Motivated by the iterative reconstruction of an image from its CWT magnitude or phase, we propose an inpainting algorithm with iterative magnitude and phase estimation and CWT reconstruction. Simulation results show that the proposed algorithm achieves high PSNR and appealing visual quality with low computation complexity.
Structure-aware Image Inpainting Using Patch Scale Optimization

Zhihua Chen,Chao Dai,Lei Jiang,Bin Sheng,Jing Zhang,Weiyao Lin,Yubo Yuan

DOI: https://doi.org/10.1016/j.jvcir.2016.06.029

IF: 2.887

2016-01-01

Journal of Visual Communication and Image Representation

Abstract:Image inpainting is widely used in many image processing applications such as image stitching, image editing and object removal. The main challenge stems from producing visually plausible results after reconstruction. Most of the image inpainting algorithms cannot maintain structure continuity and texture consistency precisely. To address this problem, we propose a robust exemplar-based inpainting algorithm. Firstly, we present local structure multiplier to contain sufficient structure information in the priority function which ensures the structure continuity. Secondly, we combine color feature and space distance between two patches to search for the optimized patch to avoid texture inconsistency. At last, we calculate the average pixel difference between two patches under each candidate scale, we select the scale which the minimal average pixel difference is to be the optimized scale. We copy the target patch with the optimized patch. Extensive experiments show the effectiveness of the proposed method. (C) 2016 Elsevier Inc. All rights reserved.

INPAINTING OF BINARY IMAGES USING A PHASE-FIELDMODEL

FAST AND AUTOMATIC INPAINTING OF BINARY IMAGES USING A PHASE-FIELD MODEL

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

Inpainting of binary images using the Cahn-Hilliard equation

Inpainting Algorithm for Jacquared Image Based on Phase-Field Model

Free-Form Image Inpainting with Separable Gate Encoder-Decoder Network

An efficient and explicit local image inpainting method using the Allen–Cahn equation

Partial Differential Equation Inpainting Method Based on Image Characteristics.

An Image Inpainting Approach Based on the Poisson Equation

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

A Progressive Image Inpainting Algorithm with a Mask Auto-update Branch

Highly Efficient Local Non-Texture Image Inpainting Based on Partial Differential Equation

Digital Image Inpainting with Radial Basis Functions

An automatic image inpaint tool

A Hybrid Inpainting Model Combining Diffusion and Enhanced Exemplar Methods

Similar neighborhood approach for image inpainting

IMAGE INPAINTING FROM PARTIAL NOISY DATA BY DIRECTIONAL COMPLEX TIGHT FRAMELETS

Fast Local Image Inpainting Based on the Allen-Cahn Model

Towards Interactive Image Inpainting via Sketch Refinement

Image Inpainting Based on Geometrical Modeling of Complex Wavelet Coefficients

Structure-aware Image Inpainting Using Patch Scale Optimization