Abstract:Automatic image completion can provide convenient editing of consumer images. Most image completion methods find the best patch locally and then copy it to the hole region for texture inpainting. Since the best patch is fixed in size, it is hard to adapt these methods efficiently either to various patterns or to content synthesis. Meanwhile, salient image structures can be estimated and propagated to guide the texture inpainting process for more plausible results. This paper presents a novel image completion method using structure guided texture inpainting. We do not require any interactions to achieve automatic two-stage image completion. In the structure completion stage, the salient structures around the hole region are detected, and then the missing structure curves are completed with Euler spiral. The textures along the structure curves are completed through belief propagation. In the texture inpainting stage, we propose multi-scale patches and global optimization to inpaint the remaining texture in the hole regions guided by the completed structures. First, with defined patch sizes, the hole region is divided into lattice patches, making it possible for multiple patch sizes to render multi-scale descriptions of this image. A multi-scale graph is then built for the hole region and formulated as a posterior probability model. Second, using a simulated annealing based Markov chain Monte Carlo method, an inference algorithm is designed to find a global optimization solution for the posterior probability model. The experiments show that our method can automatically complete the hole region and preserve plausible structure shapes of existing ones in various scenarios. The texture inpainting results are more convincing with guidance from the completed structures, and our method can guarantee and accelerate convergence of the global optimization.

Structure Guided Image Completion Using Texture Synthesis and Region Segmentation

Structure-Aware Image Completion with Texture Propagation

Structure Guided Texture Inpainting Through Multi-Scale Patches and Global Optimization for Image Completion.

Structure Constrained Image Completion by Geometric Transformation Model and Dynamic Patches

Image completion via transformation and structural constraints

Image Completion with Automatic Structure Propagation

Image inpainting with salient structure completion and texture propagation

Image completion via texture direction analysis

Edge-Based Image Completing Guided by Region Segmentation

Image Completion Based on Automatic Structure Propagation

Automatic Image Completion with Structure Propagation and Texture Synthesis

Sample-based Image Completion Using Structure Synthesis

Image Completion Using Constrained Delaunay Triangulation

Contour-guided Image Completion Using a Sample Image

TV-Based Texture Image Inpainting

Structure-Guided Image Completion With Image-Level and Object-Level Semantic Discriminators

Structure-Guided Image Inpainting Using Homography Transformation

Image Completion Based on Partial Region

Fast Structural Image Completion

A Structure-Synthesis Image Inpainting Algorithm Based on Morphological Erosion Operation

Appearance and geometry completion with constrained texture synthesis