Abstract:Automatic image completion can provide convenient editing of consumer images. Most image completion methods find the best patch locally and then copy it to the hole region for texture inpainting. Since the best patch is fixed in size, it is hard to adapt these methods efficiently either to various patterns or to content synthesis. Meanwhile, salient image structures can be estimated and propagated to guide the texture inpainting process for more plausible results. This paper presents a novel image completion method using structure guided texture inpainting. We do not require any interactions to achieve automatic two-stage image completion. In the structure completion stage, the salient structures around the hole region are detected, and then the missing structure curves are completed with Euler spiral. The textures along the structure curves are completed through belief propagation. In the texture inpainting stage, we propose multi-scale patches and global optimization to inpaint the remaining texture in the hole regions guided by the completed structures. First, with defined patch sizes, the hole region is divided into lattice patches, making it possible for multiple patch sizes to render multi-scale descriptions of this image. A multi-scale graph is then built for the hole region and formulated as a posterior probability model. Second, using a simulated annealing based Markov chain Monte Carlo method, an inference algorithm is designed to find a global optimization solution for the posterior probability model. The experiments show that our method can automatically complete the hole region and preserve plausible structure shapes of existing ones in various scenarios. The texture inpainting results are more convincing with guidance from the completed structures, and our method can guarantee and accelerate convergence of the global optimization.

Sample-based Image Completion Using Structure Synthesis

Structure-Aware Image Completion with Texture Propagation

Image Completion with Automatic Structure Propagation

Image Completion Based on Automatic Structure Propagation

Automatic Image Completion with Structure Propagation and Texture Synthesis

Fast Structural Image Completion

Structure Guided Image Completion Using Texture Synthesis and Region Segmentation

Image completion via transformation and structural constraints

Contour-guided Image Completion Using a Sample Image

Image Completion Using Constrained Delaunay Triangulation

Appearance and geometry completion with constrained texture synthesis

Structure Guided Texture Inpainting Through Multi-Scale Patches and Global Optimization for Image Completion.

Image Completion with Dynamic Patches

Image Completion Using Similarity Analysis and Transformation

Structure Constrained Image Completion by Geometric Transformation Model and Dynamic Patches

Data-driven Image Completion for Complex Objects

Image completion using structure and texture GAN network.

Image inpainting with salient structure completion and texture propagation

A Novel Exemplar-Based Image Completion Scheme with Adaptive TV-Constraint

Exemplar-based Image Completion Using Image Depth Information

Structure-guided Image Completion Via Regularity Statistics