Abstract:Automatic image completion can provide convenient editing of consumer images. Most image completion methods find the best patch locally and then copy it to the hole region for texture inpainting. Since the best patch is fixed in size, it is hard to adapt these methods efficiently either to various patterns or to content synthesis. Meanwhile, salient image structures can be estimated and propagated to guide the texture inpainting process for more plausible results. This paper presents a novel image completion method using structure guided texture inpainting. We do not require any interactions to achieve automatic two-stage image completion. In the structure completion stage, the salient structures around the hole region are detected, and then the missing structure curves are completed with Euler spiral. The textures along the structure curves are completed through belief propagation. In the texture inpainting stage, we propose multi-scale patches and global optimization to inpaint the remaining texture in the hole regions guided by the completed structures. First, with defined patch sizes, the hole region is divided into lattice patches, making it possible for multiple patch sizes to render multi-scale descriptions of this image. A multi-scale graph is then built for the hole region and formulated as a posterior probability model. Second, using a simulated annealing based Markov chain Monte Carlo method, an inference algorithm is designed to find a global optimization solution for the posterior probability model. The experiments show that our method can automatically complete the hole region and preserve plausible structure shapes of existing ones in various scenarios. The texture inpainting results are more convincing with guidance from the completed structures, and our method can guarantee and accelerate convergence of the global optimization.

Contour-guided Image Completion Using a Sample Image

Data-driven Image Completion for Complex Objects

Image completion via transformation and structural constraints

Virtual Completion of Facial Image in Ancient Murals

Structure Guided Image Completion Using Texture Synthesis and Region Segmentation

Efficient Image Completion Method Based on Alternating Direction Theory.

Structure Constrained Image Completion by Geometric Transformation Model and Dynamic Patches

Structure-Aware Image Completion with Texture Propagation

Sample-based Image Completion Using Structure Synthesis

Image Completion Using Constrained Delaunay Triangulation

View-Guided Point Cloud Completion

Exemplar-based Image Completion Using Image Depth Information

Contour-guided Image Completion with Perceptual Grouping

Image completion based on views of large displacement

Image Completion Using Similarity Analysis and Transformation

Image Completion Based on Creative Design of Massive Images

Image completion via texture direction analysis

Image Completion Based on Direction Empirical Mode Decomposition

Distortion Optimization Based Image Completion from A Large Displacement View

Automatic and accurate image completion from a large displacement view

Structure Guided Texture Inpainting Through Multi-Scale Patches and Global Optimization for Image Completion.