Abstract:Most existing inpainting methods repair a corrupted image to a single output, which gives people no choice to select the most satisfactory result. However, image inpainting is essentially a multi-modal problem because the inpainted results could have multiple possibilities. To generate both diverse and realistic inpainted results, we propose a diverse image inpainting framework with disentangled uncertainty. We disentangle the uncertainty of the missing region into two aspects: structure and appearance. Correspondingly, we divide the process of diverse image inpainting into two stages: diverse structure inpainting and diverse appearance inpainting. In the first stage, we restore the structure of the missing region, producing diverse complete edge maps. In the second stage, using a complete edge map as the guidance, we fill in diverse appearance information of the missing region. We also design a light-weighted disentangling subnetwork to disentangle structure information and appearance information. Besides, we propose a novel style-based masked residual block to better deal with the uncertainty. Experiments on CelebA-HQ, Paris Street View, and Places2 demonstrate that our method can repair the corrupted image with higher fidelity and diversity than other existing methods.

A Novel Image Inpainting Method Based on Sparse Decomposition

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

A Novel DIBR Method Based on Image Inpainting

Image inpainting via weighted optimization

A novel texture synthesis based algorithm for object removal in photographs

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

An Image Inpainting Approach Based on the Poisson Equation

Partial Differential Equation Inpainting Method Based on Image Characteristics.

Sketch-Guided Texture-Based Image Inpainting

Highly Efficient Local Non-Texture Image Inpainting Based on Partial Differential Equation

Exemplar-Based Image Inpainting Using Structure Consistent Patch Matching

Fast Two-Step Exemplar-Based Image Inpainting

Inpainting based on total variation

Research of Image Compression Based on Image Inpainting

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Fast Inpainting Algorithm of Woodblock New Year Pictures Damaged Area Based on Combination of Texture Distribution Analysis and Anisotropic Diffusion Technique

Image Inpainting Via Weighted Sparse Non-negative Matrix Factorization

Diverse Image Inpainting with Disentangled Uncertainty

Simultaneous Inpainting of Image Structure and Texture with PDE

A Hybrid Inpainting Model Combining Diffusion and Enhanced Exemplar Methods

Fullbore Image Construction of Imaging Logging Based on the Improved Texture Inpainting Method