Abstract:Image Inpainting is an ill-posed problem since there are diverse possible counterparts for the missing areas. The challenge of inpainting is to keep the “corrupted region" content consistent with the background and generate a variety of reasonable texture details. However, existing one-stage methods that directly output the inpainting results have to make a trade-off between diversity and consistency. The two-stage methods as the current trend can circumvent such shortcomings. These methods predict diverse structural priors in the first stage and focus on rich texture details generation in the second stage. However, all two-stage methods require autoregressive models to predict the probability distribution of the structural priors, which significantly limits the inference speed. In addition, their discretization assumption of prior distribution reduces the diversity of the inpainting results. We propose Flow-Fill, a novel two-stage image inpainting framework that utilizes a conditional normalizing flow model to generate diverse structural priors in the first stage. Flow-Fill can directly estimate the joint probability density of the missing regions as a flow-based model without reasoning pixel by pixel. Hence it achieves real-time inference speed and eliminates discretization assumptions. In addition, as a reversible model, Flow-Fill can invert the latent variables for a specified region, which allows us to make the inference process as semantic image editing. Experiments on benchmark datasets validate that Flow-Fill achieves superior diversity and fidelity in image inpainting qualitatively and quantitatively.

A Novel Coupled Bi-Directional Diffused Image Inpainting Model with Morphological Invariant Property

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

A new hybrid multi-start tabu search for finding hidden purchase decision strategies in WWW based on eye-movements

A Novel DIBR Method Based on Image Inpainting

Depth-Aided Inpainting for Disocclusion Restoration of Multi-View Images Using Depth-Image-Based Rendering

Simultaneous Inpainting for Image Structure and Texture Using Anisotropic Heat Transfer Model

Diffusion Models with Anisotropic Gaussian Splatting for Image Inpainting

Video Diffusion Models are Strong Video Inpainter

Adaptive image inpainting using anisotropic heat transfer model

A Hybrid Inpainting Model Combining Diffusion and Enhanced Exemplar Methods

A Diffusion Model with A FFT for Image Inpainting

A Directional Diffusion Algorithm for Inpainting

Highly Efficient Local Non-Texture Image Inpainting Based on Partial Differential Equation

Partial Differential Equation Inpainting Method Based on Image Characteristics.

Curvature-Dependent Elastic Bending Total Variation Model for Image Inpainting with the SAV Algorithm

Flow-Guided Diffusion for Video Inpainting

The Navier-Stokes-Voight Model for Image Inpainting

Diverse Image Inpainting with Normalizing Flow.

Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models

Mathematical Models for Local Nontexture Inpaintings

A Variational Approach to Medical Image Inpainting Based on Mumford-Shah Model