Abstract:Although image inpainting based on the generated adversarial network (GAN) has made great breakthroughs in accuracy and speed in recent years, they can only process low-resolution images because of memory limitations and difficulty in training. For high-resolution images, the inpainted regions become blurred and the unpleasant boundaries become visible. Based on the current advanced image generation network, we proposed a novel high-resolution image inpainting method based on multi-scale neural network. This method is a two-stage network including content reconstruction and texture detail restoration. After holding the visually believable fuzzy texture, we further restore the finer details to produce a smoother, clearer, and more coherent inpainting result. Then we propose a special application scene of image inpainting, that is, to delete the redundant pedestrians in the image and ensure the reality of background restoration. It involves pedestrian detection, identifying redundant pedestrians and filling in them with the seemingly correct content. To improve the accuracy of image inpainting in the application scene, we proposed a new mask dataset, which collected the characters in COCO dataset as a mask. Finally, we evaluated our method on COCO and VOC dataset. the experimental results show that our method can produce clearer and more coherent inpainting results, especially for high-resolution images, and the proposed mask dataset can produce better inpainting results in the special application scene.

Fine-grained image inpainting with scale-enhanced generative adversarial network

Image Fine-grained Inpainting.

Attentional coarse-and-fine generative adversarial networks for image inpainting

Multi-Scale Generative Adversarial Networks Image Inpainting Algorithm*

Face Image Inpainting Based on Generative Adversarial Network

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Generative Image Inpainting for Large-Scale Edge Area

Image Inpainting Based on Multi-Scale Stable-Field GAN

High-Resolution Image Inpainting Based On Multi-Scale Neural Network

A Progressive Image Inpainting Algorithm with a Mask Auto-update Branch

MSE-Net: Generative Image Inpainting with Multi-Scale Encoder

Context-Aware Semantic Inpainting

ESGAN: Edge Loss and Spatial Convolution Generative Adversarial Network for Image Inpainting

Multi-scale patch-GAN with edge detection for image inpainting

Improved Semantic Image Inpainting Method with Deep Convolution Generative Adversarial Networks.

Face inpainting based on GAN by facial prediction and fusion as guidance information

A Context-Based Multi-Scale Discriminant Model for Natural Image Inpainting

Efficient texture-aware multi-GAN for image inpainting

Image Inpainting Based on Double Joint Predictive Filtering and Wasserstein Generative Adversarial Networks.

E2I: Generative Inpainting From Edge to Image

An image inpainting method based on generative adversarial networks inversion and autoencoder