Abstract:Inpainting images that have sizable missing blocks presents a considerable challenge in terms of preserving visual consistency and attaining a convincing result. In this study, the multi-scale generative adversarial network with multi-head external attention for image inpainting (denoted as MGDAN) is proposed. First, an adaptive weight style loss is designed into the generator of multi-scale generative adversarial networks (GAN) to guide the inpainting of the style and structure in the image inpainting, which improves the inpainting effect of image contour and emoticon. Second, the Adaptive Mix model is introduced to address the imbalance in generator and discriminator training by reducing the distance between the difficult and easy samples. This approach is intended to improve the overall performance of the network and drive high-quality image generation. Third, the generator and local discriminator in the image inpainting process are enhanced by the introduction of a multi-head external attention mechanism. This addition aims to capture the long-distance and multi-level dependent relationships between different areas of the image. It is proved beneficial for the generating clear geometric contours in the restored images and improving the overall global consistency of the inpainted results. By employing specific experimental methods, we find the optimal number of heads. The effectiveness of the proposed approach also is demonstrated through the extensive experiments conducted on public datasets.

MSE-Net: Generative Image Inpainting with Multi-Scale Encoder

Face Image Inpainting Based on Generative Adversarial Network

Image Inpainting Based on Multi-Scale Stable-Field GAN

Multi-scale Gated Inpainting Network with Patch-Wise Spacial Attention.

A Context-Based Multi-Scale Discriminant Model for Natural Image Inpainting

Multi-Scale Generative Adversarial Networks Image Inpainting Algorithm*

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

Multi-scale patch-GAN with edge detection for image inpainting

Multi-scale Generative Model for Image Completion

Fine-grained image inpainting with scale-enhanced generative adversarial network

Free-Form Image Inpainting with Separable Gate Encoder-Decoder Network

MGD-Net: A Multi-Grained Dilation Network for Image Inpainting

A Novel Generative Image Inpainting Model with Dense Gated Convolutional Network

Generative Image Inpainting for Large-Scale Edge Area

Multi-scale Generative Adversarial Inpainting Network Based on Cross-Layer Attention Transfer Mechanism.

A Progressive Image Inpainting Algorithm with a Mask Auto-update Branch

Adaptive Visual Field Multi-scale Generative Adversarial Networks Image Inpainting Base on Coordinate-Attention

Multi-scale Generative Adversarial Network with Multi-Head External Attention for Image Inpainting

Image Fine-grained Inpainting.

New Inpainting Algorithm Based on Simplified Context Encoders and Multi-Scale Adversarial Network