Abstract:In face image recognition and other related applications, incomplete facial imagery due to obscuring factors during acquisition represents an issue that requires solving. Aimed at tackling this issue, the research surrounding face image completion has become an important topic in the field of image processing. Face image completion methods require the capability of capturing the semantics of facial expression. A deep learning network has been widely shown to bear this ability. However, for high-resolution face image completion, the network training of high-resolution image inpainting is difficult to converge, thus rendering high-resolution face image completion a difficult problem. Based on the study of the deep learning model of high-resolution face image generation, this paper proposes a high-resolution face inpainting method. First, our method extracts the latent vector of the face image to be repaired through ResNet, then inputs the latent vector to the pre-trained StyleGAN model to generate the face image. Next, it calculates the loss between the known part of the face image to be repaired and the corresponding part of the generated face imagery. Afterward, the latent vector is cut to generate a new face image iteratively until the number of iterations is reached. Finally, the Poisson fusion method is employed to process the last generated face image and the face image to be repaired in order to eliminate the difference in boundary color information of the repaired image. Through the comparison and analysis between two classical face completion methods in recent years on the CelebA-HQ data set, we discovered our method can achieve better completion results of 256*256 resolution face image completion. For 1024*1024 resolution face image restoration, we have also conducted a large number of experiments, which prove the effectiveness of our method. Our method can obtain a variety of repair results by editing the latent vector. In addition, our method can be successfully applied to face image editing, face image watermark clearing and other applications without the network training process of different masks in these applications.

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

Face Image Inpainting Based on Generative Adversarial Network

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

An image inpainting method based on generative adversarial networks inversion and autoencoder

A Progressive Image Inpainting Algorithm with a Mask Auto-update Branch

DE-GAN: Domain Embedded GAN for High Quality Face Image Inpainting

GAN-based Algorithm for Efficient Image Inpainting

Free-Form Image Inpainting with Separable Gate Encoder-Decoder Network

Face Image Inpainting Using Attribute Guided

Face inpainting based on GAN by facial prediction and fusion as guidance information

Research on image Inpainting algorithm of improved GAN based on two-discriminations networks

Image inpainting method based on AU-GAN

Domain Embedded Multi-model Generative Adversarial Networks for Image-based Face Inpainting

The Improved Image Inpainting Algorithm Via Encoder and Similarity Constraint

Progressive Inpainting Strategy with Partial Convolutions Generative Networks (PPCGN).

Image Inpainting Based on Contextual Coherent Attention GAN

Do Inpainting Yourself: Generative Facial Inpainting Guided by Exemplars

Image Inpainting Using Two-Stage Loss Function and Global and Local Markovian Discriminators

Research on High-Resolution Face Image Inpainting Method Based on StyleGAN

Semantic Image Inpainting with Multi-Stage Feature Reasoning Generative Adversarial Network

Attentional coarse-and-fine generative adversarial networks for image inpainting