Abstract:In face image recognition and other related applications, incomplete facial imagery due to obscuring factors during acquisition represents an issue that requires solving. Aimed at tackling this issue, the research surrounding face image completion has become an important topic in the field of image processing. Face image completion methods require the capability of capturing the semantics of facial expression. A deep learning network has been widely shown to bear this ability. However, for high-resolution face image completion, the network training of high-resolution image inpainting is difficult to converge, thus rendering high-resolution face image completion a difficult problem. Based on the study of the deep learning model of high-resolution face image generation, this paper proposes a high-resolution face inpainting method. First, our method extracts the latent vector of the face image to be repaired through ResNet, then inputs the latent vector to the pre-trained StyleGAN model to generate the face image. Next, it calculates the loss between the known part of the face image to be repaired and the corresponding part of the generated face imagery. Afterward, the latent vector is cut to generate a new face image iteratively until the number of iterations is reached. Finally, the Poisson fusion method is employed to process the last generated face image and the face image to be repaired in order to eliminate the difference in boundary color information of the repaired image. Through the comparison and analysis between two classical face completion methods in recent years on the CelebA-HQ data set, we discovered our method can achieve better completion results of 256*256 resolution face image completion. For 1024*1024 resolution face image restoration, we have also conducted a large number of experiments, which prove the effectiveness of our method. Our method can obtain a variety of repair results by editing the latent vector. In addition, our method can be successfully applied to face image editing, face image watermark clearing and other applications without the network training process of different masks in these applications.

Face Inpainting based on Improved WGAN-modified

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

Face Image Inpainting Based on Generative Adversarial Network

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

The Improved Image Inpainting Algorithm Via Encoder and Similarity Constraint

An image inpainting method based on generative adversarial networks inversion and autoencoder

Face inpainting based on GAN by facial prediction and fusion as guidance information

A Progressive Image Inpainting Algorithm with a Mask Auto-update Branch

Image Inpainting Based on Contextual Coherent Attention GAN

Photo-Realistic and Robust Inpainting of Faces Using Refinement GANs

Face Image Inpainting Using Attribute Guided

DGCA: high resolution image inpainting via DR-GAN and contextual attention

Image inpainting method based on AU-GAN

DE-GAN: Domain Embedded GAN for High Quality Face Image Inpainting

Free-Form Image Inpainting with Separable Gate Encoder-Decoder Network

Research on High-Resolution Face Image Inpainting Method Based on StyleGAN

Dual-path Image Inpainting with Auxiliary GAN Inversion

Multi-Scale Generative Adversarial Networks Image Inpainting Algorithm*

Face Frontalization with Inpainting Method

Research on image Inpainting algorithm of improved GAN based on two-discriminations networks