Abstract:In face image recognition and other related applications, incomplete facial imagery due to obscuring factors during acquisition represents an issue that requires solving. Aimed at tackling this issue, the research surrounding face image completion has become an important topic in the field of image processing. Face image completion methods require the capability of capturing the semantics of facial expression. A deep learning network has been widely shown to bear this ability. However, for high-resolution face image completion, the network training of high-resolution image inpainting is difficult to converge, thus rendering high-resolution face image completion a difficult problem. Based on the study of the deep learning model of high-resolution face image generation, this paper proposes a high-resolution face inpainting method. First, our method extracts the latent vector of the face image to be repaired through ResNet, then inputs the latent vector to the pre-trained StyleGAN model to generate the face image. Next, it calculates the loss between the known part of the face image to be repaired and the corresponding part of the generated face imagery. Afterward, the latent vector is cut to generate a new face image iteratively until the number of iterations is reached. Finally, the Poisson fusion method is employed to process the last generated face image and the face image to be repaired in order to eliminate the difference in boundary color information of the repaired image. Through the comparison and analysis between two classical face completion methods in recent years on the CelebA-HQ data set, we discovered our method can achieve better completion results of 256*256 resolution face image completion. For 1024*1024 resolution face image restoration, we have also conducted a large number of experiments, which prove the effectiveness of our method. Our method can obtain a variety of repair results by editing the latent vector. In addition, our method can be successfully applied to face image editing, face image watermark clearing and other applications without the network training process of different masks in these applications.

Efficient Generative Face Completion with Perceptual Deblurring

Face Image Completion Based on GAN Prior

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

MND-GAN: A Research on Image Deblurring Algorithm Based on Generative Adversarial Network

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Learning Disentangling and Fusing Networks for Face Completion Under Structured Occlusions

Research on High-Resolution Face Image Inpainting Method Based on StyleGAN

FCSR-GAN: Joint Face Completion and Super-resolution via Multi-task Learning

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Does Generative Face Completion Help Face Recognition?

Simultaneous Face Completion and Frontalization via Mask Guided Two-Stage GAN

Face Deblurring Based on Separable Normalization and Adaptive Denormalization

Fine-Grained Blind Face Inpainting with 3D Face Component Disentanglement

Transformer-based High-Fidelity Facial Displacement Completion for Detailed 3D Face Reconstruction

DE-GAN: Domain Embedded GAN for High Quality Face Image Inpainting

FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance

HPG-GAN: High-Quality Prior-Guided Blind Face Restoration Generative Adversarial Network

Face inpainting based on GAN by facial prediction and fusion as guidance information

Semi-Supervised Natural Face De-Occlusion.

Deblurring by Realistic Blurring

3DFaceFill: An Analysis-By-Synthesis Approach to Face Completion