Abstract:In face image recognition and other related applications, incomplete facial imagery due to obscuring factors during acquisition represents an issue that requires solving. Aimed at tackling this issue, the research surrounding face image completion has become an important topic in the field of image processing. Face image completion methods require the capability of capturing the semantics of facial expression. A deep learning network has been widely shown to bear this ability. However, for high-resolution face image completion, the network training of high-resolution image inpainting is difficult to converge, thus rendering high-resolution face image completion a difficult problem. Based on the study of the deep learning model of high-resolution face image generation, this paper proposes a high-resolution face inpainting method. First, our method extracts the latent vector of the face image to be repaired through ResNet, then inputs the latent vector to the pre-trained StyleGAN model to generate the face image. Next, it calculates the loss between the known part of the face image to be repaired and the corresponding part of the generated face imagery. Afterward, the latent vector is cut to generate a new face image iteratively until the number of iterations is reached. Finally, the Poisson fusion method is employed to process the last generated face image and the face image to be repaired in order to eliminate the difference in boundary color information of the repaired image. Through the comparison and analysis between two classical face completion methods in recent years on the CelebA-HQ data set, we discovered our method can achieve better completion results of 256*256 resolution face image completion. For 1024*1024 resolution face image restoration, we have also conducted a large number of experiments, which prove the effectiveness of our method. Our method can obtain a variety of repair results by editing the latent vector. In addition, our method can be successfully applied to face image editing, face image watermark clearing and other applications without the network training process of different masks in these applications.

Photorealistic Face Completion with Semantic Parsing and Face Identity-Preserving Features.

IPFC: an Attentive Face Completion Network with Identity Preserving

Perceptual Face Completion Using A Local-Global Generative Adversarial Network

Face Completion with Semantic Knowledge and Collaborative Adversarial Learning

Efficient Generative Face Completion with Perceptual Deblurring

3DFP-FCGAN: Face Completion Generative Adversarial Network with 3D Facial Prior

Contrastive attention network with dense field estimation for face completion

Face Image Completion Based on GAN Prior

FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance

Learning Disentangling and Fusing Networks for Face Completion Under Structured Occlusions

Transformer-based High-Fidelity Facial Displacement Completion for Detailed 3D Face Reconstruction

Recurrent Generative Adversarial Network for Face Completion.

Identity Preserving Face Completion for Large Ocular Region Occlusion

Deep Learning for Face Anti-Spoofing: A Survey

Deep Portrait Image Completion and Extrapolation

Attributes Guided Facial Image Completion

When Face Completion Meets Irregular Holes: An Attributes Guided Deep Inpainting Network

Geometry-Aware Face Completion and Editing

Research on High-Resolution Face Image Inpainting Method Based on StyleGAN

Identity-Preserving Face Hallucination via Deep Reinforcement Learning

3DFaceFill: An Analysis-By-Synthesis Approach to Face Completion