Abstract:In face image recognition and other related applications, incomplete facial imagery due to obscuring factors during acquisition represents an issue that requires solving. Aimed at tackling this issue, the research surrounding face image completion has become an important topic in the field of image processing. Face image completion methods require the capability of capturing the semantics of facial expression. A deep learning network has been widely shown to bear this ability. However, for high-resolution face image completion, the network training of high-resolution image inpainting is difficult to converge, thus rendering high-resolution face image completion a difficult problem. Based on the study of the deep learning model of high-resolution face image generation, this paper proposes a high-resolution face inpainting method. First, our method extracts the latent vector of the face image to be repaired through ResNet, then inputs the latent vector to the pre-trained StyleGAN model to generate the face image. Next, it calculates the loss between the known part of the face image to be repaired and the corresponding part of the generated face imagery. Afterward, the latent vector is cut to generate a new face image iteratively until the number of iterations is reached. Finally, the Poisson fusion method is employed to process the last generated face image and the face image to be repaired in order to eliminate the difference in boundary color information of the repaired image. Through the comparison and analysis between two classical face completion methods in recent years on the CelebA-HQ data set, we discovered our method can achieve better completion results of 256*256 resolution face image completion. For 1024*1024 resolution face image restoration, we have also conducted a large number of experiments, which prove the effectiveness of our method. Our method can obtain a variety of repair results by editing the latent vector. In addition, our method can be successfully applied to face image editing, face image watermark clearing and other applications without the network training process of different masks in these applications.

FaST-Net: Face Style Self-Transfer Network for Masked Face Inpainting

Masked Face Inpainting Through Residual Attention UNet

Face Image Inpainting Based on Generative Adversarial Network

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

A Method for Face Image Inpainting Based on Autoencoder and Generative Adversarial Network.

Face Mask Removal with Region-attentive Face Inpainting

Unsupervised masked face inpainting based on contrastive learning and attention mechanism

E2F-Net: Eyes-to-Face Inpainting via StyleGAN Latent Space

GAN-based Algorithm for Efficient Image Inpainting

Personalized Face Inpainting with Diffusion Models by Parallel Visual Attention

Rdfinet: reference-guided directional diverse face inpainting network

DIFAI: Diverse Facial Inpainting using StyleGAN Inversion

Learning Prior Feature and Attention Enhanced Image Inpainting

Research on High-Resolution Face Image Inpainting Method Based on StyleGAN

Masked Face Recognition With Mask Transfer and Self-Attention Under the COVID-19 Pandemic

PainterNet: Adaptive Image Inpainting with Actual-Token Attention and Diverse Mask Control

LaFIn: Generative Landmark Guided Face Inpainting

Reference-guided face inpainting with reference attention network

Learning Adaptive Patch Generators for Mask-Robust Image Inpainting.

Face inpainting based on GAN by facial prediction and fusion as guidance information