Abstract:Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. However, very low-quality inputs cannot offer accurate geometric prior while high-quality references are inaccessible, limiting the applicability in real-world scenarios. In this work, we propose GFP-GAN that leverages rich and diverse priors encapsulated in a pretrained face GAN for blind face restoration. This Generative Facial Prior (GFP) is incorporated into the face restoration process via novel channel-split spatial feature transform layers, which allow our method to achieve a good balance of realness and fidelity. Thanks to the powerful generative facial prior and delicate designs, our GFP-GAN could jointly restore facial details and enhance colors with just a single forward pass, while GAN inversion methods require expensive image-specific optimization at inference. Extensive experiments show that our method achieves superior performance to prior art on both synthetic and real-world datasets.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the blind restoration of low - quality face images in the real world. Specifically, the authors focus on how to restore high - quality face images from low - quality images that have suffered from unknown degradations, which may include low resolution, noise, blurring and compression artifacts, etc. In practical applications, this task becomes more challenging because images in the real world may contain more complex degradations, diverse poses and expressions. To address these challenges, the paper proposes a new method named GFP - GAN, which utilizes the Generative Facial Prior (GFP) in the pre - trained Face Generative Adversarial Network (GAN) to restore face details and enhance colors. This method can improve the fidelity of the restored image while maintaining the sense of reality, and can complete face detail restoration and color enhancement simultaneously in a single forward pass. The main contributions of the paper include: 1. Utilizing rich and diverse generative facial priors, which contain sufficient facial texture and color information, enabling simultaneous face restoration and color enhancement. 2. Proposing the GFP - GAN framework. Through carefully designed architectures and loss functions, it effectively incorporates the generative facial prior into the restoration process. GFP - GAN achieves a good balance between fidelity and texture fidelity in a single forward pass through the Channel - Split Spatial Feature Transform (CS - SFT) layer. 3. Extensive experiments show that this method outperforms existing methods on both synthetic and real - world datasets. Through these contributions, GFP - GAN performs excellently when dealing with low - quality face images in the real world and can restore more realistic and high - fidelity facial details.

Towards Real-World Blind Face Restoration with Generative Facial Prior

IMAGE RECONSTRUCTION OF OLD DAMAGED PHOTOS

Video Regeneration and Quality Enhancer using GFP-GAN

Feature-Guided Blind Face Restoration with GAN Prior

Facial Landmarks and Generative Priors Guided Blind Face Restoration

Blind Face Restoration Via Integrating Face Shape and Generative Priors

Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior

GAN Prior Embedded Network for Blind Face Restoration in the Wild

Toward Real-World Blind Face Restoration With Generative Diffusion Prior

Towards Real-World Blind Face Restoration with Generative Diffusion Prior

HPG-GAN: High-Quality Prior-Guided Blind Face Restoration Generative Adversarial Network

AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior

Real-World Blind Face Restoration with Generative Facial Prior and Degradation Simulation

TFRGAN: Leveraging Text Information for Blind Face Restoration with Extreme Degradation.

Blind Face Restoration under Extreme Conditions: Leveraging 3D-2D Prior Fusion for Superior Structural and Texture Recovery

Blind Face Restoration Via Multi-Prior Collaboration and Adaptive Feature Fusion.

3D Priors-Guided Diffusion for Blind Face Restoration

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

BFRFormer: Transformer-based generator for Real-World Blind Face Restoration

3D GAN Inversion with Facial Symmetry Prior