Abstract:Blind face restoration (BFR) is important while challenging. Prior works prefer to exploit GAN-based frameworks to tackle this task due to the balance of quality and efficiency. However, these methods suffer from poor stability and adaptability to long-tail distribution, failing to simultaneously retain source identity and restore detail. We propose DiffBFR to introduce Diffusion Probabilistic Model (DPM) for BFR to tackle the above problem, given its superiority over GAN in aspects of avoiding training collapse and generating long-tail distribution. DiffBFR utilizes a two-step design, that first restores identity information from low-quality images and then enhances texture details according to the distribution of real faces. This design is implemented with two key components: 1) Identity Restoration Module (IRM) for preserving the face details in results. Instead of denoising from pure Gaussian random distribution with LQ images as the condition during the reverse process, we propose a novel truncated sampling method which starts from LQ images with part noise added. We theoretically prove that this change shrinks the evidence lower bound of DPM and then restores more original details. With theoretical proof, two cascade conditional DPMs with different input sizes are introduced to strengthen this sampling effect and reduce training difficulty in the high-resolution image generated directly. 2) Texture Enhancement Module (TEM) for polishing the texture of the image. Here an unconditional DPM, a LQ-free model, is introduced to further force the restorations to appear realistic. We theoretically proved that this unconditional DPM trained on pure HQ images contributes to justifying the correct distribution of inference images output from IRM in pixel-level space. Truncated sampling with fractional time step is utilized to polish pixel-level textures while preserving identity information.

LD-BFR: Vector-Quantization-Based Face Restoration Model with Latent Diffusion Enhancement

DiffBFR: Bootstrapping Diffusion Model Towards Blind Face Restoration

BFRFormer: Transformer-based generator for Real-World Blind Face Restoration

Towards Real-World Blind Face Restoration with Generative Diffusion Prior

Feature-Guided Blind Face Restoration with GAN Prior

AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior

Toward Real-World Blind Face Restoration With Generative Diffusion Prior

Blind Face Video Restoration with Temporal Consistent Generative Prior and Degradation-Aware Prompt

CLR-Face: Conditional Latent Refinement for Blind Face Restoration Using Score-Based Diffusion Models

TFRGAN: Leveraging Text Information for Blind Face Restoration with Extreme Degradation.

GAN Prior Embedded Network for Blind Face Restoration in the Wild

Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior

DiffMAC: Diffusion Manifold Hallucination Correction for High Generalization Blind Face Restoration

3D Priors-Guided Diffusion for Blind Face Restoration

DifFace: Blind Face Restoration with Diffused Error Contraction

Facial Landmarks and Generative Priors Guided Blind Face Restoration

Blind Face Restoration Via Multi-Prior Collaboration and Adaptive Feature Fusion.

Towards Real-World Blind Face Restoration with Generative Facial Prior

Blind Face Restoration Via Integrating Face Shape and Generative Priors

Efficient Video Face Enhancement with Enhanced Spatial-Temporal Consistency

VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder