Abstract:In recent years, facial prior has been widely applied to enhance the quality of super-resolution (SR) facial images in face super-resolution (FSR) methods based on deep learning. However, most of the existing facial prior-based FSR methods have insufficient attention to local texture details, which can cause the generated SR facial images with overly smooth and unrealistic texture details, and show obvious artifacts under large magnification. With the help of GAN prior, recent advances can produce excellent results in terms of fidelity and realness. A generative framework for FSR is proposed in this work, which combines GAN and facial prior, termed CFGPFSR. Firstly, we pre-train a face StyleGAN2 and a face parsing network (FPN) that can generate decent parsing maps, in which the proposed CFGPFSR exploits rich and varied priors encapsulated in the face StyleGAN2 (GAN prior) and face parsing maps extracted from the FPN (facial prior) for FSR. Moreover, we introduce the Channel-Split Spatial Feature Transform (CS-SFT) method to further improve FSR performance. GAN and facial priors are introduced into the FSR process through the designed CS-SFT layers so that SR facial images obtain a promising balance between fidelity and realness. Unlike GAN inversion methods which necessitate costly image optimization at runtime, the proposed CFGPFSR can jointly recover facial details by only utilizing one forward pass. Experimental results on synthetic and real images indicate that the proposed CFGPFSR obtains remarkable performance in 16 × SR task, and some of its metrics such as peak signal to noise ratio (PSNR) and structural similarity (SSIM) are higher than that of the comparison methods. Meanwhile, it shows impressive results in reconstructing high-quality facial images.

MSFSR: A Multi-Stage Face Super-Resolution with Accurate Facial Representation Via Enhanced Facial Boundaries.

MSRFSR: Multi-Stage Refining Face Super-Resolution With Iterative Collaboration Between Face Recovery and Landmark Estimation

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

Noisy Practical Facial Super-Resolution Method Via Deformable Constrained Model with Small Dataset

Spatial-Frequency Mutual Learning for Face Super-Resolution

Robust Face Super-Resolution Via Position Relation Model Based on Global Face Context.

Rethinking Prior-Guided Face Super-Resolution: A New Paradigm with Facial Component Prior.

CFGPFSR: A Generative Method Combining Facial and GAN Priors for Face Super-Resolution

Multi-level landmark-guided deep network for face super-resolution

Face Super-Resolution Via Bilayer Contextual Representation

Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimation

The face image super-resolution algorithm based on combined representation learning

Learning Face Image Super-Resolution Through Facial Semantic Attribute Transformation and Self-Attentive Structure Enhancement

SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression with Local Structure Prior

A Composite Network Model for Face Super-Resolution with Multi-Order Head Attention Facial Priors

OPLS-SR: A Novel Face Super-Resolution Learning Method Using Orthonormalized Coherent Features

Super-Resolution for Human Faces Based on Sequential Images and Learnt Prior

Multi-Stage Degradation Homogenization for Super-Resolution of Face Images With Extreme Degradations

Facial mask attention network for identity-aware face super-resolution

Robust Super-Resolution for Face Images Via Principle Component Sparse Representation and Least Squares Regression.

Deep Learning-based Face Super-Resolution: A Survey