Abstract:Recent CNN-driven face super-resolution (FSR) technologies have achieved excellent breakthroughs by incorporating facial prior knowledge. However, most of them suffer from some obvious limitations. They always estimate facial priors from input low-resolution (LR) faces or coarsely enhanced LR faces, obtaining unfaithful priors that cannot be adequately exploited. This may bring noticeable artifacts to the target results, especially for large scaling factors, deteriorating the fidelity and naturalness and generating suboptimal reconstructed results. In this paper, we propose a two-stage prior-guided FSR approach to learn facial prior knowledge from the optimal SR results of stage one and explore the complementarity between priors to further guide more accurate reconstruction in stage two. Specifically, we develop an efficient local and global interactive hybrid network incorporating facial semantic and geometric priors for more discriminative results. To reach this, we devise a multiscale interconnected symmetric encoder-decoder architecture composed of Prior Interaction-Integration Modules (PIIMs), the Coarse-to-fine Feature Refinement Module (CFRM), and Feature Aggregation Modulation Modules (FAMMs). The encoder concentrates on hierarchically extracting multiscale features. The CFRM is devised to explore the potential correlations between the encoder and the decoder and further guide the refinement and reinforcement of the encoded features. The decoder aims to take full advantage of informative multiscale encoded features to reconstruct high-quality SR representations. Comprehensive evaluation and visualization results on four benchmark datasets demonstrate the superiority of the proposed PLGNet over current state-of-the-art methods. The source code of PLGNet will be available at https://github.com/lil808/PLGNet.git.

Multi-level landmark-guided deep network for face super-resolution

Face Super-Resolution Via Progressive-Scale Boosting Network

Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimation

Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors

PLGNet: Prior-guided Local and Global Interactive Hybrid Network for Face Super-Resolution

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

A Face Structure Attention Network for Face Super-Resolution

The face image super-resolution algorithm based on combined representation learning

Global-local Fusion Network for Face Super-Resolution

A Composite Network Model for Face Super-Resolution with Multi-Order Head Attention Facial Priors

Multi-Scale Feature Fusion and Structure-Preserving Network for Face Super-Resolution

Attention-Driven Graph Neural Network for Deep Face Super-Resolution

Prior Knowledge Distillation Network for Face Super-Resolution

DCLNet: Dual Closed-loop Networks for face super-resolution

Guided Cascaded Super-Resolution Network for Face Image

Rethinking Prior-Guided Face Super-Resolution: A New Paradigm with Facial Component Prior.

Facial mask attention network for identity-aware face super-resolution

Propagating Facial Prior Knowledge for Multitask Learning in Face Super-Resolution

MSRFSR: Multi-Stage Refining Face Super-Resolution With Iterative Collaboration Between Face Recovery and Landmark Estimation

Face Super-Resolution with Better Semantics and More Efficient Guidance

Face Super-Resolution Via Hierarchical Multi-Scale Residual Fusion Network.