Abstract:Recent CNN-driven face super-resolution (FSR) technologies have achieved excellent breakthroughs by incorporating facial prior knowledge. However, most of them suffer from some obvious limitations. They always estimate facial priors from input low-resolution (LR) faces or coarsely enhanced LR faces, obtaining unfaithful priors that cannot be adequately exploited. This may bring noticeable artifacts to the target results, especially for large scaling factors, deteriorating the fidelity and naturalness and generating suboptimal reconstructed results. In this paper, we propose a two-stage prior-guided FSR approach to learn facial prior knowledge from the optimal SR results of stage one and explore the complementarity between priors to further guide more accurate reconstruction in stage two. Specifically, we develop an efficient local and global interactive hybrid network incorporating facial semantic and geometric priors for more discriminative results. To reach this, we devise a multiscale interconnected symmetric encoder-decoder architecture composed of Prior Interaction-Integration Modules (PIIMs), the Coarse-to-fine Feature Refinement Module (CFRM), and Feature Aggregation Modulation Modules (FAMMs). The encoder concentrates on hierarchically extracting multiscale features. The CFRM is devised to explore the potential correlations between the encoder and the decoder and further guide the refinement and reinforcement of the encoded features. The decoder aims to take full advantage of informative multiscale encoded features to reconstruct high-quality SR representations. Comprehensive evaluation and visualization results on four benchmark datasets demonstrate the superiority of the proposed PLGNet over current state-of-the-art methods. The source code of PLGNet will be available at https://github.com/lil808/PLGNet.git.

PLGNet: Prior-guided Local and Global Interactive Hybrid Network for Face Super-Resolution

Multi-level landmark-guided deep network for face super-resolution

CFGPFSR: A Generative Method Combining Facial and GAN Priors for Face Super-Resolution

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

Prior Knowledge Distillation Network for Face Super-Resolution

Face Super-Resolution Via Bilayer Contextual Representation

W-Net: A Facial Feature-Guided Face Super-Resolution Network

The face image super-resolution algorithm based on combined representation learning

FSRGAN-DB: Super-resolution Reconstruction Based on Facial Prior Knowledge

GCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

Attention-Driven Graph Neural Network for Deep Face Super-Resolution

Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimation

A Composite Network Model for Face Super-Resolution with Multi-Order Head Attention Facial Priors

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution

DCLNet: Dual Closed-loop Networks for face super-resolution

Progressive reconstruction-decoupled face super-resolution framework with controllable knowledge guidance

Super-Resolving Face Image by Facial Parsing Information

CGC-Net: A Context-Guided Constrained Network for Remote-Sensing Image Super Resolution

Self-attention learning network for face super-resolution