Abstract:Recent CNN-driven face super-resolution (FSR) technologies have achieved excellent breakthroughs by incorporating facial prior knowledge. However, most of them suffer from some obvious limitations. They always estimate facial priors from input low-resolution (LR) faces or coarsely enhanced LR faces, obtaining unfaithful priors that cannot be adequately exploited. This may bring noticeable artifacts to the target results, especially for large scaling factors, deteriorating the fidelity and naturalness and generating suboptimal reconstructed results. In this paper, we propose a two-stage prior-guided FSR approach to learn facial prior knowledge from the optimal SR results of stage one and explore the complementarity between priors to further guide more accurate reconstruction in stage two. Specifically, we develop an efficient local and global interactive hybrid network incorporating facial semantic and geometric priors for more discriminative results. To reach this, we devise a multiscale interconnected symmetric encoder-decoder architecture composed of Prior Interaction-Integration Modules (PIIMs), the Coarse-to-fine Feature Refinement Module (CFRM), and Feature Aggregation Modulation Modules (FAMMs). The encoder concentrates on hierarchically extracting multiscale features. The CFRM is devised to explore the potential correlations between the encoder and the decoder and further guide the refinement and reinforcement of the encoded features. The decoder aims to take full advantage of informative multiscale encoded features to reconstruct high-quality SR representations. Comprehensive evaluation and visualization results on four benchmark datasets demonstrate the superiority of the proposed PLGNet over current state-of-the-art methods. The source code of PLGNet will be available at https://github.com/lil808/PLGNet.git.

SANet: Face Super-Resolution Based on Self-Similarity Prior and Attention Integration

A Face Structure Attention Network for Face Super-Resolution

SCTANet: A Spatial Attention-Guided CNN-Transformer Aggregation Network for Deep Face Image Super-Resolution

Face Super-Resolution Via Progressive-Scale Boosting Network

SAAN: Semantic Attention Adaptation Network for Face Super-Resolution

Frequency-Separated Attention Network for Image Super-Resolution

Self-attention learning network for face super-resolution

See As You Desire: Scale-adaptive Face Super-Resolution for Varying Low Resolutions

TANet: A new Paradigm for Global Face Super-resolution via Transformer-CNN Aggregation Network

Facial mask attention network for identity-aware face super-resolution

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

PLGNet: Prior-guided Local and Global Interactive Hybrid Network for Face Super-Resolution

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

Multi-feature Self-Attention Super-Resolution Network

Spatial-Frequency Mutual Learning for Face Super-Resolution

Self Residual Attention Network for Deep Face Recognition

Deep and Adaptive Feature Extraction Attention Network for Single Image Super‐resolution

Multi-level landmark-guided deep network for face super-resolution

MSRFSR: Multi-Stage Refining Face Super-Resolution With Iterative Collaboration Between Face Recovery and Landmark Estimation

CVANet: Cascaded visual attention network for single image super-resolution

SMFANet: A Lightweight Self-Modulation Feature Aggregation Network for Efficient Image Super-Resolution