Abstract:Structures matter in single image super-resolution (SISR). Benefiting from generative adversarial networks (GANs), recent studies have promoted the development of SISR by recovering photo-realistic images. However, there are still undesired structural distortions in the recovered images. In this paper, we propose a structure-preserving super-resolution (SPSR) method to alleviate the above issue while maintaining the merits of GAN-based methods to generate perceptual-pleasant details. First, we propose SPSR with gradient guidance (SPSR-G) by exploiting gradient maps of images to guide the recovery in two aspects. On the one hand, we restore high-resolution gradient maps by a gradient branch to provide additional structure priors for the SR process. On the other hand, we propose a gradient loss to impose a second-order restriction on the super-resolved images, which helps generative networks concentrate more on geometric structures. Second, since the gradient maps are handcrafted and may only be able to capture limited aspects of structural information, we further extend SPSR-G by introducing a learnable neural structure extractor (NSE) to unearth richer local structures and provide stronger supervision for SR. We propose two self-supervised structure learning methods, contrastive prediction and solving jigsaw puzzles, to train the NSEs. Our methods are model-agnostic, which can be potentially used for off-the-shelf SR networks. Experimental results on five benchmark datasets show that the proposed methods outperform state-of-the-art perceptual-driven SR methods under LPIPS, PSNR, and SSIM metrics. Visual results demonstrate the superiority of our methods in restoring structures while generating natural SR images. Code is available at https://github.com/Maclory/SPSR.

Structure Prior-Aware Dynamic Network for Face Super-Resolution

A Face Structure Attention Network for Face Super-Resolution

The face image super-resolution algorithm based on combined representation learning

Face Super-Resolution Guided by 3D Facial Priors

Face Super-Resolution Via Progressive-Scale Boosting Network

Multi-Scale Feature Fusion and Structure-Preserving Network for Face Super-Resolution

Attention-Driven Graph Neural Network for Deep Face Super-Resolution

FSRGAN-DB: Super-resolution Reconstruction Based on Facial Prior Knowledge

Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors

DCLNet: Dual Closed-loop Networks for face super-resolution

Learning Face Image Super-Resolution Through Facial Semantic Attribute Transformation and Self-Attentive Structure Enhancement

Prior-guided Dense Up-Down Sampling Network for Face Super-Resolution and Recognition

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

Self-attention learning network for face super-resolution

Propagating Facial Prior Knowledge for Multitask Learning in Face Super-Resolution

Super-Resolution Reconstruction Of Human Face Image Based On Network Of Residual Dense Connection Channel Attentional

W-Net: A Facial Feature-Guided Face Super-Resolution Network

A Composite Network Model for Face Super-Resolution with Multi-Order Head Attention Facial Priors

Face Super-Resolution Via Hierarchical Multi-Scale Residual Fusion Network.

Robust Face Super-Resolution via Patch Network of Global Context Prior

Structure-Preserving Image Super-Resolution