Abstract:Face super-resolution (SR) algorithms have recently made significant progress. However, most existing methods prefer to employ texture and structure information together to promote the generation of high-resolution features, neglecting the mutual encouragement between them, as well as the effective unification of their own low-level and high-level information, thus yielding unsatisfactory results. To address these problems, we propose an implicit mutual learning of dual-branch networks for face super-resolution, which adequately considers both extraction and aggregation of structure and texture information. The proposed approach consists of four essential blocks. First, the deep feature extractor is equipped with a deep feature reinforcement module (DFRM) based on two-stage cross-dimensional attention (TCA), which behaves in the texture enhancement and structure reconstruction branches, respectively. Then, we elaborate two information exchange blocks for two branches, one for the first information exchange block (FIEB) from the texture branch to the structure branch and one for the second information exchange block (SIEB) from the structure branch to the texture branch. These two interaction blocks perform further fusion enhancement of potential features. Finally, a hybrid fusion network (HFNet) based on supervised attention executes adaptive aggregation of the enhanced texture and structure maps. Additionally, we use a joint loss function that modifies the recovery of structure information, diminishes the use of potentially erroneous information, and encourages the generation of realistic face images. Experiments on public datasets show that our method consistently achieves better quantitative and qualitative results than SOTA methods.

Unsupervised face super-resolution via gradient enhancement and semantic guidance

Depth Image Super-resolution via Two-Branch Network

The face image super-resolution algorithm based on combined representation learning

SelFSR: Self-Conditioned Face Super-Resolution in the Wild Via Flow Field Degradation Network

A Face Super-Resolution Reconstruction Algorithm Based on Residual Estimation

Face Super-Resolution Via Progressive-Scale Boosting Network

Learning Face Image Super-Resolution Through Facial Semantic Attribute Transformation and Self-Attentive Structure Enhancement

Face Super-Resolution with Better Semantics and More Efficient Guidance

Guided Cascaded Super-Resolution Network for Face Image

Gradient-Guided and Multi-Scale Feature Network for Image Super-Resolution

Prior-guided Dense Up-Down Sampling Network for Face Super-Resolution and Recognition

Implicit Mutual Learning with Dual-Branch Networks for Face Super-Resolution

Self-attention learning network for face super-resolution

A Face Structure Attention Network for Face Super-Resolution

Multi-level landmark-guided deep network for face super-resolution

Face Super-Resolution Guided by 3D Facial Priors

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors.

Multi-Scale Spatial Transformation and Attention Based Super-Resolution Reconstruction Algorithm

Recovering Extremely Degraded Faces by Joint Super-Resolution and Facial Composite

Image Super-Resolution Reconstruction Based on a Generative Adversarial Network

Face Super-Resolution with Progressive Embedding of Multi-scale Face Priors