Abstract:Face super-resolution (SR) algorithms have recently made significant progress. However, most existing methods prefer to employ texture and structure information together to promote the generation of high-resolution features, neglecting the mutual encouragement between them, as well as the effective unification of their own low-level and high-level information, thus yielding unsatisfactory results. To address these problems, we propose an implicit mutual learning of dual-branch networks for face super-resolution, which adequately considers both extraction and aggregation of structure and texture information. The proposed approach consists of four essential blocks. First, the deep feature extractor is equipped with a deep feature reinforcement module (DFRM) based on two-stage cross-dimensional attention (TCA), which behaves in the texture enhancement and structure reconstruction branches, respectively. Then, we elaborate two information exchange blocks for two branches, one for the first information exchange block (FIEB) from the texture branch to the structure branch and one for the second information exchange block (SIEB) from the structure branch to the texture branch. These two interaction blocks perform further fusion enhancement of potential features. Finally, a hybrid fusion network (HFNet) based on supervised attention executes adaptive aggregation of the enhanced texture and structure maps. Additionally, we use a joint loss function that modifies the recovery of structure information, diminishes the use of potentially erroneous information, and encourages the generation of realistic face images. Experiments on public datasets show that our method consistently achieves better quantitative and qualitative results than SOTA methods.

Learning Unified Representations for Multi-Resolution Face Recognition

Two-Stage Multi-Scale Resolution-Adaptive Network for Low-Resolution Face Recognition

Collaborative Learning with a Multi-Branch Framework for Feature Enhancement.

Multi-Depth Branch Network for Efficient Image Super-Resolution

Trunk-Branch Ensemble Convolutional Neural Networks for Video-Based Face Recognition

Classifier Shared Deep Network with Multi-Hierarchy Loss for Low Resolution Face Recognition

MBNet: A Multi-Resolution Branch Network for Semantic Segmentation Of Ultra-High Resolution Images

A Facial Expression Recognition Method Based on a Multibranch Cross-Connection Convolutional Neural Network

Facial Landmark Machines: A Backbone-Branches Architecture with Progressive Representation Learning

FM2u-Net: Face Morphological Multi-Branch Network for Makeup-Invariant Face Verification

Multi‐branch Network with Hierarchical Bilinear Pooling for Person Reidentification

DR-Net: A Multi-View Face Synthesis Network Driven by Dual Representation

MMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction

Scene Classification Via Learning a Multi-Branch Convolutional Network.

A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images

Multi-branch Attention Consistency Network for Facial Expression Recognition

Prior-guided Dense Up-Down Sampling Network for Face Super-Resolution and Recognition

Facial Landmark Localization in the Wild by Backbone-Branches Representation Learning

UFaceNet: Research on Multi-Task Face Recognition Algorithm Based on CNN.

Implicit Mutual Learning with Dual-Branch Networks for Face Super-Resolution