Abstract:Along with the performance improvement of deep-learning-based face hallucination methods, various face priors (facial shape, facial landmark heatmaps, or parsing maps) have been used to describe holistic and partial facial features, making the cost of generating super-resolved face images expensive and laborious. To deal with this problem, we present a simple yet effective dual-path deep fusion network (DPDFN) for face image super-resolution (SR) without requiring additional face prior, which learns the global facial shape and local facial components through two individual branches. The proposed DPDFN is composed of three components: a global memory subnetwork (GMN), a local reinforcement subnetwork (LRN), and a fusion and reconstruction module (FRM). In particular, GMN characterize the holistic facial shape by employing recurrent dense residual learning to excavate wide-range context across spatial series. Meanwhile, LRN is committed to learning local facial components, which focuses on the patch-wise mapping relations between low-resolution (LR) and high-resolution (HR) space on local regions rather than the entire image. Furthermore, by aggregating the global and local facial information from the preceding dual-path subnetworks, FRM can generate the corresponding high-quality face image. Experimental results of face hallucination on public face data sets and face recognition on real-world data sets (VGGface and SCFace) show the superiority both on visual effect and objective indicators over the previous state-of-the-art methods.

Face Hallucination Using Deep Collaborative Representation for Local and Non-Local Patches

Face Hallucination Using Region-Based Deep Convolutional Networks

Context-Patch Face Hallucination Based on Thresholding Locality-constrained Representation and Reproducing Learning.

Face Hallucination By Deep Traversal Network

Attention-Aware Face Hallucination Via Deep Reinforcement Learning.

Contextual-Field Supported Iterative Representation for Face Hallucination.

Face hallucination based on stepwise sparse reconstruction

Position-Patch Based Face Hallucination via Locality-Constrained Representation

Parallel Region-Based Deep Residual Networks for Face Hallucination.

Group Embedding for Face Hallucination

Face Hallucination Via Multiple Feature Learning with Hierarchical Structure

Dual-Path Deep Fusion Network for Face Image Hallucination.

Matrix Based Regression With Local Position-Patch And Nonlocal Similarity For Face Hallucination

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Face Hallucination Via Multi-Scale Structure Prior Learning

Nonlinear Contextual Face Hallucination.

From Local Representation to Global Face Hallucination: A Novel Super-Resolution Method by Nonnegative Feature Transformation

Face Hallucination Via Locality-Constrained Low-Rank Representation

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Face Hallucination Via Semi-Kernel Partial Least Squares

Face Hallucination in a High Resolution Feature Space Using an Intermediate Dictionary Learning Via Reference Patch Embedding