Abstract:Along with the performance improvement of deep-learning-based face hallucination methods, various face priors (facial shape, facial landmark heatmaps, or parsing maps) have been used to describe holistic and partial facial features, making the cost of generating super-resolved face images expensive and laborious. To deal with this problem, we present a simple yet effective dual-path deep fusion network (DPDFN) for face image super-resolution (SR) without requiring additional face prior, which learns the global facial shape and local facial components through two individual branches. The proposed DPDFN is composed of three components: a global memory subnetwork (GMN), a local reinforcement subnetwork (LRN), and a fusion and reconstruction module (FRM). In particular, GMN characterize the holistic facial shape by employing recurrent dense residual learning to excavate wide-range context across spatial series. Meanwhile, LRN is committed to learning local facial components, which focuses on the patch-wise mapping relations between low-resolution (LR) and high-resolution (HR) space on local regions rather than the entire image. Furthermore, by aggregating the global and local facial information from the preceding dual-path subnetworks, FRM can generate the corresponding high-quality face image. Experimental results of face hallucination on public face data sets and face recognition on real-world data sets (VGGface and SCFace) show the superiority both on visual effect and objective indicators over the previous state-of-the-art methods.

Face Enhancement and Hallucination in the Wild

Learning to Hallucinate Face in the Dark

Face Hallucination: How Much It Can Improve Face Recognition

Face Hallucination: Theory and Practice

Attention-Aware Face Hallucination Via Deep Reinforcement Learning.

Face Hallucination under an Image Decomposition Perspective

Hallucinating facial images and features

A survey of face hallucination

Self-Enhanced Convolutional Network for Facial Video Hallucination

Extraction of High-Resolution Face Image from Low-Resolution and Variant Illumination Video Sequences

Hallucinating Faces by Interpolation and Principal Component Analysis

Supervised-learning Based Face Hallucination for Enhancing Face Recognition.

Face Hallucination By Deep Traversal Network

Adaptive Aggregation Network for Face Hallucination

A New Technique for Face Image Resolution Enhancement Based on Face Hallucination

A Joint Learning Based Face Hallucination Approach For Low Quality Face Image

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

An Improved Two-Step Approach to Hallucinating Faces

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Dual-Path Deep Fusion Network for Face Image Hallucination.

A Comprehensive Survey to Face Hallucination