Abstract:Face hallucination is a domain-specific super-resolution problem with the goal to generate high-resolution (HR) faces from low-resolution (LR) input images. In contrast to existing methods that often learn a single patch-to-patch mapping from LR to HR images and are regardless of the contextual interdependency between patches, we propose a novel Attention-aware Face Hallucination (Attention-FH) framework which resorts to deep reinforcement learning for sequentially discovering attended patches and then performing the facial part enhancement by fully exploiting the global interdependency of the image. Specifically, in each time step, the recurrent policy network is proposed to dynamically specify a new attended region by incorporating what happened in the past. The state (i.e., face hallucination result for the whole image) can thus be exploited and updated by the local enhancement network on the selected region. The Attention-FH approach jointly learns the recurrent policy network and local enhancement network through maximizing the long-term reward that reflects the hallucination performance over the whole image. Therefore, our proposed Attention-FH is capable of adaptively personalizing an optimal searching path for each face image according to its own characteristic. Extensive experiments show our approach significantly surpasses the state-of-the-arts on in-the-wild faces with large pose and illumination variations.

Face Hallucination: How Much It Can Improve Face Recognition

Hallucinating facial images and features

Face Hallucination: Theory and Practice

A survey of face hallucination

Supervised-learning Based Face Hallucination for Enhancing Face Recognition.

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Face Enhancement and Hallucination in the Wild

A New Technique for Face Image Resolution Enhancement Based on Face Hallucination

An Improved Two-Step Approach to Hallucinating Faces

Face Hallucination under an Image Decomposition Perspective

Recognition Oriented Feature Hallucination for Low Resolution Face Images.

Contextual-Field Supported Iterative Representation for Face Hallucination.

Face hallucination based on morphological component analysis

MAP-Based Two-Step Approach to Hallucinating Faces

Super-Identity Convolutional Neural Network for Face Hallucination

Steerable pyramid-based face hallucination

Attention-Aware Face Hallucination Via Deep Reinforcement Learning.

Self-Enhanced Convolutional Network for Facial Video Hallucination

Efficient learning based face hallucination approach via facial standard deviation prior

Discriminative Face Hallucination Via Locality-Constrained and Category Embedding Representation.

Nonlinear Contextual Face Hallucination.