Abstract:Face hallucination is a domain-specific super-resolution problem that aims to generate a high-resolution (HR) face image from a low-resolution~(LR) input. In contrast to the existing patch-wise super-resolution models that divide a face image into regular patches and independently apply LR to HR mapping to each patch, we implement deep reinforcement learning and develop a novel attention-aware face hallucination (Attention-FH) framework, which recurrently learns to attend a sequence of patches and performs facial part enhancement by fully exploiting the global interdependency of the image. Specifically, our proposed framework incorporates two components: a recurrent policy network for dynamically specifying a new attended region at each time step based on the status of the super-resolved image and the past attended region sequence, and a local enhancement network for selected patch hallucination and global state updating. The Attention-FH model jointly learns the recurrent policy network and local enhancement network through maximizing a long-term reward that reflects the hallucination result with respect to the whole HR image. Extensive experiments demonstrate that our Attention-FH significantly outperforms the state-of-the-art methods on in-the-wild face images with large pose and illumination variations.

Locality-Constrained Double Low-Rank Representation for Effective Face Hallucination

Learning a Locality Preserving Subspace for Visual Recognition.

Robust Face Hallucination Via Locality-Constrained Nuclear Norm Regularized Regression

Learning Adaptive Local Distance Metric For Face Hallucination

Contextual-Field Supported Iterative Representation for Face Hallucination.

Face Hallucination by Learning Local Distance Metric.

Face Hallucination Using Deep Collaborative Representation for Local and Non-Local Patches

Hallucinating facial images and features

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Position-based face hallucination method

Nuclear Norm Regularized Coding with Local Position-Patch and Nonlocal Similarity for Face Hallucination.

Identity-Preserving Face Hallucination via Deep Reinforcement Learning

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Hallucinating Face by Position-Patch

Face Hallucination VIA Sparse Coding.

An Example-Based Two-Step Face Hallucination Method through Coefficient Learning

Robust Low-Resolution Face Recognition Via Low-Rank Representation and Locality-Constrained Regression

Contrastive Learning with Hallucinating Data for Long-Tailed Face Recognition.

An Improved Two-Step Approach to Hallucinating Faces

Hallucinating Faces: Global Linear Modal Based Super-Resolution and Position Based Residue Compensation