Abstract:Face hallucination is a domain-specific super-resolution problem that aims to generate a high-resolution (HR) face image from a low-resolution~(LR) input. In contrast to the existing patch-wise super-resolution models that divide a face image into regular patches and independently apply LR to HR mapping to each patch, we implement deep reinforcement learning and develop a novel attention-aware face hallucination (Attention-FH) framework, which recurrently learns to attend a sequence of patches and performs facial part enhancement by fully exploiting the global interdependency of the image. Specifically, our proposed framework incorporates two components: a recurrent policy network for dynamically specifying a new attended region at each time step based on the status of the super-resolved image and the past attended region sequence, and a local enhancement network for selected patch hallucination and global state updating. The Attention-FH model jointly learns the recurrent policy network and local enhancement network through maximizing a long-term reward that reflects the hallucination result with respect to the whole HR image. Extensive experiments demonstrate that our Attention-FH significantly outperforms the state-of-the-art methods on in-the-wild face images with large pose and illumination variations.

Sample selection method for learning-based image super-resolution

An Adaptive Learning Method for Face Hallucination Using Locality Preserving Projections

Adaptive Manifold Learning Method for Face Hallucination

Manifold Learning-Based Sample Selection Method for Facial Image Super-Resolution

Face Hallucination Based On Sample Selection Bias Correction

Learning Adaptive Local Distance Metric For Face Hallucination

Hallucinating Faces: Global Linear Modal Based Super-Resolution and Position Based Residue Compensation

Learning Super-Resolution Coherent Facial Features Using Nonlinear Multiset Pls For Low-Resolution Face Recognition

A face hallucination method via HR-LLE coefficients constraint

Nonlinear Contextual Face Hallucination.

Locality-constraint iterative neighbor embedding for face hallucination

Contextual-Field Supported Iterative Representation for Face Hallucination.

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Discriminative Face Hallucination Via Locality-Constrained and Category Embedding Representation.

Group Embedding for Face Hallucination

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Face hallucination via K-selection mean constrained sparse representation

From Local Representation to Global Face Hallucination: A Novel Super-Resolution Method by Nonnegative Feature Transformation

Face Hallucination by Learning Local Distance Metric.

Locality Preserving Partial Least Squares for Neighbor Embedding-Based Face Hallucination

Face Hallucination Using Manifold-Regularized Group Locality-Constrained Representation