Abstract:In this paper, we propose an identity-preserving face hallucination (IPFH) method via deep reinforcement learning. Most existing methods ultra-resolve facial visual information in guidance of appearance similarity which rarely attend to recovering the semantic property, undermining further face analysis (e.g., recognition). We present a visual-semantic hallucinator relying on deep reinforcement learning to adaptively repair local details for the restoration of both identity and appearance characteristics. Specifically, we first capture the facial global topology structure to roughly recover the visual information with the pixel-wise similarity constraint. To super-resolve more photo-realistic faces, we explore the contextual interdependency to reconstruct facial local textural details (e.g., over-smoothed edges) with the constraints of visual and identity similarity. In terms of the visual similarity constraint, we develop the dual domain network with bidirectional consistency on both HR domain and LR domain to improve the appearance quality. Moreover, we introduce the identity constraint to encourage hallucinated faces to satisfy the identity property. Experimental results on several benchmarks demonstrate our method achieves promising performance on the recovery of visual and semantic information.

An Example-Based Two-Step Face Hallucination Method through Coefficient Learning

An Improved Two-Step Approach to Hallucinating Faces

A Two-Step Approach to Hallucinating Faces: Global Parametric Model and Local Nonparametric Model

MAP-Based Two-Step Approach to Hallucinating Faces

Position-based face hallucination method

Hallucinating Face by Position-Patch

Hallucinating Faces: Global Linear Modal Based Super-Resolution and Position Based Residue Compensation

Face Hallucination VIA Sparse Coding.

A New Technique for Face Image Resolution Enhancement Based on Face Hallucination

Steerable pyramid-based face hallucination

Contextual-Field Supported Iterative Representation for Face Hallucination.

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Multiple Exemplars-based Hallucinationfor Face Super-resolution and Editing

Face Hallucination Via Semi-Kernel Partial Least Squares

Hallucinating facial images and features

Locality-Constrained Double Low-Rank Representation for Effective Face Hallucination

C-Face: Using Compare Face on Face Hallucination for Low-Resolution Face Recognition

Face hallucination via position-based dictionaries coding in kernel feature space

Super-Identity Convolutional Neural Network for Face Hallucination

Face Hallucination Using Deep Collaborative Representation for Local and Non-Local Patches

Identity-Preserving Face Hallucination via Deep Reinforcement Learning