Abstract:Super-resolution of facial images, a.k.a. face hallucination, has been intensively studied in the past decades due to the increasingly emerging analysis demands in video surveillance, e.g., face detection, verification, identification. However, the actual performance of most previous hallucination approaches will drop dramatically when a very low-res tiny face is provided, due to the challenging multimodality of the problem as well as lack of an informative prior as a strong semantic guidance. Inspired by the latest progress in deep unsupervised learning, this paper focuses on tiny faces of size 16 × 16 pixels, hallucinating them to their 8 × upsampling versions by exploring the potentials of Wasserstein generative adversarial networks (WGAN). Besides a pixel-wise L2 regularization term imposed to the generative model, it is found that our advocated autoencoding generator with both residual and skip connections is a critical component for WGAN representing the facial contour and semantic content to a reasonable precision. With the additional Lipschitz penalty and architectural considerations for the critic in WGAN, the proposed approach finally achieves state-of-the-art hallucination performance in terms of both visual perception and objective assessment. The cropped CelebA face dataset is primarily used to aid the tuning and analysis of the new method, termed as tfh-WGAN. Experimental results demonstrate that the proposed approach not only achieves realistic hallucination of tiny faces, but also adapts to pose, expression, illuminance and occluded variations to a great degree.

A Wavelet-based Learning for Face Hallucination with Loop Architecture

Self-Enhanced Convolutional Network for Facial Video Hallucination

Supervised-learning Based Face Hallucination for Enhancing Face Recognition.

Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination.

Parallel Region-Based Deep Residual Networks for Face Hallucination.

Learning-based Face Hallucination in DCT Domain

Contextual-Field Supported Iterative Representation for Face Hallucination.

A Joint Learning Based Face Hallucination Approach For Low Quality Face Image

Attention-Aware Face Hallucination Via Deep Reinforcement Learning.

Face Hallucination Via Multi-Scale Structure Prior Learning

Face Hallucination: Theory and Practice

Nonlinear Contextual Face Hallucination.

Group Embedding for Face Hallucination

An Adaptive Learning Method for Face Hallucination Using Locality Preserving Projections

Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning

Heatmap-Aware Pyramid Face Hallucination.

Face Hallucination Via Multiple Feature Learning with Hierarchical Structure

On potentials of regularized Wasserstein generative adversarial networks for realistic hallucination of tiny faces

Learning to Hallucinate Face in the Dark

Multiple Exemplars-based Hallucinationfor Face Super-resolution and Editing

Adaptive Manifold Learning Method for Face Hallucination