Abstract:As the facial image captured by a low-cost camera is typically very Low-Resolution (LR), blurring and noisy, traditional neighbor embedding based facial image hallucination methods from one single manifold (i.e., the LR image manifold) fail to reliably estimate the intention geometrical structure, consequently leading to a bias to the image reconstruction result. In this paper, we introduce the notion of neighbor embedding from the LR and the High-Resolution (HR) image manifolds simultaneously and propose a novel neighbor embedding model, termed the Coupled-Layer Neighbor Embedding (CLNE), for facial image hallucination. CLNE differs substantially from other neighbor embedding models in that it has two layers: the LR and the HR layers. The LR layer in this model is the local geometrical structure of the LR patch manifold, which is characterized by the reconstruction weights of the LR patches; the HR layer is the intrinsic geometry that can geometrically constrain the reconstruction weights. With this coupled constraint paradigm between the adaptation of the LR layer and the HR one, CLNE can achieve a more robust neighbor embedding through iteratively updating the LR patch reconstruction weights and the estimated HR patch. The experimental results in simulation and real conditions confirm that the proposed method outperforms the related state-of-the-art methods in both quantitative and visual comparisons.

Hallucinating 3d Facial Shapes

Hallucinating 3d Faces

3D Face Hallucination from a Single Depth Frame

Face Hallucination: Theory and Practice

Recovering 3D Facial Shape Via Coupled 2D/3D Space Learning

3D Face Recognition Via Conformal Representation

“Edutainment 2017” a Visual and Semantic Representation of 3D Face Model for Reshaping Face in Images

Hallucinating facial images and features

Contextual-Field Supported Iterative Representation for Face Hallucination.

A Two-Step Approach to Hallucinating Faces: Global Parametric Model and Local Nonparametric Model

Group Embedding for Face Hallucination

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Face Hallucination Based on Modified Neighbor Embedding and Global Smoothness Constraint.

Face Hallucination via Similarity Constraints

Shape Adaptation from Self-Occluding Contour in Face Modeling.

Face Hallucination Via Semi-Kernel Partial Least Squares

Face Hallucination Using Region-Based Deep Convolutional Networks

A Joint Learning Based Face Hallucination Approach For Low Quality Face Image

Extreme 3D Face Reconstruction: Seeing Through Occlusions

Facial Image Hallucination through Coupled-Layer Neighbor Embedding

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.