Abstract:As the facial image captured by a low-cost camera is typically very Low-Resolution (LR), blurring and noisy, traditional neighbor embedding based facial image hallucination methods from one single manifold (i.e., the LR image manifold) fail to reliably estimate the intention geometrical structure, consequently leading to a bias to the image reconstruction result. In this paper, we introduce the notion of neighbor embedding from the LR and the High-Resolution (HR) image manifolds simultaneously and propose a novel neighbor embedding model, termed the Coupled-Layer Neighbor Embedding (CLNE), for facial image hallucination. CLNE differs substantially from other neighbor embedding models in that it has two layers: the LR and the HR layers. The LR layer in this model is the local geometrical structure of the LR patch manifold, which is characterized by the reconstruction weights of the LR patches; the HR layer is the intrinsic geometry that can geometrically constrain the reconstruction weights. With this coupled constraint paradigm between the adaptation of the LR layer and the HR one, CLNE can achieve a more robust neighbor embedding through iteratively updating the LR patch reconstruction weights and the estimated HR patch. The experimental results in simulation and real conditions confirm that the proposed method outperforms the related state-of-the-art methods in both quantitative and visual comparisons.

Modified Neighbor Embedding-Based Face Hallucination Using Coupled Mappings of Partial Least Squares

Locality Preserving Partial Least Squares for Neighbor Embedding-Based Face Hallucination

Face Hallucination Based on Modified Neighbor Embedding and Global Smoothness Constraint.

Facial Image Hallucination through Coupled-Layer Neighbor Embedding

Coupled-Layer Neighbor Embedding for Surveillance Face Hallucination

Face Hallucination Via Multiple Feature Learning with Hierarchical Structure

Face Hallucination in a High Resolution Feature Space Using an Intermediate Dictionary Learning Via Reference Patch Embedding

Locality-constraint iterative neighbor embedding for face hallucination

Face Hallucination Via Re-Identified K-nearest Neighbors Embedding

Face Hallucination Using Correlative Residue Compensation in a Modified Feature Space.

Group Embedding for Face Hallucination

Face Hallucination Based on Neighbor Embedding Via Illumination Adaptation

A Joint Learning Based Face Hallucination Approach For Low Quality Face Image

Nearest Feature Line Embedding for Face Hallucination

Locality Constraint Neighbor Embedding Via KPCA and Optimized Reference Patch for Face Hallucination

Face Hallucination Via Semi-Kernel Partial Least Squares

Surveillance Face Hallucination Via Variable Selection and Manifold Learning.

Multi-pose Face Hallucination Via Neighbor Embedding for Facial Components

Face Hallucination Scheme Based On Singular Value Content Metric For K-Nn Selection And An Iterative Refining In A Modified Feature Space

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Learning Adaptive Local Distance Metric For Face Hallucination