Abstract:As the facial image captured by a low-cost camera is typically very Low-Resolution (LR), blurring and noisy, traditional neighbor embedding based facial image hallucination methods from one single manifold (i.e., the LR image manifold) fail to reliably estimate the intention geometrical structure, consequently leading to a bias to the image reconstruction result. In this paper, we introduce the notion of neighbor embedding from the LR and the High-Resolution (HR) image manifolds simultaneously and propose a novel neighbor embedding model, termed the Coupled-Layer Neighbor Embedding (CLNE), for facial image hallucination. CLNE differs substantially from other neighbor embedding models in that it has two layers: the LR and the HR layers. The LR layer in this model is the local geometrical structure of the LR patch manifold, which is characterized by the reconstruction weights of the LR patches; the HR layer is the intrinsic geometry that can geometrically constrain the reconstruction weights. With this coupled constraint paradigm between the adaptation of the LR layer and the HR one, CLNE can achieve a more robust neighbor embedding through iteratively updating the LR patch reconstruction weights and the estimated HR patch. The experimental results in simulation and real conditions confirm that the proposed method outperforms the related state-of-the-art methods in both quantitative and visual comparisons.

Face Hallucination Via Re-Identified K-nearest Neighbors Embedding

Locality-constraint iterative neighbor embedding for face hallucination

Super-Resolution for Face Image with an Improved K-NN Search Strategy

Locality Constraint Neighbor Embedding Via KPCA and Optimized Reference Patch for Face Hallucination

Facial Image Hallucination through Coupled-Layer Neighbor Embedding

Face Hallucination Based on Modified Neighbor Embedding and Global Smoothness Constraint.

Face Hallucination Scheme Based On Singular Value Content Metric For K-Nn Selection And An Iterative Refining In A Modified Feature Space

Locality Preserving Partial Least Squares for Neighbor Embedding-Based Face Hallucination

Coupled-Layer Neighbor Embedding for Surveillance Face Hallucination

Modified Neighbor Embedding-Based Face Hallucination Using Coupled Mappings of Partial Least Squares

Locality Constraint Neighbour Embedding Via Reference Patch

Face Hallucination in a High Resolution Feature Space Using an Intermediate Dictionary Learning Via Reference Patch Embedding

Group Embedding for Face Hallucination

Face Hallucination Using Correlative Residue Compensation in a Modified Feature Space.

Face Hallucination Via Semi-Kernel Partial Least Squares

Face Hallucination via KNN Sparse Coding Mean Constrained

Face Hallucination Via Multiple Feature Learning with Hierarchical Structure

A Joint Learning Based Face Hallucination Approach For Low Quality Face Image

Face Super-Resolution Via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning.

Face hallucination via K-selection mean constrained sparse representation

Surveillance Face Hallucination Via Variable Selection and Manifold Learning.