Abstract:As the facial image captured by a low-cost camera is typically very Low-Resolution (LR), blurring and noisy, traditional neighbor embedding based facial image hallucination methods from one single manifold (i.e., the LR image manifold) fail to reliably estimate the intention geometrical structure, consequently leading to a bias to the image reconstruction result. In this paper, we introduce the notion of neighbor embedding from the LR and the High-Resolution (HR) image manifolds simultaneously and propose a novel neighbor embedding model, termed the Coupled-Layer Neighbor Embedding (CLNE), for facial image hallucination. CLNE differs substantially from other neighbor embedding models in that it has two layers: the LR and the HR layers. The LR layer in this model is the local geometrical structure of the LR patch manifold, which is characterized by the reconstruction weights of the LR patches; the HR layer is the intrinsic geometry that can geometrically constrain the reconstruction weights. With this coupled constraint paradigm between the adaptation of the LR layer and the HR one, CLNE can achieve a more robust neighbor embedding through iteratively updating the LR patch reconstruction weights and the estimated HR patch. The experimental results in simulation and real conditions confirm that the proposed method outperforms the related state-of-the-art methods in both quantitative and visual comparisons.

Locality Constraint Neighbor Embedding Via KPCA and Optimized Reference Patch for Face Hallucination

Locality Constraint Neighbour Embedding Via Reference Patch

Locality-constraint iterative neighbor embedding for face hallucination

Face Hallucination Via Re-Identified K-nearest Neighbors Embedding

Locality Preserving Partial Least Squares for Neighbor Embedding-Based Face Hallucination

Face Hallucination in a High Resolution Feature Space Using an Intermediate Dictionary Learning Via Reference Patch Embedding

Face Hallucination Based on Modified Neighbor Embedding and Global Smoothness Constraint.

Face Super-Resolution Via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning.

Modified Neighbor Embedding-Based Face Hallucination Using Coupled Mappings of Partial Least Squares

Face Hallucination Using Correlative Residue Compensation in a Modified Feature Space.

Super-Resolution for Face Image with an Improved K-NN Search Strategy

Group Embedding for Face Hallucination

Face Hallucination Via Semi-Kernel Partial Least Squares

Kernel-Based Face Hallucination Via Dual Regularization Priors

Face hallucination via position-based dictionaries coding in kernel feature space

Hallucinating Faces: LPH Super-Resolution and Neighbor Reconstruction for Residue Compensation.

Face Hallucination Using Deep Collaborative Representation for Local and Non-Local Patches

Position-Patch Based Face Hallucination via Locality-Constrained Representation

Face Hallucination Through KPCA

Facial Image Hallucination through Coupled-Layer Neighbor Embedding

Face Hallucination via KNN Sparse Coding Mean Constrained