Abstract:This paper presents an approach for cross-pose face recognition by virtual view generation using an appearance clustering based local view transition model. Previously, the traditional global pattern based view transition model (VTM) method was extended to its local version called LVTM, which learns the linear transformation of pixel values between frontal and non-frontal image pairs from training images using partial image in a small region for each location, instead of transforming the entire image pattern. In this paper we show that the accuracy of the appearance transition model and the recognition rate can be further improved by better exploiting the inherent linear relationship between frontal-nonfrontal face image patch pairs. This is achieved based on the observation that variations in appearance caused by pose are closely related to the corresponding 3D structure and intuitively frontal-nonfrontal patch pairs from more similar local 3D face structures should have a stronger linear relationship. Thus for each specific location, instead of learning a common transformation as in the LVTM, the corresponding local patches are first clustered based on an appearance similarity distance metric and then the transition models are learned separately for each cluster. In the testing stage, each local patch for the input non-frontal probe image is transformed using the learned local view transition model corresponding to the most visually similar cluster. The experimental results on a real-world face dataset demonstrated the superiority of the proposed method in terms of recognition rate.

Virtual view generation using clustering based local view transition model

Cross-Pose Face Recognition — A Virtual View Generation Approach Using Clustering Based LVTM

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

Virtual Face Image Generation for Illumination and Pose Insensitive Face Recognition

A Novel Multi-View SVM Based on Consistent Hidden Density Distributions Between Views for Face Recognition

Toward Realistic Virtual Try-on Through Landmark Guided Shape Matching

Locally Linear Regression for Pose-Invariant Face Recognition

Title Co-Learned MultiView Spectral Clustering for FaceRecognition Based on Image Sets

Example-based learning for view-based human face detection

Sequential Clustering based Facial Feature Extraction Method for Automatic Creation of Facial Models from Orthogonal Views

A survey of virtual sample generation technology for face recognition

Face Recognition Using Local Variation

Multi-view gait recognition with incomplete training data

Nearest-Subspace Patch Matching For Face Recognition Under Varying Pose And Illumination

Deep Cross-View Reconstruction GAN Based on Correlated Subspace for Multi-View Transformation

Co-Learned Multi-View Spectral Clustering for Face Recognition Based on Image Sets.

Face Pose Normalization and Simulation Methods Based on Multi-View Face Alignment

Discriminative virtual views for cross-view action recognition

Improved 3D Assisted Pose-Invariant Face Recognition

Video-based face recognition using tensor and clustering

RenderNet: Visual Relocalization Using Virtual Viewpoints in Large-Scale Indoor Environments