Abstract:Face recognition with multiple views is a challenging research problem. Most of the existing works have focused on extracting shared information among multiple views to improve recognition. However, when the pose variation is too large or missing, 'shared information' may not be properly extracted, leading to poor recognition results. In this paper, we propose a novel method for face recognition with multiple view images to overcome the large pose variation and missing pose issue. By introducing a novel mixed norm, the proposed method automatically selects candidates from the gallery to best represent a group of highly correlated face images in a query set to improve classification accuracy. This mixed norm combines the advantages of both sparse representation based classification (SRC) and joint sparse representation based classification (JSRC). A trade off between the ¿ 1 - norm from SRC and ¿ 2 , 1 - norm from JSRC is introduced to achieve this goal. Due to this property, the proposed method decreases the influence when a face image is unseen and has large pose variation in the recognition process. And when some face images with a certain degree of unseen pose variation appear, this mixed norm will find an optimal representation for these query images based on the shared information induced from multiple views. Moreover, we also address an open problem in robust sparse representation and classification which is using ¿ 1 - norm on the loss function to achieve a robust solution. To solve this formulation, we derive a simple, yet provably convergent algorithm based on the powerful alternative directions method of multipliers (ADMM) framework. We provide extensive comparisons which demonstrate that our method outperforms other state-of-the-arts algorithms on CMU-PIE, Yale B and Multi-PIE databases for multi-view face recognition. HighlightsWe introduce a novel mixed-norm that takes a trade-off between ¿ 1 - norm and ¿ 2 , 1 - norm .We use ¿ 1 - norm norm on the loss function to achieve a robust solution.We derive a simple and provably convergent algorithm based on the alternative directions method of multipliers framework.Extensive experiments have been done to demonstrate the performance of the proposed method.

Deep Learning Multi-View Representation for Face Recognition

Variable-Viewpoint Representations for 3D Object Recognition

Multi-view Moments Embedding Network for 3D Shape Recognition

Pursuing Face Identity From View-Specific Representation To View-Invariant Representation

Disentangling 3D/4D Facial Affect Recognition with Faster Multi-View Transformer

Multi-view Fusion with Deep Learning for 3D Shape Classification

Deep Multi-View Feature Learning for Person Re-Identification

Learning Disentangled Representation for Multi-View 3D Object Recognition.

Multi-channel Deep 3D Face Recognition

A Novel Multi-View Dimensionality Reduction and Recognition Framework with Applications to Face Recognition.

A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition

Multi-View Facial Expression Recognition with Multi-View Facial Expression Light Weight Network

Joint Dynamic Sparse Representation for Multi-View Face Recognition

Multi-view face recognition based on manifold learning and multilinear representation

Deep Residual Equivariant Mapping for Multi-angle Face Recognition.

Multi-view face recognition based on tensor subspace analysis and view manifold modeling

Multi-Manifold Approach To Multi-View Face Recognition

Mixed-norm sparse representation for multi view face recognition

Multiple-view D2NNs Array: Realizing Robust 3D Object Recognition.

Pairwise Decomposition of Image Sequences for Active Multi-view Recognition

Multi-view Face Recognition Based on Tensorfaces Algorithm