Abstract: This paper considers the problem of image set-based face verification and identification. Unlike traditional single sample (an image or a video) setting, this situation assumes the availability of a set of heterogeneous collection of orderless images and videos. The samples can be taken at different check points, different identity documents $etc$. The importance of each image is usually considered either equal or based on a quality assessment of that image independent of other images and/or videos in that image set. How to model the relationship of orderless images within a set remains a challenge. We address this problem by formulating it as a Markov Decision Process (MDP) in a latent space. Specifically, we first propose a dependency-aware attention control (DAC) network, which uses actor-critic reinforcement learning for attention decision of each image to exploit the correlations among the unordered images. An off-policy experience replay is introduced to speed up the learning process. Moreover, the DAC is combined with a temporal model for videos using divide and conquer strategies. We also introduce a pose-guided representation (PGR) scheme that can further boost the performance at extreme poses. We propose a parameter-free PGR without the need for training as well as a novel metric learning-based PGR for pose alignment without the need for pose detection in testing stage. Extensive evaluations on IJB-A/B/C, YTF, Celebrity-1000 datasets demonstrate that our method outperforms many state-of-art approaches on the set-based as well as video-based face recognition databases.

ECML: an Ensemble Cascade Metric-Learning Mechanism Toward Face Verification

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Discriminative Deep Metric Learning for Face Verification in the Wild

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Metric Learning Based Multi-Patch Ensemble for High Precision Face Verification

Reconstruction-Based Metric Learning for Unconstrained Face Verification

Attention Control with Metric Learning Alignment for Image Set-based Recognition

Local Large-Margin Multi-Metric Learning for Face and Kinship Verification

Scalable Angular Discriminative Deep Metric Learning for Face Recognition

Metric learning for facial kinship verification

Localized Multifeature Metric Learning for Image-Set-Based Face Recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Deep Factorized Metric Learning

Ensemble of Sparse Cross-Modal Metrics for Heterogeneous Face Recognition.

Exponential Discriminative Metric Embedding in Deep Learning

Multi-manifold Metric Learning for Face Recognition Based on Image Sets

Cascaded Maximum Median-Margin Discriminant Projection with Its Application to Face Recognition

Collaborative Multi-View Metric Learning For Visual Classification

Multi-view metric learning for visual classification