Abstract:The importance of wild video based image set recognition is becoming monotonically increasing. However, the contents of these collected videos are often complicated, and how to efficiently perform set modeling and feature extraction is a big challenge for set-based classification algorithms. In recent years, some proposed image set classification methods have made a considerable advance by modeling the original image set with covariance matrix, linear subspace, or Gaussian distribution. As a matter of fact, most of them just adopt a single geometric model to describe each given image set, which may lose some other useful information for classification. To tackle this problem, we propose a novel algorithm to model each image set from a multi-geometric perspective. Specifically, the covariance matrix, linear subspace, and Gaussian distribution are applied for set representation simultaneously. In order to fuse these multiple heterogeneous Riemannian manifoldvalued features, the well-equipped Riemannian kernel functions are first utilized to map them into high dimensional Hilbert spaces. Then, a multi-kernel metric learning framework is devised to embed the learned hybrid kernels into a lower dimensional common subspace for classification. We conduct experiments on four widely used datasets corresponding to four different classification tasks: video-based face recognition, set-based object categorization, video-based emotion recognition, and dynamic scene classification, to evaluate the classification performance of the proposed algorithm. Extensive experimental results justify its superiority over the state-of-the-art.

Localized Multifeature Metric Learning for Image-Set-Based Face Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Image Set Classification Using Holistic Multiple Order Statistics Features and Localized Multi-kernel Metric Learning

Local Large-Margin Multi-Metric Learning for Face and Kinship Verification

Multiple Face Tracking and Recognition with Identity-Specific Localized Metric Learning.

Image Set-Based Face Recognition: A Local Multi-keypoint Descriptor-Based Approach.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Multi-manifold Metric Learning for Face Recognition Based on Image Sets

Face Recognition Using Data Driven Local Appearance Features

Attention Control with Metric Learning Alignment for Image Set-based Recognition

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Multilinear Supervised Neighborhood Embedding with Local Descriptor Tensor for Face Recognition

Attention-Set based Metric Learning for Video Face Recognition

Embedding metric learning into set-based face recognition for video surveillance.

Face Recognition With Image Sets Using Locally Grassmannian Discriminant Analysis

Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild

Multiple Riemannian Manifold-valued Descriptors based Image Set Classification with Multi-Kernel Metric Learning

Reconstruction-Based Metric Learning for Unconstrained Face Verification

Robust Facial Expression Recognition Algorithm Based on Local Metric Learning.

A Local Multiple Patterns Feature Descriptor for Face Recognition