Abstract:In pattern recognition field, objects are usually represented by multiple features (multimodal features). For example, to characterize a natural scene image, it is essential to extract a set of visual features representing its color, texture, and shape information. However, integrating multimodal features for recognition is challenging because: (1) each feature has its specific statistical property and physical interpretation, (2) huge number of features may result in the curse of dimensionality (When data dimension is high, the distances between pairwise objects in the feature space become increasingly similar due to the central limit theory. This phenomenon influences negatively to the recognition performance), and (3) some features may be unavailable. To solve these problems, a new multimodal feature selection algorithm, termed Grassmann manifold feature selection (GMFS), is proposed. In particular, by defining a clustering criterion, the multimodal features are transformed into a matrix, and further treated as a point on the Grassmann manifold in Hamm and Lee (Grassmann discriminant analysis: a unifying view on subspace-based learning. In: Proceedings of the 25th international conference on machine learning (ICML), pp. 376–383, Helsinki, Finland [ 2008 ]). To deal with the unavailable features, L2-Hausdorff distance, a metric between different-sized matrices, is computed and the kernel is obtained accordingly. Based on the kernel, we propose supervised/unsupervised feature selection algorithms to achieve a physically meaningful embedding of the multimodal features. Experimental results on eight data sets validate the effectiveness the proposed approach.

Effective and Efficient Grassfinch Kernel for SVM Classification and Its Application to Recognition Based on Image Set

A Novel Image Classification Method Based on Manifold Learning and Gaussian Mixture Model

Distance-Based Classifier Via the Kernel Trick.

Grassmann manifold for nearest points image set classification

Graph Embedding Multi-Kernel Metric Learning for Image Set Classification With Grassmannian Manifold-Valued Features

Image Set Classification Using a Distance-Based Kernel Over Affine Grassmann Manifold

Learning adaptive Grassmann neighbors for image-set analysis

Multiple Riemannian Manifold-valued Descriptors based Image Set Classification with Multi-Kernel Metric Learning

Sparse Representation Classifier Guided Grassmann Reconstruction Metric Learning With Applications to Image Set Analysis

Grassmannian Discriminant Maps (GDM) for Manifold Dimensionality Reduction with Application to Image Set Classification

Neighborhood preserving embedding on Grassmann manifold for image-set analysis

Robust Grassmann manifold convex hull collaborative representation learning and its kernel extension for image set analysis

Fast Multi-View Segment Graph Kernel for Object Classification

Improved kernel direct Fisher discriminant analysis and face recognition

Grassmann multimodal implicit feature selection

Extrinsic Methods for Coding and Dictionary Learning on Grassmann Manifolds

Monogenic features based single sample face recognition by kernel sparse representation on multiple Riemannian manifolds

A discriminative multiple-manifold network for image set classification

Grassmannian regularized structured multi-view embedding for image classification.

Image Classification Based On Svm With Generalized Kernel

Image Classification with Kernelized Spatial-Context.