Abstract:By representing each image set as a nonsingular covariance matrix on the symmetric positive definite (SPD) manifold, visual classification with image sets has attracted much attention. Despite the success made so far, the issue of large within-class variability of representations still remains a key challenge. Recently, several SPD matrix learning methods have been proposed to assuage this problem by directly constructing an embedding mapping from the original SPD manifold to a lower dimensional one. The advantage of this type of approach is that it cannot only implement discriminative feature selection but also preserve the Riemannian geometrical structure of the original data manifold. Inspired by this fact, we propose a simple SPD manifold deep learning network (SymNet) for image set classification in this article. Specifically, we first design SPD matrix mapping layers to map the input SPD matrices into new ones with lower dimensionality. Then, rectifying layers are devised to activate the input matrices for the purpose of forming a valid SPD manifold, chiefly to inject nonlinearity for SPD matrix learning with two nonlinear functions. Afterward, we introduce pooling layers to further compress the input SPD matrices, and the log-map layer is finally exploited to embed the resulting SPD matrices into the tangent space via log-Euclidean Riemannian computing, such that the Euclidean learning applies. For SymNet, the (2-D)2principal component analysis (PCA) technique is utilized to learn the multistage connection weights without requiring complicated computations, thus making it be built and trained easier. On the tail of SymNet, the kernel discriminant analysis (KDA) algorithm is coupled with the output vectorized feature representations to perform discriminative subspace learning. Extensive experiments and comparisons with state-of-the-art methods on six typical visual classification tasks demonstrate the feasibility and validity of the proposed SymNet.

Neighborhood Preserved Sparse Representation for Robust Classification on Symmetric Positive Definite Matrices

Locally Adaptive Sparse Representation on Riemannian Manifolds for Robust Classification

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications

Collaborative Representation for SPD Matrices with Application to Image-Set Classification

Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices

Sparse-Representation-Based Classification with Structure-Preserving Dimension Reduction

Semantic And Neighborhood Preserving Dictionary Learning For Symmetric Positive-Definite Matrices

Robust Dictionary Learning and Sparse Coding with Riemannian Geometry Preserving Method in Symmetric Matrices Inner Product Space.

Kernel Sparse Subspace Clustering on Symmetric Positive Definite Manifolds

SymNet: A Simple Symmetric Positive Definite Manifold Deep Learning Method for Image Set Classification

Log-Euclidean Kernels for Sparse Representation and Dictionary Learning

Kernel Clustering on Symmetric Positive Definite Manifolds Via Double Approximated Low Rank Representation

Multiple Kernel Sparse Representation Based Classification

Component SPD Matrices: A lower-dimensional discriminative data descriptor for image set classification

Supervised Classification Via Constrained Subspace and Tensor Sparse Representation.

Use of customizing kernel sparse representation for hyperspectral image classification.

Learning a Robust Representation via a Deep Network on Symmetric Positive Definite Manifolds

Riemannian Multinomial Logistics Regression for SPD Neural Networks

A Robust Distance Measure for Similarity-Based Classification on the SPD Manifold.

Hyperspectral Image Classification with Robust Sparse Representation

Kernel Based Weighted Group Sparse Representation Classifier.