Abstract:By representing each image set as a nonsingular covariance matrix on the symmetric positive definite (SPD) manifold, visual classification with image sets has attracted much attention. Despite the success made so far, the issue of large within-class variability of representations still remains a key challenge. Recently, several SPD matrix learning methods have been proposed to assuage this problem by directly constructing an embedding mapping from the original SPD manifold to a lower dimensional one. The advantage of this type of approach is that it cannot only implement discriminative feature selection but also preserve the Riemannian geometrical structure of the original data manifold. Inspired by this fact, we propose a simple SPD manifold deep learning network (SymNet) for image set classification in this article. Specifically, we first design SPD matrix mapping layers to map the input SPD matrices into new ones with lower dimensionality. Then, rectifying layers are devised to activate the input matrices for the purpose of forming a valid SPD manifold, chiefly to inject nonlinearity for SPD matrix learning with two nonlinear functions. Afterward, we introduce pooling layers to further compress the input SPD matrices, and the log-map layer is finally exploited to embed the resulting SPD matrices into the tangent space via log-Euclidean Riemannian computing, such that the Euclidean learning applies. For SymNet, the (2-D)2principal component analysis (PCA) technique is utilized to learn the multistage connection weights without requiring complicated computations, thus making it be built and trained easier. On the tail of SymNet, the kernel discriminant analysis (KDA) algorithm is coupled with the output vectorized feature representations to perform discriminative subspace learning. Extensive experiments and comparisons with state-of-the-art methods on six typical visual classification tasks demonstrate the feasibility and validity of the proposed SymNet.

Kernel Sparse Subspace Clustering on Symmetric Positive Definite Manifolds

Kernel Clustering on Symmetric Positive Definite Manifolds Via Double Approximated Low Rank Representation

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications

Semi-supervised sparse subspace clustering with manifold regularization

Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices

Online Dictionary Learning On Symmetric Positive Definite Manifolds With Vision Applications

Support Vector Metric Learning on Symmetric Positive Definite Manifold

Neighborhood Preserved Sparse Representation for Robust Classification on Symmetric Positive Definite Matrices

Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach

Co-Clustering With Manifold And Double Sparse Representation

A dissimilarity based kernel space for support vector machines

Visual Clustering Based on Kernel Sparse Representation on Grassmann Manifolds

Data-Dependent Sparsity for Subspace Clustering.

Dimensionality Reduction on SPD Manifolds: The Emergence of Geometry-Aware Methods

Semi-supervised Projected Subspace Clustering

Intrinsic Metric Learning with Subspace Representation.

SymNet: A Simple Symmetric Positive Definite Manifold Deep Learning Method for Image Set Classification

Semantic And Neighborhood Preserving Dictionary Learning For Symmetric Positive-Definite Matrices

Geometry-aware Similarity Learning on SPD Manifolds for Visual Recognition

Discriminative Analysis for Symmetric Positive Definite Matrices on Lie Groups.

Locally Adaptive Sparse Representation on Riemannian Manifolds for Robust Classification