Abstract:There are two widely used models for the Grassmannian $\operatorname{Gr}(k,n)$, as the set of equivalence classes of orthogonal matrices $\operatorname{O}(n)/(\operatorname{O}(k) \times \operatorname{O}(n-k))$, and as the set of trace-$k$ projection matrices $\{P \in \mathbb{R}^{n \times n} : P^{\mathsf{T}} = P = P^2,\; \operatorname{tr}(P) = k\}$. The former, standard in manifold optimization, has the advantage of giving numerically stable algorithms but the disadvantage of having to work with equivalence classes of matrices. The latter, widely used in coding theory and probability, has the advantage of using actual matrices (as opposed to equivalence classes) but working with projection matrices is numerically unstable. We present an alternative that has both advantages and suffers from neither of the disadvantages; by representing $k$-dimensional subspaces as symmetric orthogonal matrices of trace $2k-n$, we obtain \[ \operatorname{Gr}(k,n) \cong \{Q \in \operatorname{O}(n) : Q^{\mathsf{T}} = Q, \; \operatorname{tr}(Q) = 2k -n\}. \] As with the other two models, we show that differential geometric objects and operations -- tangent vector, metric, normal vector, exponential map, geodesic, parallel transport, gradient, Hessian, etc -- have closed-form analytic expressions that are computable with standard numerical linear algebra. In the proposed model, these expressions are considerably simpler, a result of representing $\operatorname{Gr}(k,n)$ as a linear section of a compact matrix Lie group $\operatorname{O}(n)$, and can be computed with at most one QR decomposition and one exponential of a special skew-symmetric matrix that takes only $O(nk(n-k))$ time. In particular, we completely avoid eigen- and singular value decompositions in our steepest descent, conjugate gradient, quasi-Newton, and Newton methods for the Grassmannian.

Joint Normalization and Dimensionality Reduction on Grassmannian: A Generalized Perspective

Dimensionality Reduction on Grassmannian via Riemannian Optimization: A Generalized Perspective.

Dimensionality Reduction On Grassmannian: A Good Practice

Supervised Dimensionality Reduction on Grassmannian for Image Set Recognition.

Learning adaptive Grassmann neighbors for image-set analysis

Robust Metric Learning on Grassmann Manifolds with Generalization Guarantees.

Locality Preserving Projections for Grassmann Manifold

Sparse Representation Classifier Guided Grassmann Reconstruction Metric Learning With Applications to Image Set Analysis

Grassmannian Learning: Embedding Geometry Awareness in Shallow and Deep Learning

Riemannian manifold learning.

Grassmannian Discriminant Maps (GDM) for Manifold Dimensionality Reduction with Application to Image Set Classification

Robust Dimensionality Reduction via Low-rank Laplacian Graph Learning

Partial Sum Minimization of Singular Values Representation on Grassmann Manifolds

Low Rank Representation on Grassmann Manifolds: an Extrinsic Perspective

Metric Learning: A General Dimension Reduction Framework for Classification and Visualization.

Joint of Locality- and Globality-Preserving Projections

Dimensionality Reduction on SPD Manifolds: The Emergence of Geometry-Aware Methods

Cascaded Low Rank and Sparse Representation on Grassmann Manifolds

Riemannian joint dimensionality reduction and dictionary learning on symmetric positive definite manifold

Localized LRR on Grassmann Manifold: an Extrinsic View.

Simpler Grassmannian optimization