Abstract:Many learning tasks are modeled as optimization problems with nonlinear constraints, such as principal component analysis and fitting a Gaussian mixture model. A popular way to solve such problems is resorting to Riemannian optimization algorithms, which yet heavily rely on both human involvement and expert knowledge about Riemannian manifolds. In this paper, we propose a Riemannian meta-optimization method to automatically learn a Riemannian optimizer. We parameterize the Riemannian optimizer by a novel recurrent network and utilize Riemannian operations to ensure that our method is faithful to the geometry of manifolds. The proposed method explores the distribution of the underlying data by minimizing the objective of updated parameters, and hence is capable of learning task-specific optimizations. We introduce a Riemannian implicit differentiation training scheme to achieve efficient training in terms of numerical stability and computational cost. Unlike conventional meta-optimization training schemes that need to differentiate through the whole optimization trajectory, our training scheme is only related to the final two optimization steps. In this way, our training scheme avoids the exploding gradient problem, and significantly reduces the computational load and memory footprint. We discuss experimental results across various constrained problems, including principal component analysis on Grassmann manifolds, face recognition, person re-identification, and texture image classification on Stiefel manifolds, clustering and similarity learning on symmetric positive definite manifolds, and few-shot learning on hyperbolic manifolds.

Face Recognition Based on Riemannian Manifold Learning

Riemannian manifold learning.

Learning an Image Manifold for Retrieval

Gabor Feature-Based Face Recognition Using Riemannian Manifold Learning

Riemannian manifold learning for nonlinear dimensionality reduction

Nearest Manifold Approach for Face Recognition

Towards Generalized and Efficient Metric Learning on Riemannian Manifold.

Discriminative Structure Discovery Via Dimensionality Reduction for Facial Image Manifold

Monogenic features based single sample face recognition by kernel sparse representation on multiple Riemannian manifolds

Face Recognition Based on Semi-Supervised Manifold Learning

Manifold-Manifold Distance with application to face recognition based on image set

Facial Expression Recognition on Multiple Manifolds

Manifold-manifold distance and its application to face recognition with image sets.

Applying Ricci Flow to High Dimensional Manifold Learning

Learning to Optimize on Riemannian Manifolds

A Boosted Manifold Learning for Automatic Face Recognition.

Face Recognition Via Domain Adaptation And Manifold Distance Metric Learning

Manifold Learning Algorithm Analysis and Application in Face Database

Application of Manifold on 3D Facial Feature Dimension Reduction

Local Manifold Matching for Face Recognition

Isometric Immersion Learning with Riemannian Geometry