Abstract:Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem on the symplectic Stiefel manifold, we construct geometric ingredients for Riemannian optimization with a new family of Riemannian metrics called tractable metrics and develop Riemannian Newton schemes. The newly obtained ingredients do not only generalize several existing results but also provide us with freedom to choose a suitable metric for each problem. To the best of our knowledge, this is the first try to develop the explicit second-order geometry and Newton's methods on the symplectic Stiefel manifold. For the Riemannian Newton method, we first consider novel operator-valued formulas for computing the Riemannian Hessian of a~cost function, which further allows the manifold to be endowed with a weighted Euclidean metric that can provide a preconditioning effect. We then solve the resulting Newton equation, as the central step of Newton's methods, directly via transforming it into a~saddle point problem followed by vectorization, or iteratively via applying any matrix-free iterative method either to the operator Newton equation or its saddle point formulation. Finally, we propose a hybrid Riemannian Newton optimization algorithm that enjoys both global convergence and quadratic/superlinear local convergence at the final stage. Various numerical experiments are presented to validate the proposed methods.

A Riemannian optimization method on the indefinite Stiefel manifold

Riemannian optimization on the symplectic Stiefel manifold using second-order information

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Riemannian optimization with a preconditioning scheme on the generalized Stiefel manifold

Optimization without Retraction on the Random Generalized Stiefel Manifold

Optimization schemes on manifolds for structured matrices with fixed eigenvalues

Symplectic Stiefel manifold: tractable metrics, second-order geometry and Newton's methods

Decentralized Weakly Convex Optimization Over the Stiefel Manifold

Randomized Submanifold Subgradient Method for Optimization over Stiefel Manifolds

Riemannian Optimization Approach to Structure-Preserving Model Order Reduction of Integral-Differential Systems on the Product of Two Stiefel Manifolds

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Sequential subspace methods on Stiefel manifold optimization problems

Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants

Gauss–Newton Method for Convex Composite Optimizations on Riemannian Manifolds

Optimization on product manifolds under a preconditioned metric

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations

Riemannian coordinate descent algorithms on matrix manifolds

A relaxation method for binary optimizations on constrained Stiefel manifold

Riemannian optimization of isometric tensor networks

Nonlinear Eigen-approach ADMM for Sparse Optimization on Stiefel Manifold

Vector Transport Free Riemannian LBFGS for Optimization on Symmetric Positive Definite Matrix Manifolds