Abstract:Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem on the symplectic Stiefel manifold, we construct geometric ingredients for Riemannian optimization with a new family of Riemannian metrics called tractable metrics and develop Riemannian Newton schemes. The newly obtained ingredients do not only generalize several existing results but also provide us with freedom to choose a suitable metric for each problem. To the best of our knowledge, this is the first try to develop the explicit second-order geometry and Newton's methods on the symplectic Stiefel manifold. For the Riemannian Newton method, we first consider novel operator-valued formulas for computing the Riemannian Hessian of a~cost function, which further allows the manifold to be endowed with a weighted Euclidean metric that can provide a preconditioning effect. We then solve the resulting Newton equation, as the central step of Newton's methods, directly via transforming it into a~saddle point problem followed by vectorization, or iteratively via applying any matrix-free iterative method either to the operator Newton equation or its saddle point formulation. Finally, we propose a hybrid Riemannian Newton optimization algorithm that enjoys both global convergence and quadratic/superlinear local convergence at the final stage. Various numerical experiments are presented to validate the proposed methods.

From the Simplex to the Sphere: Faster Constrained Optimization Using the Hadamard Parametrization

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

A Class of Optimal Transportation Problems on the Sphere

Convex optimization over a probability simplex

Optimization over convex polyhedra via Hadamard parametrizations

A Feasible Method for Optimization with Orthogonality Constraints

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Simplex QP-based methods for minimizing a conic quadratic objective over polyhedra

Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

On Simplices with a Given Barycenter That Are Enclosed by the Standard Simplex

Symplectic Stiefel manifold: tractable metrics, second-order geometry and Newton's methods

Spectrally Constrained Optimization

Proximal methods for structured nonsmooth optimization over Riemannian submanifolds

The Proxy Step-Size Technique for Regularized Optimization on the Sphere Manifold

A Proximal-Gradient Method for Constrained Optimization

General Constrained Matrix Optimization

Extreme Point Pursuit -- Part I: A Framework for Constant Modulus Optimization

Single-Projection Procedure for Infinite Dimensional Convex Optimization Problems

Global Optimization with Orthogonality Constraints Via Stochastic Diffusion on Manifold