Abstract:Optimization over the embedded submanifold defined by constraints $c(x) = 0$ has attracted much interest over the past few decades due to its wide applications in various areas. Plenty of related optimization packages have been developed based on Riemannian optimization approaches, which rely on some basic geometrical materials of Riemannian manifolds, including retractions, vector transports, etc. These geometrical materials can be challenging to determine in general. Existing packages only accommodate a few well-known manifolds whose geometrical materials are easily accessible. For other manifolds which are not contained in these packages, the users have to develop the geometric materials by themselves. In addition, it is not always tractable to adopt advanced features from various state-of-the-art unconstrained optimization solvers to Riemannian optimization approaches. We introduce CDOpt (available at <a class="link-external link-https" href="https://cdopt.github.io/" rel="external noopener nofollow">this https URL</a>), a user-friendly Python package for a class Riemannian optimization. Based on constraint dissolving approaches, Riemannian optimization problems are transformed into their equivalent unconstrained counterparts in CDOpt. Therefore, solving Riemannian optimization problems through CDOpt directly benefits from various existing solvers and the rich expertise gained over decades for unconstrained optimization. Moreover, all the computations in CDOpt related to any manifold in question are conducted on its constraints expression, hence users can easily define new manifolds in CDOpt without any background on differential geometry. Furthermore, CDOpt extends the neural layers from PyTorch and Flax, thus allows users to train manifold constrained neural networks directly by the solvers for unconstrained optimization. Extensive numerical experiments demonstrate that CDOpt is highly efficient and robust in solving various classes of Riemannian optimization problems.

Rieoptax: Riemannian Optimization in JAX

Optimistix: modular optimisation in JAX and Equinox

$\texttt{immrax}$: A Parallelizable and Differentiable Toolbox for Interval Analysis and Mixed Monotone Reachability in JAX

Optimal Transport Tools (OTT): A JAX Toolbox for all things Wasserstein

JAX-SSO: Differentiable Finite Element Analysis Solver for Structural Optimization and Seamless Integration with Neural Networks

evosax: JAX-based Evolution Strategies

CDOpt: A Python Package for a Class of Riemannian Optimization

Lineax: unified linear solves and linear least-squares in JAX and Equinox

JAXFit: Trust Region Method for Nonlinear Least-Squares Curve Fitting on the GPU

TORAX: A Fast and Differentiable Tokamak Transport Simulator in JAX

Vector Transport Free Riemannian LBFGS for Optimization on Symmetric Positive Definite Matrix Manifolds

Riemannian optimization on the symplectic Stiefel manifold using second-order information

JAX FDM: A differentiable solver for inverse form-finding

A Riemannian optimization method on the indefinite Stiefel manifold

JAX-ReaxFF: A Gradient-Based Framework for Fast Optimization of Reactive Force Fields.

Preconditioned low-rank Riemannian optimization for linear systems with tensor product structure

Riemannian optimization of isometric tensor networks

JAXbind: Bind any function to JAX

Gradients of Functions of Large Matrices

DrJAX: Scalable and Differentiable MapReduce Primitives in JAX

An Extension of Fast Iterative Shrinkage‐thresholding Algorithm to Riemannian Optimization for Sparse Principal Component Analysis