Abstract:This paper considers optimization problems on the Stiefel manifold XTX=Ip\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X^{\mathsf{T}}X=I_p$$\end{document}, where X∈Rn×p\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X\in \mathbb {R}^{n \times p}$$\end{document} is the variable and Ip\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$I_p$$\end{document} is the p\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$p$$\end{document}-by-p\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$p$$\end{document} identity matrix. A framework of constraint preserving update schemes is proposed by decomposing each feasible point into the range space of X\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X$$\end{document} and the null space of XT\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X^{\mathsf{T}}$$\end{document}. While this general framework can unify many existing schemes, a new update scheme with low complexity cost is also discovered. Then we study a feasible Barzilai–Borwein-like method under the new update scheme. The global convergence of the method is established with an adaptive nonmonotone line search. The numerical tests on the nearest low-rank correlation matrix problem, the Kohn–Sham total energy minimization and a specific problem from statistics demonstrate the efficiency of the new method. In particular, the new method performs remarkably well for the nearest low-rank correlation matrix problem in terms of speed and solution quality and is considerably competitive with the widely used SCF iteration for the Kohn–Sham total energy minimization.

Matrix Function Optimization Problems under Orthonormal Constraint

Matrix Function Optimization under Weighted Boundary Constraints and Its Applications in Network Control.

Optimization on Matrix Manifold Based on Gradient Information and Its Applications in Network Control

Matrix Optimization Problem Involving Group Sparsity and Nonnegativity Constraints

General Constrained Matrix Optimization

Structured Quasi-Newton Methods for Optimization with Orthogonality Constraints.

A Feasible Method for Optimization with Orthogonality Constraints

The Global Optimization Geometry of Low-Rank Matrix Optimization

A class of bilinear matrix constraint optimization problem and its applications

Some Optimization Problems on Ranks and Inertias of Matrix-Valued Functions Subject to Linear Matrix Equation Restrictions

Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

A framework of constraint preserving update schemes for optimization on Stiefel manifold

Parallelizable Algorithms for Optimization Problems with Orthogonality Constraints

A Riemannian optimization method on the indefinite Stiefel manifold

Quadratic Optimization with Orthogonality Constraint: Explicit Łojasiewicz Exponent and Linear Convergence of Retraction-Based Line-Search and Stochastic Variance-Reduced Gradient Methods

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

Matrix Optimization over Low-Rank Spectral Sets: Stationary Points and Local and Global Minimizers.

Matrix-valued distributed stochastic optimization with constraints

Quaternion Matrix Optimization and The Underlying Calculus

A matrix-free interior point continuous trajectory for linearly constrained convex programming

Low-Complexity Iterative Methods for Complex-Variable Matrix Optimization Problems in Frobenius Norm