Abstract:This paper considers optimization problems on the Stiefel manifold XTX=Ip\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X^{\mathsf{T}}X=I_p$$\end{document}, where X∈Rn×p\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X\in \mathbb {R}^{n \times p}$$\end{document} is the variable and Ip\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$I_p$$\end{document} is the p\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$p$$\end{document}-by-p\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$p$$\end{document} identity matrix. A framework of constraint preserving update schemes is proposed by decomposing each feasible point into the range space of X\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X$$\end{document} and the null space of XT\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$X^{\mathsf{T}}$$\end{document}. While this general framework can unify many existing schemes, a new update scheme with low complexity cost is also discovered. Then we study a feasible Barzilai–Borwein-like method under the new update scheme. The global convergence of the method is established with an adaptive nonmonotone line search. The numerical tests on the nearest low-rank correlation matrix problem, the Kohn–Sham total energy minimization and a specific problem from statistics demonstrate the efficiency of the new method. In particular, the new method performs remarkably well for the nearest low-rank correlation matrix problem in terms of speed and solution quality and is considerably competitive with the widely used SCF iteration for the Kohn–Sham total energy minimization.

Task Embedded Coordinate Update: A Realizable Framework for Multivariate Non-Convex Optimization.

Modeling Task Relationships in Multivariate Soft Sensor with Balanced Mixture-of-Experts

A Multifactorial Optimization Framework Based on Adaptive Intertask Coordinate System

Coordinate-friendly Structures, Algorithms and Applications

Coordinate-Update Algorithms can Efficiently Detect Infeasible Optimization Problems

An Optimization Approach for Team Coordination Through Information Sharing

Regularized Evolutionary Multitask Optimization: Learning to Intertask Transfer in Aligned Subspace

On the Convergence of ADMM with Task Adaption and Beyond

Aligning Heterogeneous Optimization Problems with Optimal Correspondence Assisted Affine Transformation for Evolutionary Multi-Tasking.

Evolutionary Multitasking Optimization Enhanced by Geodesic Flow Kernel

Affine Transformation-Enhanced Multifactorial Optimization for Heterogeneous Problems

Two-stage Multi-Tasking Transform Framework for Large-Scale Many-Objective Optimization Problems

Optimal Calculation of Tensor Learning Approaches.

Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detection

Investigating Customization Strategies and Convergence Behaviors of Task-Specific ADMM.

A framework of constraint preserving update schemes for optimization on Stiefel manifold

A Unified Inexact Stochastic ADMM for Composite Nonconvex and Nonsmooth Optimization

A Unified Adaptive Tensor Approximation Scheme to Accelerate Composite Convex Optimization.

EMT-ReMO: Evolutionary Multitasking for High-Dimensional Multi-Objective Optimization Via Random Embedding

Evolutionary Multitasking With Centralized Learning for Large-Scale Combinatorial Multi-Objective Optimization

A Multi-Optimizer Cooperative Coevolution Method For Large Scale Optimization