Abstract:In this paper, to address the optimization problem on a compact matrix manifold, we introduce a novel algorithmic framework called the Transformed Gradient Projection (TGP) algorithm, using the projection onto this compact matrix manifold. Compared with the existing algorithms, the key innovation in our approach lies in the utilization of a new class of search directions and various stepsizes, including the Armijo, nonmonotone Armijo, and fixed stepsizes, to guide the selection of the next iterate. Our framework offers flexibility by encompassing the classical gradient projection algorithms as special cases, and intersecting the retraction-based line-search algorithms. Notably, our focus is on the Stiefel or Grassmann manifold, revealing that many existing algorithms in the literature can be seen as specific instances within our proposed framework, and this algorithmic framework also induces several new special cases. Then, we conduct a thorough exploration of the convergence properties of these algorithms, considering various search directions and stepsizes. To achieve this, we extensively analyze the geometric properties of the projection onto compact matrix manifolds, allowing us to extend classical inequalities related to retractions from the literature. Building upon these insights, we establish the weak convergence, convergence rate, and global convergence of TGP algorithms under three distinct stepsizes. In cases where the compact matrix manifold is the Stiefel or Grassmann manifold, our convergence results either encompass or surpass those found in the literature. Finally, through a series of numerical experiments, we observe that the TGP algorithms, owing to their increased flexibility in choosing search directions, outperform classical gradient projection and retraction-based line-search algorithms in several scenarios.

Modified and accelerated relaxed gradient-based iterative algorithms for the complex conjugate and transpose matrix equations

The relaxed gradient based iterative algorithm for solving the generalized coupled complex conjugate and transpose Sylvester matrix equations

A modified gradient‐based iterative algorithm for solving the complex conjugate and transpose matrix equations

Iterative method for constrained systems of conjugate transpose matrix equations

Iterative algorithm to the generalized coupled Sylvester‐transpose matrix equations with application in robust and minimum norm observer design of linear systems

Solving a system of complex matrix equations using a gradient-based method and its application in image restoration

Modified Newton'S Algorithm for Computing the Group Inverses of Singular Toeplitz Matrices

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

Developing iterative algorithms to solve Sylvester tensor equations

A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications

Low-Complexity Iterative Methods for Complex-Variable Matrix Optimization Problems in Frobenius Norm

Convergence analysis of the transformed gradient projection algorithms on compact matrix manifolds

On adapting Nesterov's scheme to accelerate iterative methods for linear problems

The shifted inner-outer iteration methods for solving Sylvester matrix equations

A Modified Dai–Liao Conjugate Gradient Method Based on a Scalar Matrix Approximation of Hessian and Its Application

Modified CRI iteration methods for complex symmetric indefinite linear systems

An Adaptive Gradient Neural Network to Solve Dynamic Linear Matrix Equations

A generalization of the relaxation-based matrix splitting iterative method for solving the system of generalized absolute value equations

Two-step inertial Bregman alternating structure-adapted proximal gradient descent algorithm for nonconvex and nonsmooth problems

A class of new three-term descent conjugate gradient algorithms for large-scale unconstrained optimization and applications to image restoration problems

A shift‐splitting Jacobi‐gradient iterative algorithm for solving the matrix equation AV−V ̅B=C