Abstract:Sparse principal component analysis (PCA), an important variant of PCA, attempts to find sparse loading vectors when conducting dimension reduction. This paper considers the nonsmooth Riemannian optimization problem associated with the ScoTLASS model1 for sparse PCA which can impose orthogonality and sparsity simultaneously. A Riemannian proximal method is proposed in the work of Chen et al.9 for the efficient solution of this optimization problem. In this paper, two acceleration schemes are introduced. First and foremost, we extend the FISTA method from the Euclidean space to the Riemannian manifold to solve sparse PCA, leading to the accelerated Riemannian proximal gradient method. Since the Riemannian optimization problem for sparse PCA is essentially nonconvex, a restarting technique is adopted to stabilize the accelerated method without sacrificing the fast convergence. Second, a diagonal preconditioner is proposed for the Riemannian proximal subproblem which can further accelerate the convergence of the Riemannian proximal methods. Numerical evaluations establish the computational advantages of the proposed methods over the existing proximal gradient methods on a manifold. Additionally, a short result concerning the convergence of the Riemannian subgradients of a sequence is established, which, together with the result in the work of Chen et al.,9 can show the stationary point convergence of the Riemannian proximal methods.

A Customized Inertial Proximal Alternating Minimization for SVD-free Robust Principal Component Analysis

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

An Alternating Minimization Method for Robust Principal Component Analysis

Robust principal component analysis: A factorization-based approach with linear complexity

Efficient Robust Principal Component Analysis Via Block Krylov Iteration and CUR Decomposition

Fast Algorithms for Robust Principal Component Analysis with an Upper Bound on the Rank.

A Nonconvex Projection Method for Robust PCA

Exactly Robust Kernel Principal Component Analysis

Accelerated Alternating Projections for Robust Principal Component Analysis.

Avoiding Optimal Mean ℓ 2,1 -Norm Maximization-Based Robust PCA for Reconstruction

An Extension of Fast Iterative Shrinkage‐thresholding Algorithm to Riemannian Optimization for Sparse Principal Component Analysis

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

An Extension of Fast Iterative Shrinkage-thresholding to Riemannian Optimization for Sparse Principal Component Analysis

Nonconvex Regularized Robust PCA Using the Proximal Block Coordinate Descent Algorithm

Adaptive Weighted Robust Principal Component Analysis1

A NEW MODEL FOR SPARSE AND LOW-RANK MATRIX DECOMPOSITION

Fast and Provable Nonconvex Tensor RPCA.

Robust PCA via Nonconvex Rank Approximation

Deep Unrolling for Nonconvex Robust Principal Component Analysis

Robust Two-Dimensional Principal Component Analysis Via Alternating Optimization