Abstract:Principal component analysis (PCA) is a widely used tool for data analysis and dimension reduction in applications throughout science and engineering. However, the principal components (PCs) can sometimes be difficult to interpret, because they are linear combinations of all the original variables. To facilitate interpretation, sparse PCA produces modified PCs with sparse loadings, i.e. loadings with very few non-zero elements. In this paper, we propose a new sparse PCA method, namely sparse PCA via regularized SVD (sPCA-rSVD). We use the connection of PCA with singular value decomposition (SVD) of the data matrix and extract the PCs through solving a low rank matrix approximation problem. Regularization penalties are introduced to the corresponding minimization problem to promote sparsity in PC loadings. An efficient iterative algorithm is proposed for computation. Two tuning parameter selection methods are discussed. Some theoretical results are established to justify the use of sPCA-rSVD when only the data covariance matrix is available. In addition, we give a modified definition of variance explained by the sparse PCs. The sPCA-rSVD provides a uniform treatment of both classical multivariate data and high-dimension-low-sample-size (HDLSS) data. Further understanding of sPCA-rSVD and some existing alternatives is gained through simulation studies and real data examples, which suggests that sPCA-rSVD provides competitive results.

Sparse Principal Component Analysis for Natural Language Processing

Large-Scale Sparse Principal Component Analysis with Application to Text Data

Sparse Principal Component Analysis via Variable Projection

Sparse Principal Component Analysis With Preserved Sparsity Pattern

A Selective Overview of Sparse Principal Component Analysis

Sparse Principal Component Analysis

Dynamic Principal Subspaces with Sparsity in High Dimensions

Sparse principal component analysis via regularized low rank matrix approximation

Localized Sparse Principal Component Analysis of Multivariate Time Series in Frequency Domain

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Multilinear Sparse Principal Component Analysis

Dynamic Principal Component Analysis in High Dimensions

Sparse Principal Component Analysis: a Least Squares approximation approach

Sparse Functional Principal Component Analysis in High Dimensions

Sparse and Functional Principal Components Analysis

Sparse principal component analysis by choice of norm

Row-Sparse Principal Component Analysis via Coordinate Descent Method

Dynamic Principal Subspaces in High Dimensions

Robust Tensor Principal Component Analysis in All Modes