Abstract: Principal component analysis (PCA) has been widely applied to dimensionality reduction and data pre-processing for different applications in engineering, biology and social science. Classical PCA and its variants seek for linear projections of the original variables to obtain a low dimensional feature representation with maximal variance. One limitation is that it is very difficult to interpret the results of PCA. In addition, the classical PCA is vulnerable to certain noisy data. In this paper, we propose a convex sparse principal component analysis (CSPCA) algorithm and apply it to feature analysis. First we show that PCA can be formulated as a low-rank regression optimization problem. Based on the discussion, the l 2 , 1 -norm minimization is incorporated into the objective function to make the regression coefficients sparse, thereby robust to the outliers. In addition, based on the sparse model used in CSPCA, an optimal weight is assigned to each of the original feature, which in turn provides the output with good interpretability. With the output of our CSPCA, we can effectively analyze the importance of each feature under the PCA criteria. The objective function is convex, and we propose an iterative algorithm to optimize it. We apply the CSPCA algorithm to feature selection and conduct extensive experiments on six different benchmark datasets. Experimental results demonstrate that the proposed algorithm outperforms state-of-the-art unsupervised feature selection algorithms.

Adaptive Sparse Kernel Principal Component Analysis for Computation and Store Space Constrained-based Feature Extraction.

Computation and Store Space Constrained-Based Sparse Kernel Data Analysis

Sparse Data-Dependent Kernel Principal Component Analysis Based on Least Squares Support Vector Machine for Feature Extraction and Recognition.

Improved <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M1"><mml:mrow><mml:mi>k</mml:mi></mml:mrow></mml:math>-<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M2"><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:math> PCA Algorithm Using Artificial Sparsity in Dynamic MRI

Adaptive kernel subspace method for speeding up feature extraction

Adaptive Kpca Modeling of Nonlinear Systems

Sparse Kernel Feature Extraction Via Support Vector Learning.

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Sparse kernel principal component algorithm based on an approximate zero norm

KPCA Based on Feature Samples for Fault Detection

Sparse Principal Component Analysis With Preserved Sparsity Pattern

A Framework of Sparse Kernel Principal Component Analysis and Its Applications

Sparse representation image classification algorithm based on principal component analysis convolution

Incomplete Cholesky Decomposition Based Kernel Principal Component Analysis For Large-Scale Data Set

An Improved Algorithm for Kernel Principal Component Analysis

Learning Feature Sparse Principal Subspace.

Matrix-based Kernel Principal Component Analysis for Large-Scale Data Set.

Face recognition with weighted kernel principal component analysis

A Convex Sparse PCA for Feature Analysis.

Learning Feature Sparse Principal Components