Abstract:Principal Component Analysis (PCA) is the most widely used unsupervised subspace learning method, and lots of its variants have been developed. With so many proposed PCA-like methods, it is still not clear that which features are better or worse for principal components, especially when the data suffers from outliers. To this end, we propose Robust Principal Component Analysis via joint ℓ 2,1 -norms minimization, which provides new insights into two crucial issues of PCA: feature selection and robustness to outliers. Unlike other PCA-like methods, the proposed method is able to select effective features for reconstruction by using the ℓ 2,1 -norm regularization term. More specific, we first use a ℓ 2,1 -norm based transformation matrix to select effective features that can effectively characterize key components (e.g., the eyes and the nose in a face image), and then use an orthogonal transformation matrix to recover the original data from the selected data representation. In this way, the key components can be well recovered by using the effective features selected by a learned transformation matrix. On the other hand, we also impose ℓ 2,1 -norm on a loss term to select clean samples to recover its same class samples but with outliers. A simple yet effective optimization algorithm is proposed to solve the resulting optimization problem. Experiments on six datasets demonstrate the effectiveness of the proposed method.

A New Principal Component Analysis Method Based on Robust Diagnosis

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Analysis of PCA-based reconstruction method for fault diagnosis

Analysis of Principal Component Analysis-Based Reconstruction Method for Fault Diagnosis

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Improved Algorithms for High-Dimensional Robust Pca

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

A Highly Efficient Joint Sparsity Constrained Robust Principal Component Analysis for Fault Diagnosis

Normalized Robust PCA With Adaptive Reconstruction Error Minimization

Multi-space PCA with its application in fault diagnosis

Robust Covariance Estimation for Distributed Principal Component Analysis

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Fault Detection with Improved Principal Component Pursuit Method

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

Robust PCA for High Dimensional Data based on Characteristic Transformation

Self-Paced Probabilistic Principal Component Analysis for Data with Outliers

Self-paced Principal Component Analysis

Fault Detection Behavior And Performance Analysis Of Principal Component Analysis Based Process Monitoring Methods