Abstract:Principal component analysis (PCA) is one of the most widely used unsupervised dimensionality reduction algorithms, but it is very sensitive to outliers because the squared l2 -norm is used as distance metric. Recently, many scholars have devoted themselves to solving this difficulty. They learn the projection matrix from minimum reconstruction error or maximum projection variance as the starting point, which leads them to ignore a serious problem, that is, the original PCA learns the projection matrix by minimizing the reconstruction error and maximizing the projection variance simultaneously, but they only consider one of them, which imposes various limitations on the performance of model. To solve this problem, we propose a novel robust principal component analysis via joint reconstruction and projection, namely, RPCA-RP, which combines reconstruction error and projection variance to fully mine the potential information of data. Furthermore, we carefully design a discrete weight for model to implicitly distinguish between normal data and outliers, so as to easily remove outliers and improve the robustness of method. In addition, we also unexpectedly discovered that our method has anomaly detection capabilities. Subsequently, an effective iterative algorithm is explored to solve this problem and perform related theoretical analysis. Extensive experimental results on several real-world datasets and RGB large-scale dataset demonstrate the superiority of our method.

Nonlinear data reconstruction by robust kernel principal component analysis

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

Adaptive Kpca Modeling of Nonlinear Systems

Phase Space Reconstruction of Nonlinear Time Series Based on Kernel Method

Robust and Sparse Kernel PCA and Its Outlier Map

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Normalized Robust PCA With Adaptive Reconstruction Error Minimization

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

Robust Covariance Estimation for Distributed Principal Component Analysis

Robust kernel principal component analysis with optimal mean

Exactly Robust Kernel Principal Component Analysis

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

PCA-L1 Algorithm Based on Kernel Function

Kernel Principal Component Analysis for Fuzzy Point Data Set

Robust Principal Component Analysis Via Feature Self-Representation

Determining the Optimal Kernel Parameter in KPCA Based on Sample Reconstruction