Abstract:Principal component analysis (PCA) is one of the most widely used unsupervised dimensionality reduction algorithms, but it is very sensitive to outliers because the squared l2 -norm is used as distance metric. Recently, many scholars have devoted themselves to solving this difficulty. They learn the projection matrix from minimum reconstruction error or maximum projection variance as the starting point, which leads them to ignore a serious problem, that is, the original PCA learns the projection matrix by minimizing the reconstruction error and maximizing the projection variance simultaneously, but they only consider one of them, which imposes various limitations on the performance of model. To solve this problem, we propose a novel robust principal component analysis via joint reconstruction and projection, namely, RPCA-RP, which combines reconstruction error and projection variance to fully mine the potential information of data. Furthermore, we carefully design a discrete weight for model to implicitly distinguish between normal data and outliers, so as to easily remove outliers and improve the robustness of method. In addition, we also unexpectedly discovered that our method has anomaly detection capabilities. Subsequently, an effective iterative algorithm is explored to solve this problem and perform related theoretical analysis. Extensive experimental results on several real-world datasets and RGB large-scale dataset demonstrate the superiority of our method.

Nonparametric Principal Subspace Regression

Dynamic Principal Subspaces with Sparsity in High Dimensions

Dynamic Principal Subspaces in High Dimensions

Supervised Principal Component Regression for Functional Responses with High Dimensional Predictors

Dynamic Principal Component Analysis in High Dimensions

Unified Principal Component Analysis for Sparse and Dense Functional Data under Spatial Dependency

Learning Feature Sparse Principal Subspace.

Principal component analysis balancing prediction and approximation accuracy for spatial data

Spatio-temporal principal component analysis

Augmented Estimation of Principal Component Subspace in High Dimensions

Sparse Unsupervised Dimensionality Reduction Algorithms

Targeted principal components regression

Modeling Multivariate Spatial-Temporal Data with Latent Low-Dimensional Dynamics

Multivariate Spatial-temporal Prediction on Latent Low-dimensional Functional Structure with Non-stationarity

Sparse Principal Component Analysis for High Dimensional Vector Autoregressive Models

Supervised Principal Components: a New Method for Multivariate Spectral Analysis

Sparse principal component analysis by choice of norm

Principal component analysis for non-stationary time series based on detrended cross-correlation analysis

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

A note on the variance in principal component regression

Dynamic Multivariate Functional Data Modeling Via Sparse Subspace Learning