Abstract:Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In this context, the fresh look advocated here permeates benefits from variable selection and compressive sampling, to robustify PCA against outliers. A least-trimmed squares estimator of a low-rank bilinear factor analysis model is shown closely related to that obtained from an $\ell_0$-(pseudo)norm-regularized criterion encouraging sparsity in a matrix explicitly modeling the outliers. This connection suggests robust PCA schemes based on convex relaxation, which lead naturally to a family of robust estimators encompassing Huber's optimal M-class as a special case. Outliers are identified by tuning a regularization parameter, which amounts to controlling sparsity of the outlier matrix along the whole robustification path of (group) least-absolute shrinkage and selection operator (Lasso) solutions. Beyond its neat ties to robust statistics, the developed outlier-aware PCA framework is versatile to accommodate novel and scalable algorithms to: i) track the low-rank signal subspace robustly, as new data are acquired in real time; and ii) determine principal components robustly in (possibly) infinite-dimensional feature spaces. Synthetic and real data tests corroborate the effectiveness of the proposed robust PCA schemes, when used to identify aberrant responses in personality assessment surveys, as well as unveil communities in social networks, and intruders from video surveillance data.

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

Robust Principal Component Analysis Via Optimal Mean by Joint ℓ2,1 and Schatten P-Norms Minimization

Robust Principal Component Analysis Via Feature Self-Representation

Robust principal component analysis via optimal mean by joint ℓ

Robust Principal Component Analysis with Non-Greedy l-Norm Maximization.

Improve Robustness of Sparse Pca by L-1-Norm Maximization

Robust Formulation for PCA: Avoiding Mean Calculation with L2,p-norm Maximization

Robust Sparse Lp-norm Principal Component Analysis

Avoiding Optimal Mean ℓ 2,1 -Norm Maximization-Based Robust PCA for Reconstruction

Normalized Robust PCA With Adaptive Reconstruction Error Minimization

Robust Sparse Principal Component Analysis

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Optimal Mean Robust Principal Component Analysis.

Robust PCA as Bilinear Decomposition with Outlier-Sparsity Regularization

Avoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy L1-norm Maximization

Non-Greedy L21-Norm Maximization for Principal Component Analysis