Abstract:Robust Principal Component Analysis (RPCA) is a fundamental technique for decomposing data into low-rank and sparse components, which plays a critical role for applications such as image processing and anomaly detection. Traditional RPCA methods commonly use $\ell_1$ norm regularization to enforce sparsity, but this approach can introduce bias and result in suboptimal estimates, particularly in the presence of significant noise or outliers. Non-convex regularization methods have been proposed to mitigate these challenges, but they tend to be complex to optimize and sensitive to initial conditions, leading to potential instability in solutions. To overcome these challenges, in this paper, we propose a novel RPCA model that integrates adaptive weighted least squares (AWLS) and low-rank matrix factorization (LRMF). The model employs a {self-attention-inspired} mechanism in its weight update process, allowing the weight matrix to dynamically adjust and emphasize significant components during each iteration. By employing a weighted F-norm for the sparse component, our method effectively reduces bias while simplifying the computational process compared to traditional $\ell_1$-norm-based methods. We use an alternating minimization algorithm, where each subproblem has an explicit solution, thereby improving computational efficiency. Despite its simplicity, numerical experiments demonstrate that our method outperforms existing non-convex regularization approaches, offering superior performance and stability, as well as enhanced accuracy and robustness in practical applications.

The robust sparse PCA for data reconstructive via weighted elastic net

Robust Sparse PCA Via Weighted Elastic Net

Robust principal component analysis for sparse face recognition

Weighted LASSO for Sparse Recovery with Statistical Prior Support Information

Robust Sparse Lp-norm Principal Component Analysis

Robust PCA Based on Adaptive Weighted Least Squares and Low-Rank Matrix Factorization

Improve Robustness of Sparse Pca by L-1-Norm Maximization

Sparse Principal Component Analysis via Joint L2,1-Norm Penalty

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

Robust PCA Using Generalized Nonconvex Regularization.

Discrete Robust Principal Component Analysis Via Binary Weights Self-Learning

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Avoiding Optimal Mean ℓ 2,1 -Norm Maximization-Based Robust PCA for Reconstruction

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Enhanced Principal Component Analysis under A Collaborative-Robust Framework

Sparse Principal Component Analysis

Robust Sparse Principal Component Analysis