Abstract:Robust Principal Component Analysis (RPCA) is a fundamental technique for decomposing data into low-rank and sparse components, which plays a critical role for applications such as image processing and anomaly detection. Traditional RPCA methods commonly use $\ell_1$ norm regularization to enforce sparsity, but this approach can introduce bias and result in suboptimal estimates, particularly in the presence of significant noise or outliers. Non-convex regularization methods have been proposed to mitigate these challenges, but they tend to be complex to optimize and sensitive to initial conditions, leading to potential instability in solutions. To overcome these challenges, in this paper, we propose a novel RPCA model that integrates adaptive weighted least squares (AWLS) and low-rank matrix factorization (LRMF). The model employs a {self-attention-inspired} mechanism in its weight update process, allowing the weight matrix to dynamically adjust and emphasize significant components during each iteration. By employing a weighted F-norm for the sparse component, our method effectively reduces bias while simplifying the computational process compared to traditional $\ell_1$-norm-based methods. We use an alternating minimization algorithm, where each subproblem has an explicit solution, thereby improving computational efficiency. Despite its simplicity, numerical experiments demonstrate that our method outperforms existing non-convex regularization approaches, offering superior performance and stability, as well as enhanced accuracy and robustness in practical applications.

RAP: Scalable RPCA for Low-rank Matrix Recovery

RES-PCA: A Scalable Approach to Recovering Low-Rank Matrices

Robust principal component analysis: A factorization-based approach with linear complexity

Robust Principal Component Analysis with Missing Data.

Double-Weighted Low-Rank Matrix Recovery Based on Rank Estimation.

Exactly Robust Kernel Principal Component Analysis

Efficient Robust Principal Component Analysis Via Block Krylov Iteration and CUR Decomposition

A Fast Factorization-based Approach to Robust PCA

Fast Algorithms for Robust Principal Component Analysis with an Upper Bound on the Rank.

Randomized Truncated Pivoted QLP Factorization for Low-Rank Matrix Recovery

Robust PCA Based on Adaptive Weighted Least Squares and Low-Rank Matrix Factorization

Proximity Point Algorithm for Low-Rank Matrix Recovery from Sparse Noise Corrupted Data

Active Subspace: Toward Scalable Low-Rank Learning

Strongly Convex Programming for Exact Matrix Completion and Robust Principal Component Analysis

Riemannian Pursuit for Big Matrix Recovery.

Recovery of Coherent Data via Low-Rank Dictionary Pursuit.

Robust PCA via Nonconvex Rank Approximation

Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descent

A NEW MODEL FOR SPARSE AND LOW-RANK MATRIX DECOMPOSITION

A New Nonconvex Rank Approximation of RPCA

Matrix Recovery with Implicitly Low-Rank Data.