Robust Principal Component Analysis: A Construction Error Minimization Perspective

Kai Liu,Yarui Cao

DOI: https://doi.org/10.48550/arXiv.2111.12132

IF: 5.414

2021-11-23

Machine Learning

Abstract:In this paper we propose a novel optimization framework to systematically solve robust PCA problem with rigorous theoretical guarantee, based on which we investigate very computationally economic updating algorithms.

What problem does this paper attempt to address?

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Ran He,Bao-Gang Hu,Wei-Shi Zheng,Xiang-Wei Kong

DOI: https://doi.org/10.1109/tip.2010.2103949

IF: 10.6

2011-01-01

IEEE Transactions on Image Processing

Abstract:Principal component analysis (PCA) minimizes the mean square error (MSE) and is sensitive to outliers. In this paper, we present a new rotational-invariant PCA based on maximum correntropy criterion (MCC). A half-quadratic optimization algorithm is adopted to compute the correntropy objective. At each iteration, the complex optimization problem is reduced to a quadratic problem that can be efficiently solved by a standard optimization method. The proposed method exhibits the following benefits: 1) it is robust to outliers through the mechanism of MCC which can be more theoretically solid than a heuristic rule based on MSE; 2) it requires no assumption about the zero-mean of data for processing and can estimate data mean during optimization; and 3) its optimal solution consists of principal eigenvectors of a robust covariance matrix corresponding to the largest eigenvalues. In addition, kernel techniques are further introduced in the proposed method to deal with nonlinearly distributed data. Numerical results demonstrate that the proposed method can outperform robust rotational-invariant PCAs based on L1 norm when outliers occur.
Efficient Optimization Algorithms for Robust Principal Component Analysis and Its Variants

Shiqian Ma,Necdet Serhat Aybat

DOI: https://doi.org/10.48550/arXiv.1806.03430

2018-06-09

Abstract:Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision. Robust PCA and its variants such as sparse PCA and stable PCA can be formulated as optimization problems with exploitable special structures. Many specialized efficient optimization methods have been proposed to solve robust PCA and related problems. In this paper we review existing optimization methods for solving convex and nonconvex relaxations/variants of robust PCA, discuss their advantages and disadvantages, and elaborate on their convergence behaviors. We also provide some insights for possible future research directions including new algorithmic frameworks that might be suitable for implementing on multi-processor setting to handle large-scale problems.

Optimization and Control,Computer Vision and Pattern Recognition,Machine Learning
An Alternating Minimization Method for Robust Principal Component Analysis

Yuan Shen,Hongyu Xu,Xin Liu

DOI: https://doi.org/10.1080/10556788.2018.1496086

2018-01-01

Abstract:This paper focuses on the solution of robust principal component analysis (RPCA) problems that arise in fields such as information theory, statistics, and engineering. We adopt a model that minimizes the sum of the observation error and sparsity measurement subject to the rank constraint. To solve this problem, we propose a two-step alternating minimization method. In the first step, a symmetric low-rank product minimization, which is essentially a partial singular value decomposition, is efficiently solved with moderate accuracy. The second step then derives a closed-form solution. The proposed approach is almost parameter-free, and global convergence to a strict local minimizer is guaranteed under very loose conditions. We compare the proposed approach with some existing solvers, and numerical experiments demonstrate the outstanding performance of our approach in solving synthetic and real RPCA test problems. In particular, we illustrate the significant potential of the proposed approach to solve large-size problems with moderate accuracy.
Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Yujia Fu,Uwe Kruger,Zhe Li,Lei Xie,Jillian Thompson,David Rooney,Juergen Hahn,Huizhong Yang

DOI: https://doi.org/10.1016/j.chemolab.2017.06.007

IF: 4.175

2017-01-01

Chemometrics and Intelligent Laboratory Systems

Abstract:This article revisits recently proposed methods to determine the kernel parameter and the number of latent components for identifying kernel principal component analysis (KPCA) and kernel partial least squares (KPLS) models. A detailed analysis shows that existing work is neither optimal nor efficient in determining these important parameters and may lead to erroneous estimates. In addition to that, most methods are not designed to simultaneously estimate both parameters, i.e. they require one parameter to be predetermined. To address these practically important issues, the article introduces a cross-validatory framework to optimally determine both parameters. Application studies to a simulation example and a total of three experimental or industrial data sets confirm that the cross-validatory framework outperforms existing methods and yields optimal estimations for both parameters. In sharp contrast, existing work has the potential to substantially overestimate the number of latent components and to provide inadequate estimates for the kernel parameter.
Robust principal component analysis via optimal mean by joint ℓ

Xiaoshuang Shi,Feiping Nie,Zhihui Lai,Zhenhua Guo

DOI: https://doi.org/10.1016/j.neucom.2017.12.034

IF: 6

2018-01-01

Neurocomputing

Abstract:Since principal component analysis (PCA) is sensitive to corrupted variables or observations that affect its performance and applicability in real scenarios, some convex robust PCA methods have been developed to enhance the robustness of PCA. However, most of them neglect the optimal mean calculation problem. They center the data with the mean calculated by the ℓ 2 -norm, which is incorrect because the ℓ 1 -norm objective function is used in the following steps. In this paper, we consider a novel robust PCA method that can pursue and remove outliers, exactly recover a low-rank matrix and calculate the optimal mean. Specifically, we propose an optimization model constituted by a ℓ 2,1 -norm based loss function and a Schatten p -norm regularization term. The ℓ 2,1 -norm used in loss function aims to pursue and remove outliers, the Schatten p -norm can suppress the singular values of reconstructed data at smaller p (0 < p < 1), so it is a better approximation to the rank than the trace norm. Experimental results on benchmark databases demonstrate the effectiveness of our proposed algorithm.
Robust Formulation for PCA: Avoiding Mean Calculation with L2,p-norm Maximization

Shuangli Liao,Jin Li,Yang Liu,Quanxue Gao,Xinbo Gao

DOI: https://doi.org/10.1609/aaai.v32i1.11679

2018-01-01

Abstract:Most existing robust principal component analysis (PCA) involve mean estimation for extracting low-dimensional representation. However, they do not get the optimal mean for real data, which include outliers, under the different robust distances metric learning, such as L1-norm and L2,1-norm. This affects the robustness of algorithms. Motivated by the fact that the variance of data can be characterized by the variation between each pair of data, we propose a novel robust formulation for PCA. It avoids computing the mean of data in the criterion function. Our method employs L2,p-norm as the distance metric to measure the variation in the criterion function and aims to seek the projection matrix that maximizes the sum of variation between each pair of the projected data. Both theoretical analysis and experimental results demonstrate that our methods are efficient and superior to most existing robust methods for data reconstruction.
Robust Two-Dimensional Principal Component Analysis Via Alternating Optimization

Yipeng Sun,Xiaoming Tao,Yang Li,Jianhua Lu

DOI: https://doi.org/10.1109/icip.2013.6738070

2013-01-01

Abstract:To extract two-dimensional principal components from image samples while being insensitive to outliers, we propose a robust model for two-dimensional principal component analysis (robust 2D-PCA) by regularizing sparse penalty term. Moveover, we develop a novel iterative algorithm for robust 2D-PCA via alternating optimization, learning the projection matrices by bi-directional decomposition. To further speed up the iteration, we develop an alternating greedy approach, minimizing over the low-dimensional feature matrix and the sparse error matrix. Experimental results on dynamic background subtraction are evaluated to show the effectiveness of the proposed model, compared with conventional 2D-PCA and robust PCA algorithms.
Avoiding Optimal Mean ℓ 2,1 -Norm Maximization-Based Robust PCA for Reconstruction

Minnan Luo,Feiping Nie,Xiaojun Chang,Yi Yang,Alexander G. Hauptmann,Qinghua Zheng

DOI: https://doi.org/10.1162/neco_a_00937

IF: 3.278

2017-01-01

Neural Computation

Abstract:Robust principal component analysis (PCA) is one of the most important dimension-reduction techniques for handling high-dimensional data with outliers. However, most of the existing robust PCA presupposes that the mean of the data is zero and incorrectly utilizes the average of data as the optimal mean of robust PCA. In fact, this assumption holds only for the squared [Formula: see text]-norm-based traditional PCA. In this letter, we equivalently reformulate the objective of conventional PCA and learn the optimal projection directions by maximizing the sum of projected difference between each pair of instances based on [Formula: see text]-norm. The proposed method is robust to outliers and also invariant to rotation. More important, the reformulated objective not only automatically avoids the calculation of optimal mean and makes the assumption of centered data unnecessary, but also theoretically connects to the minimization of reconstruction error. To solve the proposed nonsmooth problem, we exploit an efficient optimization algorithm to soften the contributions from outliers by reweighting each data point iteratively. We theoretically analyze the convergence and computational complexity of the proposed algorithm. Extensive experimental results on several benchmark data sets illustrate the effectiveness and superiority of the proposed method.
Avoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy L1-norm Maximization

Minnan Luo,Feiping Nie,Xiaojun Chang,Yi Yang,Alexander G. Hauptmann,Qinghua Zheng

2016-01-01

Abstract:Robust principal component analysis (PCA) is one of the most important dimension reduction techniques to handle high-dimensional data with outliers. However, the existing robust PCA presupposes that the mean of the data is zero and incorrectly utilizes the Euclidean distance based optimal mean for robust PCA with l1-norm. Some studies consider this issue and integrate the estimation of the optimal mean into the dimension reduction objective, which leads to expensive computation. In this paper, we equivalently reformulate the maximization of variances for robust PCA, such that the optimal projection directions are learned by maximizing the sum of the projected difference between each pair of instances, rather than the difference between each instance and the mean of the data. Based on this reformulation, we propose a novel robust PCA to automatically avoid the calculation of the optimal mean based on l1-norm distance. This strategy also makes the assumption of centered data unnecessary. Additionally, we intuitively extend the proposed robust PCA to its 2D version for image recognition. Efficient non-greedy algorithms are exploited to solve the proposed robust PCA and 2D robust PCA with fast convergence and low computational complexity. Some experimental results on benchmark data sets demonstrate the effectiveness and superiority of the proposed approaches on image reconstruction and recognition.
Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

Shuangyan Yi,Zhenyu He,Weiguo Yang

DOI: https://doi.org/10.1109/spac.2017.8304243

2017-01-01

Abstract:Principal Component Analysis (PCA) is the most widely used unsupervised subspace learning method, and lots of its variants have been developed. With so many proposed PCA-like methods, it is still not clear that which features are better or worse for principal components, especially when the data suffers from outliers. To this end, we propose Robust Principal Component Analysis via joint ℓ 2,1 -norms minimization, which provides new insights into two crucial issues of PCA: feature selection and robustness to outliers. Unlike other PCA-like methods, the proposed method is able to select effective features for reconstruction by using the ℓ 2,1 -norm regularization term. More specific, we first use a ℓ 2,1 -norm based transformation matrix to select effective features that can effectively characterize key components (e.g., the eyes and the nose in a face image), and then use an orthogonal transformation matrix to recover the original data from the selected data representation. In this way, the key components can be well recovered by using the effective features selected by a learned transformation matrix. On the other hand, we also impose ℓ 2,1 -norm on a loss term to select clean samples to recover its same class samples but with outliers. A simple yet effective optimization algorithm is proposed to solve the resulting optimization problem. Experiments on six datasets demonstrate the effectiveness of the proposed method.
Robust Principal Component Analysis Via Optimal Mean by Joint ℓ2,1 and Schatten P-Norms Minimization

Xiaoshuang Shi,Feiping Nie,Zhihui Lai,Zhenhua Guo

DOI: https://doi.org/10.1016/j.neucom.2017.12.034

IF: 6

2018-01-01

Neurocomputing

Abstract:Since principal component analysis (PCA) is sensitive to corrupted variables or observations that affect its performance and applicability in real scenarios, some convex robust PCA methods have been developed to enhance the robustness of PCA. However, most of them neglect the optimal mean calculation problem. They center the data with the mean calculated by the l(2)-norm, which is incorrect because the l(1)-norm objective function is used in the following steps. In this paper, we consider a novel robust PCA method that can pursue and remove outliers, exactly recover a low-rank matrix and calculate the optimal mean. Specifically, we propose an optimization model constituted by a l(2,1)-norm based loss function and a Schatten p-norm regularization term. The l(2,1)-norm used in loss function aims to pursue and remove outliers, the Schatten p-norm can suppress the singular values of reconstructed data at smaller p (0 < p < 1), so it is a better approximation to the rank than the trace norm. Experimental results on benchmark databases demonstrate the effectiveness of our proposed algorithm. (C) 2017 Elsevier B.V. All rights reserved.
Robust PCA by Manifold Optimization

Teng Zhang,Yi Yang

2018-01-01

Journal of Machine Learning Research

Abstract:Robust PCA is a widely used statistical procedure to recover a underlying low-rank matrix with grossly corrupted observations. This work considers the problem of robust PCA as a nonconvex optimization problem on the manifold of low-rank matrices, and proposes two algorithms (for two versions of retractions) based on manifold optimization. It is shown that, with a proper designed initialization, the proposed algorithms are guaranteed to converge to the underlying low-rank matrix linearly. Compared with a previous work based on the Burer-Monterio decomposition of low-rank matrices, the proposed algorithms reduce the dependence on the conditional number of the underlying low-rank matrix theoretically. Simulations and real data examples confirm the competitive performance of our method.
Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Shuangyan Yi,Zhenyu He,Wei-guo Yang

DOI: https://doi.org/10.1109/spac.2017.8304243

2017-01-01

Abstract:Principal Component Analysis (PCA) is the most widely used unsupervised subspace learning method, and lots of its variants have been developed. With so many proposed PCA-like methods, it is still not clear that which features are better or worse for principal components, especially when the data suffers from outliers. To this end, we propose Robust Principal Component Analysis via joint l(2,1)-norms minimization, which provides new insights into two crucial issues of PCA: feature selection and robustness to outliers. Unlike other PCA-like methods, the proposed method is able to select effective features for reconstruction by using the l(2,1)-norm regularization term. More specific, we first use a l(2,1)-norm based transformation matrix to select effective features that can effectively characterize key components (e.g., the eyes and the nose in a face image), and then use an orthogonal transformation matrix to recover the original data from the selected data representation. In this way, the key components can be well recovered by using the effective features selected by a learned transformation matrix. On the other hand, we also impose l(2,1)-norm on a loss term to select clean samples to recover its same class samples but with outliers. A simple yet effective optimization algorithm is proposed to solve the resulting optimization problem. Experiments on six datasets demonstrate the effectiveness of the proposed method.
An Iterative Algorithm for Robust Kernel Principal Component Analysis

LEI WANG,YAN-WEI PANG,DAO-YI SHEN,NENG-HAI YU

DOI: https://doi.org/10.1109/ICMLC.2007.4370750

2007-01-01

Abstract:Principal component analysis (PCA) has been proven to be an efficient method in dimensionality reduction, feature extraction and pattern recognition. Kernel principal component analysis (KPCA) can be considered as a natural nonlinear generalization of PCA, which performs linear PCA in a high dimensional space implicitly by using kernel trick. However, both conventional PCA and KPCA suffer from the deficiency of being sensitive to outliers. Existing robust KPCA has to eigen-decompose the gram matrix directly in each step and is much more computationally infeasible due to the large size of the matrix when the number of training samples is large. By extending existing robust PCA algorithm using kernel methods, we present a novel robust adaptive algorithm for calculating the kernel principal components. The proposed method not only preserves the characteristic of capturing underlying nonlinear structure of KPCA but also is robust against outliers by restraining the effect of outlying samples. Compared with existing robust KPCA methods, our method is performed without having to store the kernel matrix, which can reduce significantly the storage burden. In addition, our method shows the potential of expansibility to the incremental learning version. Experimental results on synthetic data indicate that our improved algorithm is effective and promising.
Exactly Robust Kernel Principal Component Analysis

Jicong Fan,Tommy W. S. Chow

DOI: https://doi.org/10.1109/tnnls.2019.2909686

IF: 14.255

2020-03-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Robust principal component analysis (RPCA) can recover low-rank matrices when they are corrupted by sparse noises. In practice, many matrices are, however, of high rank and, hence, cannot be recovered by RPCA. We propose a novel method called robust kernel principal component analysis (RKPCA) to decompose a partially corrupted matrix as a sparse matrix plus a high- or full-rank matrix with low latent dimensionality. RKPCA can be applied to many problems such as noise removal and subspace clustering and is still the only unsupervised nonlinear method robust to sparse noises. Our theoretical analysis shows that, with high probability, RKPCA can provide high recovery accuracy. The optimization of RKPCA involves nonconvex and indifferentiable problems. We propose two nonconvex optimization algorithms for RKPCA. They are alternating direction method of multipliers with backtracking line search and proximal linearized minimization with adaptive step size (AdSS). Comparative studies in noise removal and robust subspace clustering corroborate the effectiveness and the superiority of RKPCA.

computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, hardware & architecture
Normalized Robust PCA With Adaptive Reconstruction Error Minimization

Yunlong Gao,Yuzhe Feng,Youwei Xie,Jinyan Pan,Feiping Nie

DOI: https://doi.org/10.1109/tkde.2023.3325462

IF: 9.235

2023-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Principal component analysis (PCA) is one of the most versatile techniques for unsupervised dimension reduction, which is implemented as a fundamental preprocessing method in multiple tasks of statistics and machine learning research because of its efficiency. Nevertheless, researchers have concentrated on the identification of outliers that do not conform to the low-dimensional approximation through statistical methods, e.g., outlier rejection, without giving insights on each data point with a dynamic ratio of signal-to-noise components in the high-dimensional regimes. To characterize the dynamic nature of the principal component information, we propose a Normalized Robust PCA with Adaptive Reconstruction Error minimization model, which considers both the adaptive normalization technique and flexible weights learning simultaneously. With this configuration, the principal component information constantly adjusts the degree of sparsity for activated samples. In other words, the signal component's discrimination and noise information restriction could work cooperatively. Empirical studies on one synthetic dataset and several benchmarks demonstrate the effectiveness of our proposed method over existing outlier rejection methods.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
BRIDGING CONVEX AND NONCONVEX OPTIMIZATION IN ROBUST PCA: NOISE, OUTLIERS, AND MISSING DATA

Yuxin Chen,Jianqing Fan,Cong Ma,Yuling Yan

DOI: https://doi.org/10.1214/21-aos2066

Abstract:This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as robust principal component analysis (robust PCA), finds applications in various domains. Despite the wide applicability of convex relaxation, the available statistical support (particularly the stability analysis vis-à-vis random noise) remains highly suboptimal, which we strengthen in this paper. When the unknown matrix is well-conditioned, incoherent, and of constant rank, we demonstrate that a principled convex program achieves near-optimal statistical accuracy, in terms of both the Euclidean loss and the ℓ ∞ loss. All of this happens even when nearly a constant fraction of observations are corrupted by outliers with arbitrary magnitudes. The key analysis idea lies in bridging the convex program in use and an auxiliary nonconvex optimization algorithm, and hence the title of this paper.
Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices Via Convex Optimization.

John Wright,Arvind Ganesh,Shankar R. Rao,YiGang Peng,Yi Ma

2009-01-01

Abstract:Principal component analysis is a fundamental operation in computational data analysis, with myriad applications ranging from web search to bioinformatics to computer vision and image analysis. However, its performance and applicability in real scenarios are limited by a lack of robustness to outlying or corrupted observations. This paper considers the idealized "robust principal component analysis" problem of recovering a low rank matrix A from corrupted observations D = A + E. Here, the corrupted entries E are unknown and the errors can be arbitrarily large (modeling grossly corrupted observations common in visual and bioinformatic data), but are assumed to be sparse. We prove that most matrices A can be efficiently and exactly recovered from most error sign-and-support patterns by solving a simple convex program, for which we give a fast and provably convergent algorithm. Our result holds even when the rank of A grows nearly proportionally (up to a logarithmic factor) to the dimensionality of the observation space and the number of errors E grows in proportion to the total number of entries in the matrix. A by-product of our analysis is the first proportional growth results for the related problem of completing a low-rank matrix from a small fraction of its entries. Simulations and real-data examples corroborate the theoretical results, and suggest potential applications in computer vision.
Improved Algorithms for High-Dimensional Robust Pca

Xiaoyong Lin,Zeqiu Zhang,Jue Wang,Zhaoyang Zhang,Tingting Qiu,Zhengkun Mi

DOI: https://doi.org/10.1109/icuwb.2016.7790402

2016-01-01

Abstract:Principal component analysis (PCA) is one of the most crucial dimensionality reduction methods and widely used in satellite image analysis, face recognition, social network feature extraction and other application scenarios. But it is fragile because of its quadratic error criterion when faced with outliers. There are many robust PCAs to solve this problem, however, when extended to the high-dimensional set, in which the dimensionality of dataset is comparable to the number of observations, the quality of their output will suffer dramatically. So the high-dimensional robust PCA is needed eagerly. HR-PCA and DHR-PCA are exactly the algorithms designed for this regime. They are robust and fit for high-dimensional space. However, attention has to be paid to the low efficiency and loss of useful information respectively in these two algorithms. Two improved algorithms are proposed in this paper to address these issues. Firstly, a preprocessing mechanism is added before performing HR-PCA so as to reduce the burden of HR-PCA. Secondly, we take different ways of changing weights of observations according to their outlyingness instead of decreasing all weights in DHR-PCA. From the simulation results, the improved algorithms are robust enough and have stable performance.
Bilinear Factor Matrix Norm Minimization for Robust PCA: Algorithms and Applications

Fanhua Shang,James Cheng,Yuanyuan Liu,Zhi-Quan Luo,Zhouchen Lin

DOI: https://doi.org/10.48550/arXiv.1810.05186

2018-10-12

Abstract:The heavy-tailed distributions of corrupted outliers and singular values of all channels in low-level vision have proven effective priors for many applications such as background modeling, photometric stereo and image alignment. And they can be well modeled by a hyper-Laplacian. However, the use of such distributions generally leads to challenging non-convex, non-smooth and non-Lipschitz problems, and makes existing algorithms very slow for large-scale applications. Together with the analytic solutions to lp-norm minimization with two specific values of p, i.e., p=1/2 and p=2/3, we propose two novel bilinear factor matrix norm minimization models for robust principal component analysis. We first define the double nuclear norm and Frobenius/nuclear hybrid norm penalties, and then prove that they are in essence the Schatten-1/2 and 2/3 quasi-norms, respectively, which lead to much more tractable and scalable Lipschitz optimization problems. Our experimental analysis shows that both our methods yield more accurate solutions than original Schatten quasi-norm minimization, even when the number of observations is very limited. Finally, we apply our penalties to various low-level vision problems, e.g., text removal, moving object detection, image alignment and inpainting, and show that our methods usually outperform the state-of-the-art methods.

Machine Learning,Computer Vision and Pattern Recognition,Optimization and Control

Robust Principal Component Analysis: A Construction Error Minimization Perspective

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Efficient Optimization Algorithms for Robust Principal Component Analysis and Its Variants

An Alternating Minimization Method for Robust Principal Component Analysis

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Robust principal component analysis via optimal mean by joint ℓ

Robust Formulation for PCA: Avoiding Mean Calculation with L2,p-norm Maximization

Robust Two-Dimensional Principal Component Analysis Via Alternating Optimization

Avoiding Optimal Mean ℓ 2,1 -Norm Maximization-Based Robust PCA for Reconstruction

Avoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy L1-norm Maximization

Robust Principal Component Analysis Via Joint ℓ&lt;inf&gt;2,1&lt;/inf&gt;-Norms Minimization

Robust Principal Component Analysis Via Optimal Mean by Joint ℓ2,1 and Schatten P-Norms Minimization

Robust PCA by Manifold Optimization

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Exactly Robust Kernel Principal Component Analysis

Normalized Robust PCA With Adaptive Reconstruction Error Minimization

BRIDGING CONVEX AND NONCONVEX OPTIMIZATION IN ROBUST PCA: NOISE, OUTLIERS, AND MISSING DATA

Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices Via Convex Optimization.

Improved Algorithms for High-Dimensional Robust Pca

Bilinear Factor Matrix Norm Minimization for Robust PCA: Algorithms and Applications

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization