Abstract:This paper proposes scalable and fast algorithms for solving the Robust PCA problem, namely recovering a low-rank matrix with an unknown fraction of its entries being arbitrarily corrupted. This problem arises in many applications, such as image processing, web data ranking, and bioinformatic data analysis. It was recently shown that under surprisingly broad conditions, the Robust PCA problem can be exactly solved via convex optimization that minimizes a combination of the nuclear norm and the ℓ^1-norm . In this paper, we apply the method of augmented Lagrange multipliers (ALM) to solve this convex program. As the objective function is non-smooth, we show how to extend the classical analysis of ALM to such new objective functions and prove the optimality of the proposed algorithms and characterize their convergence rate. Empirically, the proposed new algorithms can be more than five times faster than the previous state-of-the-art algorithms for Robust PCA, such as the accelerated proximal gradient (APG) algorithm. Moreover, the new algorithms achieve higher precision, yet being less storage/memory demanding. We also show that the ALM technique can be used to solve the (related but somewhat simpler) matrix completion problem and obtain rather promising results too. We further prove the necessary and sufficient condition for the inexact ALM to converge globally. Matlab code of all algorithms discussed are available at http://perception.csl.illinois.edu/matrix-rank/home.html

Strongly Convex Programming for Exact Matrix Completion and Robust Principal Component Analysis

Robust Principal Component Analysis with Missing Data.

Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices Via Convex Optimization.

Robust PCA via Nonconvex Rank Approximation

Robust principal component analysis: A factorization-based approach with linear complexity

Exact Solution Analysis of Strongly Convex Programming for Principal Component Pursuit.

Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix

RAP: Scalable RPCA for Low-rank Matrix Recovery

Exactly Robust Kernel Principal Component Analysis

BRIDGING CONVEX AND NONCONVEX OPTIMIZATION IN ROBUST PCA: NOISE, OUTLIERS, AND MISSING DATA

Robust Matrix Completion via Maximum Correntropy Criterion and Half Quadratic Optimization

Nonconvex relaxation approaches to robust matrix recovery

Stable principal component pursuit

A New Nonconvex Rank Approximation of RPCA

Robust principal component analysis?

RES-PCA: A Scalable Approach to Recovering Low-Rank Matrices

Nearly-optimal Robust Matrix Completion

Exact low-rank matrix completion via convex optimization

Robust Principal Component Analysis with Matrix Factorization

Fast Convex Optimization Algorithms for the Recovery of a Corrupted Low-Rank Matrix

The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices