Abstract:Robust principal component analysis (RPCA) via decomposition into low-rank plus sparse matrices offers a powerful framework for a large variety of applications such as image processing, video processing, and 3-D computer vision. Indeed, most of the time these applications require to detect sparse outliers from the observed imagery data that can be approximated by a low-rank matrix. Moreover, most of the time experiments show that RPCA with additional spatial and/or temporal constraints often outperforms the state-of-the-art algorithms in these applications. Thus, the aim of this paper is to survey the applications of RPCA in computer vision. In the first part of this paper, we review representative image processing applications as follows: 1) low-level imaging such as image recovery and denoising, image composition, image colorization, image alignment and rectification, multifocus image, and face recognition; 2) medical imaging such as dynamic magnetic resonance imaging (MRI) for acceleration of data acquisition, background suppression, and learning of interframe motion fields; and 3) imaging for 3-D computer vision with additional depth information such as in structure from motion (SfM) and 3-D motion recovery. In the second part, we present the applications of RPCA in video processing which utilize additional spatial and temporal information compared to image processing. Specifically, we investigate video denoising and restoration, hyperspectral video, and background/foreground separation. Finally, we provide perspectives on possible future research directions and algorithmic frameworks that are suitable for these applications.

Robust High-Order Manifold Constrained Sparse Principal Component Analysis for Image Representation

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Improved Algorithms for High-Dimensional Robust Pca

An Alternating Minimization Method for Robust Principal Component Analysis

Robust Sparse Principal Component Analysis

Robust principal component analysis for sparse face recognition

Robust 2D Principal Component Analysis: A Structured Sparsity Regularized Approach.

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

Robust High-Order Manifold Constrained Low Rank Representation for Subspace Clustering

Avoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy L1-norm Maximization

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Manifold constrained joint sparse learning via non-convex regularization

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

Exactly Robust Kernel Principal Component Analysis

Improve Robustness of Sparse Pca by L-1-Norm Maximization

Robust PCA Using Generalized Nonconvex Regularization.

Robust PCA by Manifold Optimization

A Nonconvex Projection Method for Robust PCA

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

On the Applications of Robust PCA in Image and Video Processing