Abstract:Robust principal component analysis (RPCA) via decomposition into low-rank plus sparse matrices offers a powerful framework for a large variety of applications such as image processing, video processing, and 3-D computer vision. Indeed, most of the time these applications require to detect sparse outliers from the observed imagery data that can be approximated by a low-rank matrix. Moreover, most of the time experiments show that RPCA with additional spatial and/or temporal constraints often outperforms the state-of-the-art algorithms in these applications. Thus, the aim of this paper is to survey the applications of RPCA in computer vision. In the first part of this paper, we review representative image processing applications as follows: 1) low-level imaging such as image recovery and denoising, image composition, image colorization, image alignment and rectification, multifocus image, and face recognition; 2) medical imaging such as dynamic magnetic resonance imaging (MRI) for acceleration of data acquisition, background suppression, and learning of interframe motion fields; and 3) imaging for 3-D computer vision with additional depth information such as in structure from motion (SfM) and 3-D motion recovery. In the second part, we present the applications of RPCA in video processing which utilize additional spatial and temporal information compared to image processing. Specifically, we investigate video denoising and restoration, hyperspectral video, and background/foreground separation. Finally, we provide perspectives on possible future research directions and algorithmic frameworks that are suitable for these applications.

Learning Robust and Sparse Principal Components With the α–Divergence

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

An Alternating Minimization Method for Robust Principal Component Analysis

Robust Covariance Estimation for Distributed Principal Component Analysis

$e^{\text{RPCA}}$: Robust Principal Component Analysis for Exponential Family Distributions

Bayesian Robust Principal Component Analysis with Adaptive Singular Value Penalty

A Nonconvex Projection Method for Robust PCA

On the Applications of Robust PCA in Image and Video Processing

Ensemble Principal Component Analysis

Dual Principal Component Pursuit: Probability Analysis and Efficient Algorithms

Sparse principal component analysis via regularized low rank matrix approximation

Online Robust Principal Component Analysis Via Truncated Nuclear Norm Regularization.

Exactly Robust Kernel Principal Component Analysis

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

Deep Unrolling for Nonconvex Robust Principal Component Analysis

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations