Abstract:Principal component analysis (PCA) is widely used to extract features and reduce dimensionality in various computer vision and image/video processing tasks. Conventional approaches either lack robustness to outliers and corrupted data or are designed for one-dimensional signals. To address this problem, we propose a robust PCA model for two-dimensional images incorporating structured sparse priors, referred to as structured sparse 2D-PCA. This robust model considers the prior of structured and grouped pixel values in two dimensions. As the proposed formulation is jointly nonconvex and nonsmooth, which is difficult to tackle by joint optimization, we develop a two-stage alternating minimization approach to solve the problem. This approach iteratively learns the projection matrices by bidirectional decomposition and utilizes the proximal method to obtain the structured sparse outliers. By considering the structured sparsity prior, the proposed model becomes less sensitive to noisy data and outliers in two dimensions. Moreover, the computational cost indicates that the robust two-dimensional model is capable of processing quarter common intermediate format video in real time, as well as handling large-size images and videos, which is often intractable with other robust PCA approaches that involve image-to-vector conversion. Experimental results on robust face reconstruction, video background subtraction data set, and real-world videos show the effectiveness of the proposed model compared with conventional 2D-PCA and other robust PCA algorithms.

Angle 2DPCA: A New Formulation for 2DPCA.

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

A Robust Optimal Mean Cosine Angle 2DPCA for Image Feature Extraction

A joint-norm distance metric 2DPCA for robust dimensionality reduction

( 2 D ) 2 PCA : 2-Directional 2-Dimensional PCA for Efficient Face Representation and Recognition

(2D)(2)pca: Two-Directional Two-Dimensional Pca for Efficient Face Representation and Recognition

Criteria for 2DPCA Superior to PCA in Image Feature Extraction

&#8467;1 Major Component Detection and Analysis (&#8467;1 MCDA): Foundations in Two Dimensions

Double L<sub>2,p</sub>-norm based PCA for feature extraction

Cosine 2DPCA With Weighted Projection Maximization

Two-Dimensional Euler PCA for Face Recognition

The Equivalence of Two-Dimensional PCA to Line-Based PCA

Robust 2DPCA With Non-greedy $\ell _{1}$ -Norm Maximization for Image Analysis

Improved Algorithms for High-Dimensional Robust Pca

ℓ1 Major Component Detection and Analysis (ℓ1 MCDA): Foundations in Two Dimensions

Complete Two-Dimensional PCA for Face Recognition

F ‐norm two‐dimensional linear discriminant analysis and its application on face recognition

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Avoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy L1-norm Maximization

Robust 2D Principal Component Analysis: A Structured Sparsity Regularized Approach.

Dual Principal Component Pursuit: Probability Analysis and Efficient Algorithms

Angle 2DPCA: A New Formulation for 2DPCA.

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

A Robust Optimal Mean Cosine Angle 2DPCA for Image Feature Extraction

A joint-norm distance metric 2DPCA for robust dimensionality reduction

( 2 D ) 2 PCA : 2-Directional 2-Dimensional PCA for Efficient Face Representation and Recognition

(2D)(2)pca: Two-Directional Two-Dimensional Pca for Efficient Face Representation and Recognition

Criteria for 2DPCA Superior to PCA in Image Feature Extraction

&amp;#8467;1 Major Component Detection and Analysis (&amp;#8467;1 MCDA): Foundations in Two Dimensions

Double L<sub>2,p</sub>-norm based PCA for feature extraction

Cosine 2DPCA With Weighted Projection Maximization

Two-Dimensional Euler PCA for Face Recognition

The Equivalence of Two-Dimensional PCA to Line-Based PCA

Robust 2DPCA With Non-greedy $\ell _{1}$ -Norm Maximization for Image Analysis

Improved Algorithms for High-Dimensional Robust Pca

ℓ1 Major Component Detection and Analysis (ℓ1 MCDA): Foundations in Two Dimensions

Complete Two-Dimensional PCA for Face Recognition

F ‐norm two‐dimensional linear discriminant analysis and its application on face recognition

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Avoiding Optimal Mean Robust PCA/2DPCA with Non-Greedy L1-norm Maximization

Robust 2D Principal Component Analysis: A Structured Sparsity Regularized Approach.

Dual Principal Component Pursuit: Probability Analysis and Efficient Algorithms

ℓ1 Major Component Detection and Analysis (ℓ1 MCDA): Foundations in Two Dimensions