Abstract:In paper, we focus on the computation of the principal components for a general tensor, known as the tensor principal component analysis (PCA) problem. It has been proven that the general tensor PCA problem is reducible to its matricization form when the order is even. Usually it is considered as low-rank matrix completion problems theoretically. It is common to consider nuclear norm as a surrogate of the rank operator since it is the tightest convex lower bound of the rank operator under certain condition. However, most nuclear norm minimization based approaches involve numbers of singular value decomposition (SVD) operations. Given a matrix X ∈ R m × n , the time complexity of SVD operation is O(mn 2 ), which brings prohibitive computational burden to apply these methods in real applications. However, the problem is non-convex, and the proximal mapping associated with non-convex regularization is not easy to compute. It is always solved by the Linearized Alternating Direction Method of Multipliers (LADMM). Despite the success of LADMM in practice, it remains unknown if LADMM is convergent in solving such non-convex compositely regularized optimization. In this paper, we firstly present a detailed convergence analysis of the LADMM algorithm for solving non-convex compositely regularized optimization with a large class of non-convex penalties. Furthermore, we propose a new efficient and scalable algorithm for matrix principal component analysis called Proximal Linearized Alternating Direction Method of Multipliers for Principal Component Analysis(PLADMPCA). Different from traditional matrix factorization methods, PLADMPCA utilizes the linearization technique to formulate the matrix as an outer product of vectors, which greatly improves the computational efficacy compared to matrix factorization method. We empirically evaluate the proposed algorithm PLADMPCA on synthetic tensor data with different order. Results have shown that PLADMPCA have much better computational cost to matrix factorization based method. At the same time, it outperforms the state-of-art SVD based matrix completion algorithms by similar or better reconstruction accuracy with enormous advantages on efficiency.

Fast Tensor Principal Component Analysis Via Proximal Alternating Direction Method with Vectorized Technique

An Efficient Algorithm for Tensor Principal Component Analysis Via Proximal Linearized Alternating Direction Method of Multipliers

Improved Robust Tensor Principal Component Analysis for Accelerating Dynamic MR Imaging Reconstruction

Fast and Provable Nonconvex Tensor RPCA.

Accelerated Alternating Projections for Robust Principal Component Analysis.

A Faster Tensor Robust PCA Via Tensor Factorization

A Factorization Strategy for Tensor Robust PCA.

Tensor Principal Component Analysis Via Convex Optimization

Improved Robust Tensor Principal Component Analysis Via Low-Rank Core Matrix

A Fast Correction Approach to Tensor Robust Principal Component Analysis

Tensor Robust Principal Component Analysis Via Non-convex Low-Rank Approximation Based on the Laplace Function

A Lagrange–Newton Algorithm for Tensor Sparse Principal Component Analysis

Fast and Provable Tensor Robust Principal Component Analysis via Scaled Gradient Descent

Online Multilinear Principal Component Analysis.

Frequency-Weighted Robust Tensor Principal Component Analysis

Robust Tensor Principal Component Analysis in All Modes

Tensor Robust Kernel PCA for Multidimensional Data

A New Method of Fast-complete Matrix-projection Principal Component Analysis

Globally Convergent Accelerated Proximal Alternating Maximization Method for L1-Principal Component Analysis.

T-SVD Based Non-convex Tensor Completion and Robust Principal Component Analysis.

Double Auto-Weighted Tensor Robust Principal Component Analysis