Abstract:In the past decade, robust principal component analysis (RPCA) and low-rank matrix completion (LRMC), as two very important optimization problems with the view of recovering original low-rank matrix from sparsely and highly corrupted observations or a subset of its entries, have already been successfully adopted in image denoising, video processing, web search, biological information, etc. This paper proposes an efficient and effective algorithm, named the alternating direction and step size minimization (ADSM) algorithm, which employs the alternating direction minimization idea to solve the general relaxed model that can describe small noise (e.g., Gaussian noise). The coupling of sparse noise and small noise makes low-rank matrix recovery more challenging than that of RPCA. We make use of Taylor expansion, singular value decomposition and shrinkage operator as the alternating direction minimization method to deduce iterative direction matrices. A continuous technology is incorporated into ADSM to accelerate convergence. Similarly, the Taylor expansion and step size minimization (TESM) algorithm for LRMC is designed by the above way, but the alternating direction minimization idea needs to be ruled out since there is not a sparse matrix in it. Theoretically, it is proved that the two algorithms globally converge to their respective optimal points based on some conditions. The numerical results are reported, illustrating that ADSM and TESM are quite efficient and effective for recovering large-scale low-rank matrix problems at many cases.

Experimental Observation on a Low-Rank Tensor Model for Eigenvalue Problems.

Iterative Tensor Eigen Rank Minimization for Low-Rank Tensor Completion.

Subspace Methods with Local Refinements for Eigenvalue Computation Using Low-Rank Tensor-Train Format.

On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems

Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization

Robust Low-Rank Tensor Recovery Via Nonconvex Singular Value Minimization.

Low-rank tensor completion via tensor joint rank with logarithmic composite norm

Low-rank Tensor Train for Tensor Robust Principal Component Analysis.

Laplace Function Based Nonconvex Surrogate for Low-Rank Tensor Completion

Low-Rank Tensor Learning by Generalized Nonconvex Regularization

Robust low tubal rank tensor recovery via L 2 E criterion

Multilinear Low-Rank Tensors on Graphs & Applications

Tensor Network States with Low-Rank Tensors

Sparse and Low-Rank High-Order Tensor Regression via Parallel Proximal Method

Sine Activated Low-Rank Matrices for Parameter Efficient Learning

A Flexible Power Method for Solving Infinite Dimensional Tensor Eigenvalue Problems

Beyond Low Rank: A Data-Adaptive Tensor Completion Method

Low-Rank Tensor Completion Based on Self-Adaptive Learnable Transforms.

Exploiting the Structure Effectively and Efficiently in Low Rank Matrix Recovery.

Solving a Class of Infinite-Dimensional Tensor Eigenvalue Problems by Translational Invariant Tensor Ring Approximations

Alternating Direction and Taylor Expansion Minimization Algorithms for Unconstrained Nuclear Norm Optimization.