Abstract:Low-rank matrix recovery is a major challenge in machine learning and computer vision, particularly for large-scale data matrices, as popular methods involving nuclear norm and singular value decomposition (SVD) are associated with high computational costs and biased estimators. To overcome this challenge, we propose a novel approach to learning low-rank matrices based on the matrix volume and a nonconvex logarithmic function. The matrix volume is the product of all the nonzero singular values of a matrix and has unique geometric properties and connections with other convex and nonconvex functions. We establish a generalized nonconvex regularization problem using the penalty function strategy and introduce an accelerated proximal alternating linearized minimization (AccPALM) algorithm with double acceleration, which combines Nesterov's acceleration and power strategy. The algorithm reduces computational costs and has provable convergence results under the Kurdyka-Łojasiewicz (KŁ) inequality with mild conditions. Our approach shows superior accuracy, efficiency, and convergence behavior compared to other low-rank matrix learning methods on robust matrix completion (RMC) and low-rank representation (LRR) tasks. We analyze the impact of algorithm parameters on convergence and performance and present visually appealing results to further demonstrate the effectiveness of our approach. The proposed methodology represents a promising advance in the field of low-rank matrix recovery, and its effectiveness has been validated via extensive numerical experiments. The source code for the proposed algorithms is accessible at https://github.com/ZhangHengMin/AccPALMcodes.

The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices

Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix

Fast Algorithms for Recovering a Corrupted Low-Rank Matrix

Fast Algorithms for Recovering a Corrupted

Fast Convex Optimization Algorithms for the Recovery of a Corrupted Low-Rank Matrix

Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices Via Convex Optimization.

Accelerated Matrix Recovery Via Random Projection Based on Inexact Augmented Lagrange Multiplier Method

Robust Principal Component Analysis with Missing Data.

Accelerated PALM for Nonconvex Low-Rank Matrix Recovery with Theoretical Analysis

Recovery of corrupted low-rank matrices via half-quadratic based nonconvex minimization

Nonconvex Robust Low-rank Matrix Recovery

Nonconvex relaxation approaches to robust matrix recovery

Proximity Point Algorithm for Low-Rank Matrix Recovery from Sparse Noise Corrupted Data

Practical low-rank matrix approximation under robust L<inf>1</inf>-norm

Accelerated algorithms for low-rank matrix recovery

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

Exact low-rank matrix completion from sparsely corrupted entries via adaptive outlier pursuit

Robust Low-Rank Matrix Recovery As Mixed Integer Programming Via $\ell _{0}$-Norm Optimization.

Dense Error Correction for Low-Rank Matrices via Principal Component Pursuit

Strongly Convex Programming for Exact Matrix Completion and Robust Principal Component Analysis

Robust PCA via Nonconvex Rank Approximation