Abstract:Low-rank matrix recovery is a major challenge in machine learning and computer vision, particularly for large-scale data matrices, as popular methods involving nuclear norm and singular value decomposition (SVD) are associated with high computational costs and biased estimators. To overcome this challenge, we propose a novel approach to learning low-rank matrices based on the matrix volume and a nonconvex logarithmic function. The matrix volume is the product of all the nonzero singular values of a matrix and has unique geometric properties and connections with other convex and nonconvex functions. We establish a generalized nonconvex regularization problem using the penalty function strategy and introduce an accelerated proximal alternating linearized minimization (AccPALM) algorithm with double acceleration, which combines Nesterov's acceleration and power strategy. The algorithm reduces computational costs and has provable convergence results under the Kurdyka-Łojasiewicz (KŁ) inequality with mild conditions. Our approach shows superior accuracy, efficiency, and convergence behavior compared to other low-rank matrix learning methods on robust matrix completion (RMC) and low-rank representation (LRR) tasks. We analyze the impact of algorithm parameters on convergence and performance and present visually appealing results to further demonstrate the effectiveness of our approach. The proposed methodology represents a promising advance in the field of low-rank matrix recovery, and its effectiveness has been validated via extensive numerical experiments. The source code for the proposed algorithms is accessible at https://github.com/ZhangHengMin/AccPALMcodes.

Accelerated Matrix Recovery Via Random Projection Based on Inexact Augmented Lagrange Multiplier Method

The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

Convergence of projected Landweber iteration for matrix rank minimization

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

Riemannian Pursuit for Big Matrix Recovery.

Accelerated PALM for Nonconvex Low-Rank Matrix Recovery with Theoretical Analysis

Accelerated Low-Rank Visual Recovery by Random Projection

Matrix Recovery with Implicitly Low-Rank Data.

Randomized Truncated Pivoted QLP Factorization for Low-Rank Matrix Recovery

Mixture Augmented Lagrange Multiplier Method for Tensor Recovery

Accelerated algorithms for low-rank matrix recovery

Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix

Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices Via Convex Optimization.

Accelerated Alternating Projections for Robust Principal Component Analysis.

Pathwise Component Descent Method with MC+ Penalty for Low Rank Matrix Recovery

Low-rank matrix recovery with non-quadratic loss: projected gradient method and regularity projection oracle

Nonconvex relaxation approaches to robust matrix recovery

Fast Convex Optimization Algorithms for the Recovery of a Corrupted Low-Rank Matrix

Fast Algorithms for Recovering a Corrupted

Fast Algorithms for Recovering a Corrupted Low-Rank Matrix